2019-12-16T22:31:55.252 INFO:root:teuthology version: 1.0.0-dcf4da1 2019-12-16T22:31:55.253 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.TGtjHe.tmp -- --verbose --lock --description rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-fsx-workunit.yaml} --name sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi --block --owner scheduled_sage@teuthology --archive /home/teuthworker/archive/sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi/4609548 2019-12-16T22:31:55.345 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-16T22:31:55.409 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi/4609548 branch: wip-sage3-testing-2019-12-16-1157 description: rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-fsx-workunit.yaml} email: null first_in_suite: false job_id: '4609548' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: run two ceph clusters and install rbd-mirror - desc: configure the permissions for client.mirror - desc: 2 ceph clusters with 1 mon and 3 osds each - desc: run four rbd-mirror daemons per cluster - desc: run multiple FSX workloads to simulate cluster load and then verify that the images were replicated name: sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: ubuntu os_version: '18.04' overrides: admin_socket: branch: wip-sage3-testing-2019-12-16-1157 ceph: conf: client: debug rbd: 20 debug rbd_mirror: 15 log to stderr: false rbd default features: 125 rbd mirror image policy type: none client.mirror.0: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.1: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.2: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.3: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid global: mon client directed command retry: 5 ms inject socket failures: 5000 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 8a58d0694cce968d9a21937d52c2e48cfe306455 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: 8a58d0694cce968d9a21937d52c2e48cfe306455 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-sage3-testing-2019-12-16-1157 sha1: 8a58d0694cce968d9a21937d52c2e48cfe306455 owner: scheduled_sage@teuthology priority: 49 repo: git://git.ceph.com/ceph-ci.git roles: - - cluster1.mon.a - cluster1.mgr.x - cluster2.mgr.x - cluster1.osd.0 - cluster1.osd.1 - cluster1.osd.2 - cluster1.client.0 - cluster2.client.0 - - cluster2.mon.a - cluster2.osd.0 - cluster2.osd.1 - cluster2.osd.2 - cluster1.client.mirror - cluster1.client.mirror.0 - cluster1.client.mirror.1 - cluster1.client.mirror.2 - cluster1.client.mirror.3 - cluster1.client.mirror.4 - cluster1.client.mirror.5 - cluster1.client.mirror.6 - cluster2.client.mirror - cluster2.client.mirror.0 - cluster2.client.mirror.1 - cluster2.client.mirror.2 - cluster2.client.mirror.3 - cluster2.client.mirror.4 - cluster2.client.mirror.5 - cluster2.client.mirror.6 sha1: 8a58d0694cce968d9a21937d52c2e48cfe306455 suite: rbd suite_branch: wip-sage3-testing-2019-12-16-1157 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 8a58d0694cce968d9a21937d52c2e48cfe306455 tasks: - install: extra_packages: - rbd-mirror - ceph: cluster: cluster1 - ceph: cluster: cluster2 - exec: cluster1.client.mirror.0: - sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - rbd-mirror: client: cluster1.client.mirror.0 thrash: true - rbd-mirror: client: cluster1.client.mirror.1 thrash: true - rbd-mirror: client: cluster1.client.mirror.2 thrash: true - rbd-mirror: client: cluster1.client.mirror.3 thrash: true - rbd-mirror: client: cluster2.client.mirror.0 thrash: true - rbd-mirror: client: cluster2.client.mirror.1 thrash: true - rbd-mirror: client: cluster2.client.mirror.2 thrash: true - rbd-mirror: client: cluster2.client.mirror.3 thrash: true - rbd-mirror-thrash: cluster: cluster1 - rbd-mirror-thrash: cluster: cluster2 - workunit: clients: cluster1.client.mirror: - rbd/rbd_mirror_fsx_prepare.sh env: CEPH_ARGS: '' RBD_MIRROR_NOCLEANUP: '1' RBD_MIRROR_USE_EXISTING_CLUSTER: '1' RBD_MIRROR_USE_RBD_MIRROR: '1' - rbd_fsx: clients: - cluster1.client.mirror.0 - cluster1.client.mirror.1 - cluster1.client.mirror.2 - cluster1.client.mirror.3 - cluster1.client.mirror.4 - cluster1.client.mirror.5 keep_images: true ops: 6000 pool_name: mirror - workunit: clients: cluster1.client.mirror: - rbd/rbd_mirror_fsx_compare.sh env: CEPH_ARGS: '' RBD_MIRROR_USE_EXISTING_CLUSTER: '1' RBD_MIRROR_USE_RBD_MIRROR: '1' timeout: 6h teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.22728 2019-12-16T22:31:55.409 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa; will attempt to use it 2019-12-16T22:31:55.410 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks 2019-12-16T22:31:55.410 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-16T22:31:55.412 INFO:teuthology.task.internal:Checking packages... 2019-12-16T22:31:55.424 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '8a58d0694cce968d9a21937d52c2e48cfe306455' 2019-12-16T22:31:55.424 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-16T22:31:55.424 INFO:teuthology.packaging:ref: None 2019-12-16T22:31:55.424 INFO:teuthology.packaging:tag: None 2019-12-16T22:31:55.424 INFO:teuthology.packaging:branch: wip-sage3-testing-2019-12-16-1157 2019-12-16T22:31:55.425 INFO:teuthology.packaging:sha1: 8a58d0694cce968d9a21937d52c2e48cfe306455 2019-12-16T22:31:55.425 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=wip-sage3-testing-2019-12-16-1157 2019-12-16T22:31:55.586 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:31:55.586 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-16T22:31:55.597 INFO:teuthology.task.internal:no buildpackages task found 2019-12-16T22:31:55.597 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-16T22:31:55.612 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-16T22:31:55.612 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-16T22:31:55.663 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-16T22:32:05.681 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-16T22:32:15.698 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_sage@teuthology', 'description': '/home/teuthworker/archive/sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi/4609548', 'machine_type': 'smithi'} 2019-12-16T22:32:15.715 DEBUG:teuthology.lock.ops:locked ubuntu@smithi177.front.sepia.ceph.com, ubuntu@smithi106.front.sepia.ceph.com 2019-12-16T22:32:15.793 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-16T22:32:16.027 INFO:teuthology.provision.fog.smithi106:Scheduling deploy of ubuntu 18.04 2019-12-16T22:32:16.031 INFO:teuthology.provision.fog.smithi177:Scheduling deploy of ubuntu 18.04 2019-12-16T22:32:16.395 INFO:teuthology.orchestra.console:Power off smithi177 2019-12-16T22:32:16.396 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-16T22:32:16.420 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:16.466 INFO:teuthology.orchestra.console:Power off smithi106 2019-12-16T22:32:16.467 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-16T22:32:16.493 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:20.484 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:20.521 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:24.612 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:24.635 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:24.848 INFO:teuthology.orchestra.console:Power off for smithi106 completed 2019-12-16T22:32:24.950 INFO:teuthology.orchestra.console:Power on smithi106 2019-12-16T22:32:24.950 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-16T22:32:24.973 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:28.728 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:28.938 INFO:teuthology.orchestra.console:Power off for smithi177 completed 2019-12-16T22:32:29.000 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:29.040 INFO:teuthology.orchestra.console:Power on smithi177 2019-12-16T22:32:29.040 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-16T22:32:29.067 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:33.092 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:33.111 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi106.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:33.322 INFO:teuthology.orchestra.console:Power on for smithi106 completed 2019-12-16T22:32:33.423 INFO:teuthology.provision.fog.smithi106:Waiting for deploy to finish 2019-12-16T22:32:37.204 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi177.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-16T22:32:37.417 INFO:teuthology.orchestra.console:Power on for smithi177 completed 2019-12-16T22:32:37.518 INFO:teuthology.provision.fog.smithi177:Waiting for deploy to finish 2019-12-16T22:35:23.857 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:35:32.941 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:35:41.997 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:35:50.087 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:35:51.049 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:35:59.145 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:00.106 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:08.205 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:09.162 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:17.261 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:18.217 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:26.317 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:35.374 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:44.433 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:36:53.521 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:24.242 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:24.349 INFO:teuthology.orchestra.run.smithi177:> hostname 2019-12-16T22:37:24.890 INFO:teuthology.orchestra.run.smithi177.stdout:smithi177.front.sepia.ceph.com 2019-12-16T22:37:24.891 INFO:teuthology.orchestra.run.smithi177:> grep smithi177.front.sepia.ceph.com /etc/hosts 2019-12-16T22:37:24.898 INFO:teuthology.orchestra.run.smithi177.stdout:172.21.15.177 smithi177.front.sepia.ceph.com smithi177 2019-12-16T22:37:24.898 INFO:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2019-12-16T22:37:25.007 INFO:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hosts 2019-12-16T22:37:25.017 INFO:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/172.21.15.177/172.21.15.177/g' /etc/hosts 2019-12-16T22:37:25.075 INFO:teuthology.orchestra.run.smithi177:> sudo sed -i -e 's/smithi177.front.sepia.ceph.com/smithi177/g' /etc/hostname 2019-12-16T22:37:25.139 INFO:teuthology.orchestra.run.smithi177:> sudo hostname smithi177 2019-12-16T22:37:25.194 INFO:teuthology.provision.fog.smithi177:Deploy complete! 2019-12-16T22:37:25.196 DEBUG:teuthology.parallel:result is None 2019-12-16T22:37:31.054 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:31.703 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-12-16T22:37:37.705 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:37.715 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-12-16T22:37:43.717 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:43.726 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-12-16T22:37:49.729 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:50.754 ERROR:paramiko.transport:Socket exception: Connection reset by peer (104) 2019-12-16T22:37:56.757 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:56.877 INFO:teuthology.orchestra.run.smithi106:> hostname 2019-12-16T22:37:57.444 INFO:teuthology.orchestra.run.smithi106.stdout:smithi106.front.sepia.ceph.com 2019-12-16T22:37:57.445 INFO:teuthology.orchestra.run.smithi106:> grep smithi106.front.sepia.ceph.com /etc/hosts 2019-12-16T22:37:57.452 INFO:teuthology.orchestra.run.smithi106.stdout:172.21.15.106 smithi106.front.sepia.ceph.com smithi106 2019-12-16T22:37:57.453 INFO:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2019-12-16T22:37:57.520 INFO:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hosts 2019-12-16T22:37:57.577 INFO:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/172.21.15.106/172.21.15.106/g' /etc/hosts 2019-12-16T22:37:57.633 INFO:teuthology.orchestra.run.smithi106:> sudo sed -i -e 's/smithi106.front.sepia.ceph.com/smithi106/g' /etc/hostname 2019-12-16T22:37:57.696 INFO:teuthology.orchestra.run.smithi106:> sudo hostname smithi106 2019-12-16T22:37:57.752 INFO:teuthology.provision.fog.smithi106:Deploy complete! 2019-12-16T22:37:57.761 DEBUG:teuthology.parallel:result is None 2019-12-16T22:37:57.971 INFO:teuthology.lock.ops:Checking smithi177.front.sepia.ceph.com 2019-12-16T22:37:57.971 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-16T22:37:57.992 INFO:teuthology.lock.ops:Checking smithi106.front.sepia.ceph.com 2019-12-16T22:37:57.992 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-16T22:37:58.009 INFO:teuthology.lock.ops:Updating [smithi177.front.sepia.ceph.com]: set os type and version on server 2019-12-16T22:37:58.009 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-16T22:37:58.010 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:58.081 INFO:teuthology.orchestra.run.smithi177:> true 2019-12-16T22:37:58.317 INFO:teuthology.orchestra.run.smithi177:> uname -m 2019-12-16T22:37:58.363 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2019-12-16T22:37:58.364 INFO:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2019-12-16T22:37:58.412 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2019-12-16T22:37:58.412 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-16T22:37:58.412 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2019-12-16T22:37:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2019-12-16T22:37:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-16T22:37:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="18.04" 2019-12-16T22:37:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-16T22:37:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-16T22:37:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-16T22:37:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-16T22:37:58.414 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=bionic 2019-12-16T22:37:58.414 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=bionic 2019-12-16T22:37:58.414 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2019-12-16T22:37:58.430 INFO:teuthology.lock.ops:Updating [smithi106.front.sepia.ceph.com]: set os type and version on server 2019-12-16T22:37:58.430 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-16T22:37:58.430 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:58.493 INFO:teuthology.orchestra.run.smithi106:> true 2019-12-16T22:37:58.709 INFO:teuthology.orchestra.run.smithi106:> uname -m 2019-12-16T22:37:58.756 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2019-12-16T22:37:58.756 INFO:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2019-12-16T22:37:58.804 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2019-12-16T22:37:58.804 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-16T22:37:58.804 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2019-12-16T22:37:58.805 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2019-12-16T22:37:58.805 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-16T22:37:58.805 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="18.04" 2019-12-16T22:37:58.805 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-16T22:37:58.806 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-16T22:37:58.806 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-16T22:37:58.806 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-16T22:37:58.806 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=bionic 2019-12-16T22:37:58.806 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=bionic 2019-12-16T22:37:58.807 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2019-12-16T22:37:58.821 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-12-16T22:37:58.855 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi106.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDz46hE/59V6G/yY7M/2TcudEH6hit23kIisw/8xoAMEnZSpLxOaZQaR8Cyn88j4jCN/k9GhXkjenp8UlNVZB3aOCbtRpXa+3+4NdnSmpk69ZOgClgfoAX9beOKoAbaDlJOdkbIfrgluBsn70iLBUYWbNBklKvq7zbjZtKphpMUxQADNloIrDR/+n0a0G/a9Yg9jZiWnUEESvrGIL7xsdQtYGgbs21wl5iBW8PnCZcKtlVR7hBvjmQlybI9O7tzT3x6rcHZiqEWHMrg2iOiqufrguPFe6qYOnnDg0JNrgn1iana8j0c1VUUUV21Ez06/zG7mof0Nxm+Gf3lQATzFF/N smithi177.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV9HN4RP8xt43fd1193v7nr3U1BKwbZalDDz2rHylogjDJF1i7HwRkIiA3+qlgk1J3ZLt5vXF2Cu+pblnxitk4eI/70mwibcTmSE7vgBy4I5Dz5Ttu0ElVyIwiIX7T+32F2vaHT2+izWPvsBpQvXj529V0JUbd5HNtXycizW+Igy/GePuwM9YJtK5MHMYhIx/kjpdnoDMwhyU/9eOuYu/PssnWbgnvUsSSJ6Vl+LAcysYHDl3dkUtbXU1gzny0+0CEFspT++vUaknpbvt06em9ZHnziQRIHMS7YkKhV9yAe+l1ksB2Dtml3dNm194LPYEPnST1S/2bxn90SNE+nfMv 2019-12-16T22:37:58.856 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-16T22:37:58.904 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-16T22:37:58.915 INFO:teuthology.task.internal:Saving configuration 2019-12-16T22:37:58.950 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-16T22:37:58.962 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-16T22:37:58.979 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-16 22:32:15.705206', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi106.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILEOoGy3Y/lB1peLnq6LvVYujhkFhuUglyBfS+/M/KM1', u'description': u'/home/teuthworker/archive/sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi/4609548'} 2019-12-16T22:37:58.993 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-16 22:32:15.705227', u'locked_by': u'scheduled_sage@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi177.front.sepia.ceph.com', u'os_version': u'18.04', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'ubuntu', u'arch': u'x86_64', u'ssh_pub_key': u'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE3c/2cjPydqoVhnp7ySn672Eh6E8pUEf3XIhphwV5eT', u'description': u'/home/teuthworker/archive/sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi/4609548'} 2019-12-16T22:37:58.994 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-16T22:37:59.010 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2019-12-16T22:37:59.010 INFO:teuthology.task.internal:roles: ubuntu@smithi177.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2019-12-16T22:37:59.011 INFO:teuthology.run_tasks:Running task console_log... 2019-12-16T22:37:59.097 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-16T22:37:59.097 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-16T22:37:59.112 INFO:teuthology.task.internal:Opening connections... 2019-12-16T22:37:59.112 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2019-12-16T22:37:59.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:59.186 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi177.front.sepia.ceph.com 2019-12-16T22:37:59.187 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:37:59.266 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-16T22:37:59.328 INFO:teuthology.orchestra.run.smithi106:> uname -m 2019-12-16T22:37:59.364 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2019-12-16T22:37:59.364 INFO:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2019-12-16T22:37:59.410 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2019-12-16T22:37:59.411 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-16T22:37:59.411 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2019-12-16T22:37:59.411 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2019-12-16T22:37:59.411 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-16T22:37:59.411 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="18.04" 2019-12-16T22:37:59.411 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-16T22:37:59.411 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-16T22:37:59.412 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-16T22:37:59.412 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-16T22:37:59.412 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=bionic 2019-12-16T22:37:59.412 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=bionic 2019-12-16T22:37:59.412 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2019-12-16T22:37:59.426 INFO:teuthology.orchestra.run.smithi177:> uname -m 2019-12-16T22:37:59.467 INFO:teuthology.orchestra.run.smithi177.stdout:x86_64 2019-12-16T22:37:59.468 INFO:teuthology.orchestra.run.smithi177:> cat /etc/os-release 2019-12-16T22:37:59.515 INFO:teuthology.orchestra.run.smithi177.stdout:NAME="Ubuntu" 2019-12-16T22:37:59.515 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION="18.04.3 LTS (Bionic Beaver)" 2019-12-16T22:37:59.515 INFO:teuthology.orchestra.run.smithi177.stdout:ID=ubuntu 2019-12-16T22:37:59.516 INFO:teuthology.orchestra.run.smithi177.stdout:ID_LIKE=debian 2019-12-16T22:37:59.516 INFO:teuthology.orchestra.run.smithi177.stdout:PRETTY_NAME="Ubuntu 18.04.3 LTS" 2019-12-16T22:37:59.516 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_ID="18.04" 2019-12-16T22:37:59.516 INFO:teuthology.orchestra.run.smithi177.stdout:HOME_URL="https://www.ubuntu.com/" 2019-12-16T22:37:59.516 INFO:teuthology.orchestra.run.smithi177.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2019-12-16T22:37:59.516 INFO:teuthology.orchestra.run.smithi177.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2019-12-16T22:37:59.516 INFO:teuthology.orchestra.run.smithi177.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2019-12-16T22:37:59.517 INFO:teuthology.orchestra.run.smithi177.stdout:VERSION_CODENAME=bionic 2019-12-16T22:37:59.517 INFO:teuthology.orchestra.run.smithi177.stdout:UBUNTU_CODENAME=bionic 2019-12-16T22:37:59.517 INFO:teuthology.lock.ops:Updating smithi177.front.sepia.ceph.com on lock server 2019-12-16T22:37:59.530 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-16T22:37:59.556 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-16T22:37:59.567 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-16T22:37:59.567 INFO:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2019-12-16T22:37:59.570 INFO:teuthology.orchestra.run.smithi177:> test '!' -e /home/ubuntu/cephtest 2019-12-16T22:37:59.575 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-16T22:37:59.587 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-16T22:37:59.588 INFO:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2019-12-16T22:37:59.613 INFO:teuthology.orchestra.run.smithi177:> test -z $(ls -A /var/lib/ceph) 2019-12-16T22:37:59.637 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-16T22:37:59.682 INFO:teuthology.run_tasks:Running task kernel... 2019-12-16T22:37:59.703 DEBUG:teuthology.task.kernel:normalized config {'cluster2.mgr.x': {'sha1': 'distro', 'kdb': True}, 'cluster1.mon.a': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror.4': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror.5': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror.6': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror.0': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror.1': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror.2': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror.3': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror.6': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror.5': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror.4': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror.3': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror.2': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror.1': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror.0': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.mirror': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.mirror': {'sha1': 'distro', 'kdb': True}, 'cluster1.osd.2': {'sha1': 'distro', 'kdb': True}, 'cluster1.osd.1': {'sha1': 'distro', 'kdb': True}, 'cluster1.osd.0': {'sha1': 'distro', 'kdb': True}, 'cluster2.osd.1': {'sha1': 'distro', 'kdb': True}, 'cluster1.client.0': {'sha1': 'distro', 'kdb': True}, 'cluster2.client.0': {'sha1': 'distro', 'kdb': True}, 'cluster2.osd.0': {'sha1': 'distro', 'kdb': True}, 'cluster2.mon.a': {'sha1': 'distro', 'kdb': True}, 'cluster2.osd.2': {'sha1': 'distro', 'kdb': True}, 'cluster1.mgr.x': {'sha1': 'distro', 'kdb': True}} 2019-12-16T22:37:59.703 INFO:teuthology.task.kernel:config {'cluster1.mon.a': {'sha1': 'distro', 'kdb': True}, 'cluster2.mon.a': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-16T22:37:59.703 INFO:teuthology.orchestra.run.smithi106:> uname -r 2019-12-16T22:37:59.707 INFO:teuthology.orchestra.run.smithi106.stdout:4.15.0-72-generic 2019-12-16T22:37:59.708 INFO:teuthology.task.kernel:Running kernel on smithi106: 4.15.0-72-generic 2019-12-16T22:37:59.708 INFO:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2019-12-16T22:37:59.811 INFO:teuthology.orchestra.run.smithi106:> sudo apt-get update 2019-12-16T22:37:59.916 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2019-12-16T22:38:00.042 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-16T22:38:00.123 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2019-12-16T22:38:00.173 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [601 kB] 2019-12-16T22:38:00.253 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [627 kB] 2019-12-16T22:38:00.268 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [210 kB] 2019-12-16T22:38:00.446 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2019-12-16T22:38:00.572 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [817 kB] 2019-12-16T22:38:00.831 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [625 kB] 2019-12-16T22:38:00.892 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [997 kB] 2019-12-16T22:38:00.961 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,033 kB] 2019-12-16T22:38:01.420 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 5,161 kB in 1s (3,624 kB/s) 2019-12-16T22:38:03.012 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2019-12-16T22:38:03.050 INFO:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2019-12-16T22:38:03.157 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2019-12-16T22:38:03.402 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2019-12-16T22:38:03.403 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2019-12-16T22:38:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:E: Unable to locate package linux-image-current-generic 2019-12-16T22:38:03.476 DEBUG:teuthology.orchestra.run:got remote process result: 100 2019-12-16T22:38:03.476 INFO:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2019-12-16T22:38:03.600 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2019-12-16T22:38:03.848 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2019-12-16T22:38:03.849 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2019-12-16T22:38:04.034 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic is already the newest version (4.15.0.72.74). 2019-12-16T22:38:04.034 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic set to manually installed. 2019-12-16T22:38:04.034 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 15 not upgraded. 2019-12-16T22:38:04.035 INFO:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2019-12-16T22:38:04.059 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2019-12-16T22:38:04.059 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2019-12-16T22:38:04.059 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2019-12-16T22:38:04.059 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2019-12-16T22:38:04.060 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 15 2019-12-16T22:38:04.060 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2019-12-16T22:38:04.060 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2019-12-16T22:38:04.060 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2019-12-16T22:38:04.060 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 4.15.0.72.74 2019-12-16T22:38:04.060 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-4.15.0-72-generic, linux-modules-extra-4.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2019-12-16T22:38:04.060 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2019-12-16T22:38:04.061 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2019-12-16T22:38:04.061 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2019-12-16T22:38:04.061 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2019-12-16T22:38:04.061 INFO:teuthology.orchestra.run.smithi177:> uname -r 2019-12-16T22:38:04.068 INFO:teuthology.orchestra.run.smithi177.stdout:4.15.0-72-generic 2019-12-16T22:38:04.068 INFO:teuthology.task.kernel:Running kernel on smithi177: 4.15.0-72-generic 2019-12-16T22:38:04.068 INFO:teuthology.orchestra.run.smithi177:> sudo apt-get clean 2019-12-16T22:38:04.180 INFO:teuthology.orchestra.run.smithi177:> sudo apt-get update 2019-12-16T22:38:04.305 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2019-12-16T22:38:04.430 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:2 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-16T22:38:04.510 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2019-12-16T22:38:04.561 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security/universe i386 Packages [601 kB] 2019-12-16T22:38:04.649 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://security.ubuntu.com/ubuntu bionic-security/universe amd64 Packages [627 kB] 2019-12-16T22:38:04.666 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://security.ubuntu.com/ubuntu bionic-security/universe Translation-en [210 kB] 2019-12-16T22:38:04.783 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2019-12-16T22:38:04.912 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 Packages [817 kB] 2019-12-16T22:38:05.153 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-updates/main i386 Packages [625 kB] 2019-12-16T22:38:05.213 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [997 kB] 2019-12-16T22:38:05.277 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,033 kB] 2019-12-16T22:38:05.774 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 5,161 kB in 1s (3,778 kB/s) 2019-12-16T22:38:07.181 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2019-12-16T22:38:07.226 INFO:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2019-12-16T22:38:07.309 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2019-12-16T22:38:07.551 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2019-12-16T22:38:07.552 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2019-12-16T22:38:07.630 INFO:teuthology.orchestra.run.smithi177.stderr:E: Unable to locate package linux-image-current-generic 2019-12-16T22:38:07.630 DEBUG:teuthology.orchestra.run:got remote process result: 100 2019-12-16T22:38:07.630 INFO:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2019-12-16T22:38:07.718 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2019-12-16T22:38:07.944 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2019-12-16T22:38:07.944 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2019-12-16T22:38:08.148 INFO:teuthology.orchestra.run.smithi177.stdout:linux-image-generic is already the newest version (4.15.0.72.74). 2019-12-16T22:38:08.149 INFO:teuthology.orchestra.run.smithi177.stdout:linux-image-generic set to manually installed. 2019-12-16T22:38:08.149 INFO:teuthology.orchestra.run.smithi177.stdout:0 upgraded, 0 newly installed, 0 to remove and 15 not upgraded. 2019-12-16T22:38:08.150 INFO:teuthology.orchestra.run.smithi177:> dpkg -s linux-image-generic 2019-12-16T22:38:08.172 INFO:teuthology.orchestra.run.smithi177.stdout:Package: linux-image-generic 2019-12-16T22:38:08.172 INFO:teuthology.orchestra.run.smithi177.stdout:Status: install ok installed 2019-12-16T22:38:08.173 INFO:teuthology.orchestra.run.smithi177.stdout:Priority: optional 2019-12-16T22:38:08.173 INFO:teuthology.orchestra.run.smithi177.stdout:Section: kernel 2019-12-16T22:38:08.173 INFO:teuthology.orchestra.run.smithi177.stdout:Installed-Size: 15 2019-12-16T22:38:08.173 INFO:teuthology.orchestra.run.smithi177.stdout:Maintainer: Ubuntu Kernel Team 2019-12-16T22:38:08.173 INFO:teuthology.orchestra.run.smithi177.stdout:Architecture: amd64 2019-12-16T22:38:08.174 INFO:teuthology.orchestra.run.smithi177.stdout:Source: linux-meta 2019-12-16T22:38:08.174 INFO:teuthology.orchestra.run.smithi177.stdout:Version: 4.15.0.72.74 2019-12-16T22:38:08.174 INFO:teuthology.orchestra.run.smithi177.stdout:Depends: linux-image-4.15.0-72-generic, linux-modules-extra-4.15.0-72-generic, linux-firmware, intel-microcode, amd64-microcode 2019-12-16T22:38:08.174 INFO:teuthology.orchestra.run.smithi177.stdout:Recommends: thermald 2019-12-16T22:38:08.175 INFO:teuthology.orchestra.run.smithi177.stdout:Description: Generic Linux kernel image 2019-12-16T22:38:08.175 INFO:teuthology.orchestra.run.smithi177.stdout: This package will always depend on the latest generic kernel image 2019-12-16T22:38:08.175 INFO:teuthology.orchestra.run.smithi177.stdout: available. 2019-12-16T22:38:08.176 INFO:teuthology.task.kernel:Enabling kdb on cluster1.mon.a... 2019-12-16T22:38:08.176 INFO:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-16T22:38:08.371 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2019-12-16T22:38:08.405 INFO:teuthology.task.kernel:Enabling kdb on cluster2.mon.a... 2019-12-16T22:38:08.406 INFO:teuthology.orchestra.run.smithi177:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-16T22:38:08.427 INFO:teuthology.orchestra.run.smithi177.stdout:ttyS1 2019-12-16T22:38:08.451 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-16T22:38:08.461 INFO:teuthology.task.internal:Creating test directory... 2019-12-16T22:38:08.462 INFO:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-16T22:38:08.470 INFO:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-16T22:38:08.499 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-16T22:38:08.512 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-16T22:38:08.528 INFO:teuthology.task.internal:Creating archive directory... 2019-12-16T22:38:08.528 INFO:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-16T22:38:08.530 INFO:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-16T22:38:08.560 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-16T22:38:08.573 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-16T22:38:08.574 INFO:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-16T22:38:08.605 INFO:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-16T22:38:08.626 INFO:teuthology.orchestra.run.smithi177.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-16T22:38:08.628 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-16T22:38:08.629 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-16T22:38:08.661 INFO:teuthology.task.internal:Configuring sudo... 2019-12-16T22:38:08.661 INFO:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-16T22:38:08.673 INFO:teuthology.orchestra.run.smithi177:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-16T22:38:08.690 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-16T22:38:08.702 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-16T22:38:08.702 INFO:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-16T22:38:08.729 INFO:teuthology.orchestra.run.smithi177:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-16T22:38:08.738 INFO:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-16T22:38:08.783 INFO:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-16T22:38:08.830 INFO:teuthology.orchestra.run.smithi106:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-16T22:38:08.918 INFO:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-16T22:38:08.925 INFO:teuthology.orchestra.run.smithi177:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-16T22:38:08.975 INFO:teuthology.orchestra.run.smithi177:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-16T22:38:09.067 INFO:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2019-12-16T22:38:09.069 INFO:teuthology.orchestra.run.smithi177:> sudo service rsyslog restart 2019-12-16T22:38:09.148 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-16T22:38:09.174 INFO:teuthology.task.internal:Starting timer... 2019-12-16T22:38:09.174 INFO:teuthology.run_tasks:Running task pcp... 2019-12-16T22:38:09.222 INFO:teuthology.run_tasks:Running task selinux... 2019-12-16T22:38:09.236 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2019-12-16T22:38:09.236 DEBUG:teuthology.task.selinux:Excluding smithi177: OS 'ubuntu' does not support SELinux 2019-12-16T22:38:09.236 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-16T22:38:09.236 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2019-12-16T22:38:09.236 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-16T22:38:09.237 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-16T22:38:09.250 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2019-12-16T22:38:09.258 INFO:teuthology.repo_utils:Fetching master from origin 2019-12-16T22:38:09.318 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-16T22:38:09.334 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-16T22:38:09.339 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi177.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-16T22:38:09.684 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-16T22:38:10.908 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-16T22:38:13.656 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-16T22:38:13.680 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:13 +0000 (0:00:00.068) 0:00:00.068 ******* 2019-12-16T22:38:13.692 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:13 +0000 (0:00:00.011) 0:00:00.080 ******* 2019-12-16T22:38:16.391 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi106.front.sepia.ceph.com] 2019-12-16T22:38:16.468 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] 2019-12-16T22:38:16.514 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:16 +0000 (0:00:02.821) 0:00:02.902 ******* 2019-12-16T22:38:16.591 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:16 +0000 (0:00:00.077) 0:00:02.979 ******* 2019-12-16T22:38:16.812 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-16T22:38:16.814 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-16T22:38:16.852 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:16 +0000 (0:00:00.260) 0:00:03.240 ******* 2019-12-16T22:38:16.858 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-16T22:38:16.901 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:16 +0000 (0:00:00.047) 0:00:03.287 ******* 2019-12-16T22:38:17.395 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-16T22:38:17.396 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-16T22:38:17.442 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:17 +0000 (0:00:00.541) 0:00:03.829 ******* 2019-12-16T22:38:17.449 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-16T22:38:17.510 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:17 +0000 (0:00:00.068) 0:00:03.898 ******* 2019-12-16T22:38:17.796 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-16T22:38:17.797 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.071230", "end": "2019-12-16 22:38:17.876464", "rc": 0, "start": "2019-12-16 22:38:17.805234", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2019-12-16T22:38:17.849 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:17 +0000 (0:00:00.339) 0:00:04.237 ******* 2019-12-16T22:38:17.856 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.072952", "end": "2019-12-16 22:38:17.749569", "rc": 0, "start": "2019-12-16 22:38:17.676617", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2019-12-16T22:38:17.907 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:17 +0000 (0:00:00.057) 0:00:04.295 ******* 2019-12-16T22:38:18.137 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-16T22:38:18.137 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:38:18.139 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:38:18.195 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:18 +0000 (0:00:00.287) 0:00:04.583 ******* 2019-12-16T22:38:18.246 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:18 +0000 (0:00:00.051) 0:00:04.634 ******* 2019-12-16T22:38:19.266 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-12-16T22:38:19.266 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576535898.21-266991040953327/source", "state": "file", "uid": 0} 2019-12-16T22:38:19.319 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:19 +0000 (0:00:01.072) 0:00:05.706 ******* 2019-12-16T22:38:19.330 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576535898.27-92996921833686/source", "state": "file", "uid": 0} 2019-12-16T22:38:19.371 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:19 +0000 (0:00:00.052) 0:00:05.759 ******* 2019-12-16T22:38:19.682 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-12-16T22:38:19.683 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi177.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "change 2019-12-16T22:38:19.685 INFO:teuthology.task.ansible.out:d": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:19.844 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:19.845 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:19.995 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:19.997 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.115 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.142 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.248 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.280 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.393 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.435 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.532 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.619 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-16T22:38:20.721 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-12-16T22:38:20.727 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-16T22:38:20.912 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:20 +0000 (0:00:01.541) 0:00:07.300 ******* 2019-12-16T22:38:20.956 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:20 +0000 (0:00:00.038) 0:00:07.339 ******* 2019-12-16T22:38:21.593 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2019-12-16T22:38:21.595 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] 2019-12-16T22:38:21.695 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2019-12-16T22:38:21.704 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:21 +0000 (0:00:00.743) 0:00:08.083 ******* 2019-12-16T22:38:22.079 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi106.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.227257", "end": "2019-12-16 22:38:22.058226", "rc": 0, "start": "2019-12-16 22:38:21.830969", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-16T22:38:22.131 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.436) 0:00:08.519 ******* 2019-12-16T22:38:22.287 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2019-12-16T22:38:22.287 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.023368", "end": "2019-12-16 22:38:22.370934", "failed_when_result": false, "rc": 0, "start": "2019-12-16 22:38:22.347566", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2019-12-16T22:38:22.333 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.201) 0:00:08.721 ******* 2019-12-16T22:38:22.394 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-16T22:38:22.395 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:22.465 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.131) 0:00:08.853 ******* 2019-12-16T22:38:22.493 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-16T22:38:22.495 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:22.533 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.068) 0:00:08.921 ******* 2019-12-16T22:38:22.579 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-16T22:38:22.581 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:22.626 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.093) 0:00:09.014 ******* 2019-12-16T22:38:22.653 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-16T22:38:22.654 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:22.696 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.068) 0:00:09.083 ******* 2019-12-16T22:38:22.720 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi177.front.sepia.ceph.com] 2019-12-16T22:38:22.730 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-16T22:38:22.731 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:22.785 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.086) 0:00:09.169 ******* 2019-12-16T22:38:22.873 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.091) 0:00:09.261 ******* 2019-12-16T22:38:22.912 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-16T22:38:22.913 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:38:22.982 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:22 +0000 (0:00:00.108) 0:00:09.370 ******* 2019-12-16T22:38:23.179 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-16T22:38:23.247 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi177.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.228962", "end": "2019-12-16 22:38:23.217154", "rc": 0, "start": "2019-12-16 22:38:22.988192", "stderr": "", "stderr_lines": [], "stdout": "f4e10beea550ddcc5081090533acfa405cd36c43", "stdout_lines": ["f4e10beea550ddcc5081090533acfa405cd36c43"]} 2019-12-16T22:38:23.292 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:23 +0000 (0:00:00.309) 0:00:09.680 ******* 2019-12-16T22:38:23.320 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-16T22:38:23.324 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-16T22:38:23.449 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-16T22:38:23.468 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.020555", "end": "2019-12-16 22:38:23.416147", "failed_when_result": false, "rc": 0, "start": "2019-12-16 22:38:23.395592", "stderr": "", "stderr_lines": [], "stdout": "c84d080fc97e482f88d240859322d5765ac90366", "stdout_lines": ["c84d080fc97e482f88d240859322d5765ac90366"]} 2019-12-16T22:38:23.513 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:23 +0000 (0:00:00.221) 0:00:09.901 ******* 2019-12-16T22:38:23.540 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-16T22:38:23.541 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:23.580 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:23 +0000 (0:00:00.065) 0:00:09.967 ******* 2019-12-16T22:38:23.596 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-16T22:38:23.596 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-16T22:38:23.608 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-16T22:38:23.610 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:23.648 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:23 +0000 (0:00:00.068) 0:00:10.036 ******* 2019-12-16T22:38:23.674 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-16T22:38:23.677 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:23.716 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:23 +0000 (0:00:00.067) 0:00:10.104 ******* 2019-12-16T22:38:23.743 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-16T22:38:23.744 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-16T22:38:23.756 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-16T22:38:23.757 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:23.812 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:23 +0000 (0:00:00.096) 0:00:10.200 ******* 2019-12-16T22:38:23.840 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:23.889 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:23 +0000 (0:00:00.076) 0:00:10.277 ******* 2019-12-16T22:38:23.896 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-16T22:38:24.023 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-16T22:38:24.024 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [users : Create all admin users with sudo access.] ************************ ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-16T22:38:24.065 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:24 +0000 (0:00:00.175) 0:00:10.453 ******* 2019-12-16T22:38:24.161 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-16T22:38:24.245 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-16T22:38:24.299 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-16T22:38:24.386 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-16T22:38:24.430 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-16T22:38:24.537 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-16T22:38:24.571 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-16T22:38:24.690 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-16T22:38:24.734 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-16T22:38:24.829 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-16T22:38:24.868 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-12-16T22:38:24.988 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-16T22:38:25.012 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-16T22:38:25.121 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-16T22:38:25.166 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-16T22:38:25.289 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-16T22:38:25.321 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-16T22:38:25.421 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-16T22:38:25.446 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-16T22:38:25.555 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-16T22:38:25.608 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-16T22:38:25.706 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-16T22:38:25.738 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-16T22:38:25.835 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-16T22:38:25.868 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-16T22:38:25.976 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2019-12-16T22:38:26.009 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-16T22:38:26.137 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-16T22:38:26.149 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-16T22:38:26.265 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-16T22:38:26.309 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-16T22:38:26.408 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-16T22:38:26.451 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-16T22:38:26.526 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-16T22:38:26.590 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-16T22:38:26.664 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-16T22:38:26.752 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-16T22:38:26.798 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-16T22:38:26.886 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-16T22:38:26.943 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-16T22:38:27.029 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-16T22:38:27.074 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-16T22:38:27.180 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-16T22:38:27.230 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-16T22:38:27.322 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-16T22:38:27.377 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-16T22:38:27.479 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-16T22:38:27.503 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-16T22:38:27.650 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-16T22:38:27.652 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-16T22:38:27.782 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-16T22:38:27.795 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-16T22:38:27.930 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-16T22:38:27.943 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-16T22:38:28.084 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-12-16T22:38:28.085 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-16T22:38:28.239 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-16T22:38:28.241 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-16T22:38:28.387 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-16T22:38:28.415 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-16T22:38:28.543 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-16T22:38:28.555 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-16T22:38:28.685 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-16T22:38:28.708 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-16T22:38:28.709 INFO:teuthology.task.ansible.out: 2019-12-16T22:38:28.835 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-16T22:38:28.858 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-16T22:38:28.976 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-16T22:38:29.012 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-16T22:38:29.112 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1135} 2019-12-16T22:38:29.155 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-16T22:38:29.240 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-16T22:38:29.303 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-16T22:38:29.378 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-16T22:38:29.457 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-16T22:38:29.542 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-16T22:38:29.606 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-12-16T22:38:29.672 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-16T22:38:29.767 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-16T22:38:29.810 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-16T22:38:29.936 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-16T22:38:29.966 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-16T22:38:30.097 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-16T22:38:30.105 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-16T22:38:30.243 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-16T22:38:30.255 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-12-16T22:38:30.407 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-16T22:38:30.429 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-16T22:38:30.560 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1145} 2019-12-16T22:38:30.583 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-12-16T22:38:30.708 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-16T22:38:30.842 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-16T22:38:30.856 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-12-16T22:38:30.984 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-16T22:38:31.018 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-16T22:38:31.134 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1149} 2019-12-16T22:38:31.177 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-12-16T22:38:31.279 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-16T22:38:31.323 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-16T22:38:31.430 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1151} 2019-12-16T22:38:31.467 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-16T22:38:31.588 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1152} 2019-12-16T22:38:31.611 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-16T22:38:31.717 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-16T22:38:31.781 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-16T22:38:31.868 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1154} 2019-12-16T22:38:31.926 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-16T22:38:32.019 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-16T22:38:32.087 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-12-16T22:38:32.179 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-16T22:38:32.247 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-16T22:38:32.337 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-16T22:38:32.409 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-16T22:38:32.495 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-16T22:38:32.587 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-16T22:38:32.641 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-16T22:38:32.746 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-16T22:38:32.779 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1160} 2019-12-16T22:38:32.885 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-16T22:38:32.917 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-16T22:38:33.025 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-16T22:38:33.058 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-16T22:38:33.166 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-12-16T22:38:33.220 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-16T22:38:33.308 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-16T22:38:33.310 INFO:teuthology.task.ansible.out: 2019-12-16T22:38:33.352 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-16T22:38:33.353 INFO:teuthology.task.ansible.out: 2019-12-16T22:38:33.467 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-16T22:38:33.490 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-16T22:38:33.616 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-16T22:38:33.627 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-16T22:38:33.763 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1166} 2019-12-16T22:38:33.764 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-16T22:38:33.898 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-16T22:38:33.920 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-16T22:38:34.045 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-16T22:38:34.067 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-16T22:38:34.199 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-16T22:38:34.211 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-12-16T22:38:34.344 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-16T22:38:34.345 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-16T22:38:34.476 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-16T22:38:34.499 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-12-16T22:38:34.618 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-16T22:38:34.662 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-12-16T22:38:34.839 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1173} 2019-12-16T22:38:34.882 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-16T22:38:35.077 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-16T22:38:35.099 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-16T22:38:35.235 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1175} 2019-12-16T22:38:35.268 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-16T22:38:35.395 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1176} 2019-12-16T22:38:35.448 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-16T22:38:35.534 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-16T22:38:35.577 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-16T22:38:35.673 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-16T22:38:35.747 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-16T22:38:35.820 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-16T22:38:35.916 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-12-16T22:38:35.952 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-16T22:38:36.078 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-16T22:38:36.090 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-16T22:38:36.205 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-16T22:38:36.228 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-16T22:38:36.342 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-16T22:38:36.354 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1183} 2019-12-16T22:38:36.490 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-16T22:38:36.491 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-16T22:38:36.634 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-16T22:38:36.645 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-16T22:38:36.761 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-16T22:38:36.772 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-16T22:38:36.899 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-16T22:38:36.900 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-16T22:38:37.028 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-16T22:38:37.051 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-16T22:38:37.179 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-16T22:38:37.216 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-16T22:38:37.328 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-16T22:38:37.344 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-16T22:38:37.470 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-16T22:38:37.492 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-16T22:38:37.613 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-16T22:38:37.646 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-16T22:38:37.746 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-16T22:38:37.830 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-16T22:38:37.885 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-16T22:38:37.991 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-16T22:38:38.025 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-16T22:38:38.165 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-16T22:38:38.167 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-16T22:38:38.301 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-16T22:38:38.312 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-16T22:38:38.439 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-16T22:38:38.485 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-16T22:38:38.596 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-16T22:38:38.638 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-16T22:38:38.788 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-16T22:38:38.877 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-16T22:38:38.940 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-16T22:38:39.026 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-16T22:38:39.101 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-16T22:38:39.183 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-16T22:38:39.262 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-16T22:38:39.327 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-16T22:38:39.485 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-16T22:38:39.616 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-16T22:38:39.830 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-12-16T22:38:40.136 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:40 +0000 (0:00:16.070) 0:00:26.523 ******* 2019-12-16T22:38:40.169 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-16T22:38:40.220 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:40 +0000 (0:00:00.084) 0:00:26.608 ******* 2019-12-16T22:38:40.226 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-16T22:38:40.226 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2019-12-16T22:38:40.307 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-16T22:38:40.311 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-16T22:38:40.312 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-16T22:38:40.314 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-16T22:38:40.315 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-16T22:38:40.317 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-16T22:38:40.318 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-16T22:38:40.319 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-16T22:38:40.320 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f 2019-12-16T22:38:40.321 INFO:teuthology.task.ansible.out:826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd1 2019-12-16T22:38:40.322 INFO:teuthology.task.ansible.out:7f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 2019-12-16T22:38:40.324 INFO:teuthology.task.ansible.out: 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn" 2019-12-16T22:38:40.325 INFO:teuthology.task.ansible.out:: "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-16T22:38:40.385 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:40 +0000 (0:00:00.165) 0:00:26.773 ******* 2019-12-16T22:38:40.440 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:40 +0000 (0:00:00.053) 0:00:26.827 ******* 2019-12-16T22:38:40.464 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-16T22:38:40.510 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:40 +0000 (0:00:00.070) 0:00:26.898 ******* 2019-12-16T22:38:40.601 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-16T22:38:40.607 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-16T22:38:40.609 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-16T22:38:40.611 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-16T22:38:40.612 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-16T22:38:40.614 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-16T22:38:40.615 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-16T22:38:40.617 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-16T22:38:40.621 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f8 2019-12-16T22:38:40.623 INFO:teuthology.task.ansible.out:48846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8a 2019-12-16T22:38:40.624 INFO:teuthology.task.ansible.out:a01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalho 2019-12-16T22:38:40.626 INFO:teuthology.task.ansible.out:jr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}]}, "changed": false} 2019-12-16T22:38:40.684 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:40 +0000 (0:00:00.173) 0:00:27.072 ******* 2019-12-16T22:38:41.337 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-16T22:38:41.339 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-16T22:38:41.380 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:41 +0000 (0:00:00.696) 0:00:27.768 ******* 2019-12-16T22:38:41.386 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com -> localhost] => {"after": "f4e10beea550ddcc5081090533acfa405cd36c43", "attempts": 1, "before": "f4e10beea550ddcc5081090533acfa405cd36c43", "changed": false, "remote_url_changed": false} 2019-12-16T22:38:41.428 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:41 +0000 (0:00:00.048) 0:00:27.816 ******* 2019-12-16T22:38:41.636 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-16T22:38:41.647 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-16T22:38:41.782 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-16T22:38:41.815 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-16T22:38:41.932 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-16T22:38:41.945 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-16T22:38:42.085 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-16T22:38:42.086 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-16T22:38:42.235 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-16T22:38:42.236 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-16T22:38:42.257 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-16T22:38:42.258 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-16T22:38:42.374 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-16T22:38:42.417 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-16T22:38:42.524 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-16T22:38:42.525 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-16T22:38:42.593 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-16T22:38:42.595 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-16T22:38:42.684 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-16T22:38:42.727 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-16T22:38:42.823 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-16T22:38:42.835 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:42.879 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-16T22:38:42.891 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:42.976 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-16T22:38:42.978 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-16T22:38:42.997 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:43.010 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:43.026 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf5 2019-12-16T22:38:43.028 INFO:teuthology.task.ansible.out:92607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-16T22:38:43.038 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:43.040 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:43.050 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:43.161 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-16T22:38:43.180 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-16T22:38:43.287 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-16T22:38:43.289 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-16T22:38:43.309 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-16T22:38:43.311 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-16T22:38:43.439 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-16T22:38:43.457 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-16T22:38:43.572 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-16T22:38:43.639 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-16T22:38:43.714 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-16T22:38:43.797 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-16T22:38:43.868 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-16T22:38:43.944 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-16T22:38:43.999 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-16T22:38:44.127 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-16T22:38:44.160 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-16T22:38:44.304 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-16T22:38:44.326 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-16T22:38:44.327 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-16T22:38:44.458 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-16T22:38:44.460 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-16T22:38:44.483 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-16T22:38:44.485 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-16T22:38:44.625 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-16T22:38:44.627 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-16T22:38:44.770 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-16T22:38:44.771 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-16T22:38:44.909 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-16T22:38:44.910 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-16T22:38:44.920 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-16T22:38:45.036 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-16T22:38:45.037 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-16T22:38:45.050 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-16T22:38:45.172 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-16T22:38:45.183 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-16T22:38:45.300 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-16T22:38:45.325 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-16T22:38:45.442 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-16T22:38:45.474 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-16T22:38:45.580 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-16T22:38:45.633 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-16T22:38:45.717 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-16T22:38:45.719 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-16T22:38:45.816 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-16T22:38:45.869 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-16T22:38:45.964 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-16T22:38:45.965 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-16T22:38:45.996 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-16T22:38:46.121 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-16T22:38:46.136 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-16T22:38:46.283 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-16T22:38:46.294 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-16T22:38:46.446 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-16T22:38:46.458 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-16T22:38:46.598 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-16T22:38:46.599 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-16T22:38:46.745 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-16T22:38:46.746 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-16T22:38:46.871 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-16T22:38:46.938 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-16T22:38:47.012 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-16T22:38:47.098 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-16T22:38:47.162 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-16T22:38:47.196 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-16T22:38:47.241 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-16T22:38:47.295 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-16T22:38:47.296 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-16T22:38:47.394 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-16T22:38:47.427 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-16T22:38:47.545 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-16T22:38:47.547 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-16T22:38:47.567 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-16T22:38:47.697 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-16T22:38:47.699 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-16T22:38:47.847 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-16T22:38:47.848 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-16T22:38:47.983 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-16T22:38:47.984 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-16T22:38:48.026 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-16T22:38:48.116 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-16T22:38:48.117 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-16T22:38:48.119 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-16T22:38:48.255 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-16T22:38:48.312 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-16T22:38:48.386 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-16T22:38:48.477 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-16T22:38:48.479 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-16T22:38:48.531 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-16T22:38:48.652 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-16T22:38:48.654 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-16T22:38:48.655 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-16T22:38:48.676 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-16T22:38:48.819 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-16T22:38:48.834 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-16T22:38:48.964 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-16T22:38:48.987 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-16T22:38:49.123 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-16T22:38:49.149 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-16T22:38:49.245 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-16T22:38:49.282 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-16T22:38:49.381 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-16T22:38:49.383 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-16T22:38:49.444 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-16T22:38:49.523 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-16T22:38:49.598 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-16T22:38:49.662 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-16T22:38:49.758 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-16T22:38:49.825 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-16T22:38:49.833 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-16T22:38:49.921 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-16T22:38:49.970 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-16T22:38:50.062 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-16T22:38:50.064 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-16T22:38:50.128 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-16T22:38:50.193 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-16T22:38:50.258 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-16T22:38:50.347 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-16T22:38:50.405 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-16T22:38:50.506 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-16T22:38:50.507 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-16T22:38:50.539 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-16T22:38:50.696 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-16T22:38:50.697 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-16T22:38:50.904 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-16T22:38:50.905 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-16T22:38:51.054 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-16T22:38:51.065 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-16T22:38:51.222 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-16T22:38:51.234 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-16T22:38:51.378 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-16T22:38:51.379 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-16T22:38:51.514 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-16T22:38:51.515 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-16T22:38:51.649 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-16T22:38:51.661 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-16T22:38:51.787 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-16T22:38:51.819 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-16T22:38:51.915 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-16T22:38:51.952 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-16T22:38:52.050 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-16T22:38:52.124 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-16T22:38:52.176 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-16T22:38:52.275 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-16T22:38:52.309 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-16T22:38:52.418 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-16T22:38:52.451 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-16T22:38:52.601 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-16T22:38:52.613 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-16T22:38:52.753 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-16T22:38:52.763 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-16T22:38:52.879 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-16T22:38:52.964 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-16T22:38:53.017 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-16T22:38:53.142 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-16T22:38:53.186 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-16T22:38:53.272 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-16T22:38:53.347 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-16T22:38:53.419 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-16T22:38:53.516 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-16T22:38:53.560 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-16T22:38:53.671 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-16T22:38:53.707 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-16T22:38:53.709 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-16T22:38:53.816 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-16T22:38:53.837 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-16T22:38:53.839 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-16T22:38:53.954 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-16T22:38:54.009 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-16T22:38:54.108 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-16T22:38:54.163 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-16T22:38:54.258 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-16T22:38:54.313 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-16T22:38:54.425 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-16T22:38:54.458 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-16T22:38:54.591 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-16T22:38:54.593 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-16T22:38:54.613 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-16T22:38:54.743 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-16T22:38:54.745 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-16T22:38:54.755 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-16T22:38:54.895 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-16T22:38:54.910 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-16T22:38:55.037 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-16T22:38:55.084 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-16T22:38:55.171 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-16T22:38:55.247 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-16T22:38:55.321 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-16T22:38:55.406 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-16T22:38:55.493 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-16T22:38:55.556 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-16T22:38:55.622 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-16T22:38:55.752 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-16T22:38:55.803 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-16T22:38:55.902 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-16T22:38:55.928 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-16T22:38:56.042 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-16T22:38:56.080 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-16T22:38:56.082 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-16T22:38:56.212 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-16T22:38:56.235 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-16T22:38:56.379 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-16T22:38:56.433 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-16T22:38:56.518 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-16T22:38:56.582 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-16T22:38:56.672 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2019-12-16T22:38:56.776 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:56 +0000 (0:00:15.347) 0:00:43.164 ******* 2019-12-16T22:38:56.782 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-16T22:38:56.863 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-16T22:38:56.865 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:56.876 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:56.887 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:56.899 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:56.913 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d2 2019-12-16T22:38:56.915 INFO:teuthology.task.ansible.out:49450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:56.923 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:56.935 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-16T22:38:56.937 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:56.958 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.082 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVy 2019-12-16T22:38:57.083 INFO:teuthology.task.ansible.out:h6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-16T22:38:57.103 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.230 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-16T22:38:57.230 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-16T22:38:57.232 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "val 2019-12-16T22:38:57.234 INFO:teuthology.task.ansible.out:idate_certs": true} 2019-12-16T22:38:57.359 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-16T22:38:57.413 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-16T22:38:57.415 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-16T22:38:57.489 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-16T22:38:57.490 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-16T22:38:57.504 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.517 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.527 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.536 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.539 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.565 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-16T22:38:57.567 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-16T22:38:57.684 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-16T22:38:57.693 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.696 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.697 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-16T22:38:57.697 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2019-12-16T22:38:57.716 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-16T22:38:57.718 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.718 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.720 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.731 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.748 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.757 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.792 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.793 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.804 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.804 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.806 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.818 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.829 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.842 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.842 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.864 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-16T22:38:57.866 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.868 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.879 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.930 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-16T22:38:57.971 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-16T22:38:57.973 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.973 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.975 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.976 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:57.982 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.019 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:58 +0000 (0:00:01.243) 0:00:44.407 ******* 2019-12-16T22:38:58.027 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.029 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.030 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.033 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.050 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.097 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.099 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.111 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.112 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.127 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.127 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.141 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.142 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.143 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.165 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.168 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.169 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.170 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.189 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.194 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.196 INFO:teuthology.task.ansible.out: 2019-12-16T22:38:58.210 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.233 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.273 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.283 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.308 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.319 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.345 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.378 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.379 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.381 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.392 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.399 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.412 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.423 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.424 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.437 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.461 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.463 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.476 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.485 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.487 INFO:teuthology.task.ansible.out: 2019-12-16T22:38:58.523 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.536 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.548 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidR 2019-12-16T22:38:58.550 INFO:teuthology.task.ansible.out:jrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-16T22:38:58.560 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.571 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.574 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.599 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.601 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.612 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.623 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.634 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.636 INFO:teuthology.task.ansible.out: 2019-12-16T22:38:58.646 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.661 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.676 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.682 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.693 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.706 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.717 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.719 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.729 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.744 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-16T22:38:58.748 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.749 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.763 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.785 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.787 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.869 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:58 +0000 (0:00:00.849) 0:00:45.256 ******* 2019-12-16T22:38:58.905 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-16T22:38:58.906 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:58.948 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:38:58 +0000 (0:00:00.079) 0:00:45.336 ******* 2019-12-16T22:38:58.956 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-16T22:38:59.045 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-16T22:38:59.055 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.066 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.077 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.112 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.124 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.128 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi177.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-16T22:38:59.140 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.155 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.164 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.179 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.189 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.190 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.202 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.215 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.228 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.239 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.251 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.261 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.272 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-16T22:38:59.279 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.293 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.294 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.317 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.318 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.334 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.340 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.342 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.352 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.375 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.376 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.388 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.402 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.422 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-16T22:38:59.424 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.434 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.436 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.447 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.458 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.469 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.481 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.492 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.503 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.514 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.515 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.526 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.542 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.549 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.565 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi177.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-16T22:38:59.577 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-16T22:38:59.579 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.598 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.600 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.611 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.612 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.614 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.625 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.636 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.638 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.649 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.661 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.684 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.687 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** 2019-12-16T22:38:59.687 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.698 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.714 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.730 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.741 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.753 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.766 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.777 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.790 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.791 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.806 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.817 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.818 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.832 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi177.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.842 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.853 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.865 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.876 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.877 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.889 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.900 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.911 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.923 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.934 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.934 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.946 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.957 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.971 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi177.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:38:59.991 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 3KhqWETFJaVsH/I8FOBfUg 0aca6c3c6d45c554bad8ba9853f0bc575c9915eee33ee6be2059568ad09a9d72"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:00.054 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:00 +0000 (0:00:01.105) 0:00:46.441 ******* 2019-12-16T22:39:00.080 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-16T22:39:00.082 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:00.124 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:00 +0000 (0:00:00.070) 0:00:46.512 ******* 2019-12-16T22:39:00.129 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-16T22:39:00.130 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-16T22:39:00.259 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-16T22:39:00.315 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-16T22:39:00.389 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-16T22:39:00.466 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-16T22:39:00.522 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-16T22:39:00.607 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-16T22:39:00.675 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-16T22:39:00.735 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-16T22:39:00.802 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-16T22:39:00.870 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-16T22:39:00.934 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-16T22:39:01.012 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-16T22:39:01.078 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-16T22:39:01.168 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-16T22:39:01.236 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-16T22:39:01.298 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-16T22:39:01.354 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-16T22:39:01.444 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-16T22:39:01.512 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-16T22:39:01.585 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-16T22:39:01.639 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-16T22:39:01.714 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-16T22:39:01.780 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-16T22:39:01.845 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-16T22:39:01.920 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-16T22:39:01.994 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-16T22:39:02.091 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2019-12-16T22:39:02.155 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-16T22:39:02.256 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2019-12-16T22:39:02.427 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2019-12-16T22:39:02.446 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-16T22:39:02.567 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2019-12-16T22:39:02.578 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-16T22:39:02.710 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2019-12-16T22:39:02.718 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-16T22:39:02.867 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-16T22:39:02.974 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2019-12-16T22:39:03.006 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-16T22:39:03.113 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2019-12-16T22:39:03.145 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-16T22:39:03.251 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2019-12-16T22:39:03.294 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-16T22:39:03.398 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2019-12-16T22:39:03.452 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2019-12-16T22:39:03.527 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2019-12-16T22:39:03.581 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2019-12-16T22:39:03.667 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2019-12-16T22:39:03.730 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2019-12-16T22:39:03.803 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2019-12-16T22:39:03.861 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2019-12-16T22:39:03.936 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-16T22:39:04.012 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2019-12-16T22:39:04.066 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-16T22:39:04.153 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2019-12-16T22:39:04.204 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-16T22:39:04.271 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2019-12-16T22:39:04.345 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-16T22:39:04.399 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2019-12-16T22:39:04.479 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-16T22:39:04.520 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2019-12-16T22:39:04.622 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-16T22:39:04.654 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2019-12-16T22:39:04.758 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-16T22:39:04.790 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2019-12-16T22:39:04.898 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2019-12-16T22:39:04.937 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2019-12-16T22:39:04.997 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:04 +0000 (0:00:04.872) 0:00:51.384 ******* 2019-12-16T22:39:05.055 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-16T22:39:05.211 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-16T22:39:05.334 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-16T22:39:05.367 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576535945.02-206487471216850/source", "state": "file", "uid": 0} 2019-12-16T22:39:05.418 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:05 +0000 (0:00:00.417) 0:00:51.802 ******* 2019-12-16T22:39:05.442 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-16T22:39:05.444 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => { "msg": "Host smithi177.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2019-12-16T22:39:05.494 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:05 +0000 (0:00:00.079) 0:00:51.882 ******* 2019-12-16T22:39:05.500 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-16T22:39:05.501 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-16T22:39:05.534 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-16T22:39:05.536 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-16T22:39:05.588 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:05 +0000 (0:00:00.094) 0:00:51.976 ******* 2019-12-16T22:39:05.626 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:05.682 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:05 +0000 (0:00:00.090) 0:00:52.066 ******* 2019-12-16T22:39:05.689 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi106.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-16T22:39:05.708 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-16T22:39:05.710 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:05.749 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:05 +0000 (0:00:00.070) 0:00:52.137 ******* 2019-12-16T22:39:05.808 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-16T22:39:05.809 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-16T22:39:05.907 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-16T22:39:05.908 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.072 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.323) 0:00:52.460 ******* 2019-12-16T22:39:06.079 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-16T22:39:06.080 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-16T22:39:06.103 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2019-12-16T22:39:06.136 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-16T22:39:06.138 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.180 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.107) 0:00:52.568 ******* 2019-12-16T22:39:06.219 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.039) 0:00:52.607 ******* 2019-12-16T22:39:06.250 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.290 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.071) 0:00:52.678 ******* 2019-12-16T22:39:06.328 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-16T22:39:06.330 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.370 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.079) 0:00:52.758 ******* 2019-12-16T22:39:06.396 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-16T22:39:06.398 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.438 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.068) 0:00:52.826 ******* 2019-12-16T22:39:06.475 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-16T22:39:06.477 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.542 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.103) 0:00:52.929 ******* 2019-12-16T22:39:06.578 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-16T22:39:06.580 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi177.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:06.637 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.095) 0:00:53.025 ******* 2019-12-16T22:39:06.674 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-16T22:39:06.675 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.743 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.105) 0:00:53.130 ******* 2019-12-16T22:39:06.749 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-16T22:39:06.750 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "checksum": "bcb7fb0987df16cc4ec0eb20567ca03f52e167d8", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "66384b595a953a298cfd60e4301d14e6", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1576535946.2-225647909520304/source", "state": "file", "uid": 0} 2019-12-16T22:39:06.799 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.052) 0:00:53.183 ******* 2019-12-16T22:39:06.803 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-16T22:39:06.805 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:06.854 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.057) 0:00:53.240 ******* 2019-12-16T22:39:06.863 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi106.front.sepia.ceph.com] => { "msg": "Host smithi106.front.sepia.ceph.com is running Ubuntu 18.04 (bionic)" } 2019-12-16T22:39:06.899 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.046) 0:00:53.287 ******* 2019-12-16T22:39:06.905 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-16T22:39:06.907 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:06.953 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:06 +0000 (0:00:00.053) 0:00:53.341 ******* 2019-12-16T22:39:06.961 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-16T22:39:06.961 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-16T22:39:07.015 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.059) 0:00:53.400 ******* 2019-12-16T22:39:07.023 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.078 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.061) 0:00:53.462 ******* 2019-12-16T22:39:07.080 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-16T22:39:07.081 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.122 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.048) 0:00:53.510 ******* 2019-12-16T22:39:07.129 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-16T22:39:07.130 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:07.172 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.049) 0:00:53.560 ******* 2019-12-16T22:39:07.188 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.226 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.054) 0:00:53.614 ******* 2019-12-16T22:39:07.232 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-16T22:39:07.233 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.275 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.048) 0:00:53.663 ******* 2019-12-16T22:39:07.281 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-16T22:39:07.282 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.326 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.050) 0:00:53.713 ******* 2019-12-16T22:39:07.331 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-16T22:39:07.333 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.380 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.054) 0:00:53.768 ******* 2019-12-16T22:39:07.386 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-16T22:39:07.387 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.427 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.046) 0:00:53.815 ******* 2019-12-16T22:39:07.433 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-16T22:39:07.434 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.481 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.054) 0:00:53.869 ******* 2019-12-16T22:39:07.488 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-16T22:39:07.489 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.538 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.056) 0:00:53.926 ******* 2019-12-16T22:39:07.548 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.597 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.059) 0:00:53.985 ******* 2019-12-16T22:39:07.603 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-16T22:39:07.605 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.655 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.057) 0:00:54.043 ******* 2019-12-16T22:39:07.661 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-16T22:39:07.662 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:07.706 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.051) 0:00:54.094 ******* 2019-12-16T22:39:07.715 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-16T22:39:07.720 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.779 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.072) 0:00:54.167 ******* 2019-12-16T22:39:07.788 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-16T22:39:07.790 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.835 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.055) 0:00:54.223 ******* 2019-12-16T22:39:07.841 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-16T22:39:07.843 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.882 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.047) 0:00:54.270 ******* 2019-12-16T22:39:07.888 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-16T22:39:07.889 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:07.938 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.055) 0:00:54.326 ******* 2019-12-16T22:39:07.944 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-16T22:39:07.945 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:07.946 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:07.994 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:07 +0000 (0:00:00.055) 0:00:54.382 ******* 2019-12-16T22:39:08.000 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-16T22:39:08.005 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.041 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.047) 0:00:54.429 ******* 2019-12-16T22:39:08.047 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.095 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.053) 0:00:54.483 ******* 2019-12-16T22:39:08.104 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-16T22:39:08.104 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.145 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.050) 0:00:54.533 ******* 2019-12-16T22:39:08.151 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-16T22:39:08.151 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.193 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.047) 0:00:54.581 ******* 2019-12-16T22:39:08.199 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-16T22:39:08.199 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.240 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.047) 0:00:54.628 ******* 2019-12-16T22:39:08.246 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-16T22:39:08.247 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:08.290 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.050) 0:00:54.678 ******* 2019-12-16T22:39:08.297 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-16T22:39:08.298 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.340 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.049) 0:00:54.727 ******* 2019-12-16T22:39:08.346 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-16T22:39:08.348 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.388 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.047) 0:00:54.776 ******* 2019-12-16T22:39:08.393 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-16T22:39:08.394 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:08.448 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.050) 0:00:54.826 ******* TASK [common : Register with subscription-manager.] **************************** skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:08.487 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.049) 0:00:54.875 ******* 2019-12-16T22:39:08.493 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-16T22:39:08.538 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.051) 0:00:54.926 ******* 2019-12-16T22:39:08.544 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-16T22:39:08.546 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.585 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.047) 0:00:54.973 ******* 2019-12-16T22:39:08.592 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.644 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.052) 0:00:55.026 ******* TASK [common : List CDN releases available to system] ************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.704 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.066) 0:00:55.092 ******* 2019-12-16T22:39:08.710 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-16T22:39:08.712 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.753 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.048) 0:00:55.141 ******* 2019-12-16T22:39:08.758 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-16T22:39:08.760 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.802 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.049) 0:00:55.190 ******* 2019-12-16T22:39:08.810 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-16T22:39:08.811 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.826 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.866 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.064) 0:00:55.254 ******* 2019-12-16T22:39:08.906 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.039) 0:00:55.294 ******* 2019-12-16T22:39:08.911 INFO:teuthology.task.ansible.out: 2019-12-16T22:39:08.913 INFO:teuthology.task.ansible.out:TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:08.961 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:08 +0000 (0:00:00.055) 0:00:55.349 ******* 2019-12-16T22:39:08.967 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-16T22:39:08.968 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:08.969 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.012 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.049) 0:00:55.399 ******* 2019-12-16T22:39:09.016 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-16T22:39:09.017 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.072 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.060) 0:00:55.460 ******* 2019-12-16T22:39:09.079 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-16T22:39:09.080 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.081 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.130 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.058) 0:00:55.518 ******* 2019-12-16T22:39:09.135 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2019-12-16T22:39:09.136 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.179 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.048) 0:00:55.567 ******* 2019-12-16T22:39:09.184 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-16T22:39:09.184 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.227 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.048) 0:00:55.615 ******* 2019-12-16T22:39:09.233 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.277 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.050) 0:00:55.665 ******* 2019-12-16T22:39:09.285 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-16T22:39:09.286 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.287 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.329 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.051) 0:00:55.717 ******* 2019-12-16T22:39:09.334 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-16T22:39:09.335 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.377 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.047) 0:00:55.765 ******* 2019-12-16T22:39:09.416 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.455 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.077) 0:00:55.842 ******* 2019-12-16T22:39:09.483 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.017795", "end": "2019-12-16 22:39:09.457529", "rc": 0, "start": "2019-12-16 22:39:09.439734", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} TASK [common : Set replace_repos true if newly-subscribed] ********************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.527 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.072) 0:00:55.915 ******* 2019-12-16T22:39:09.566 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.038) 0:00:55.954 ******* 2019-12-16T22:39:09.572 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-16T22:39:09.574 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:09.621 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.054) 0:00:56.009 ******* 2019-12-16T22:39:09.627 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-16T22:39:09.628 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.671 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.049) 0:00:56.059 ******* 2019-12-16T22:39:09.678 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-16T22:39:09.722 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.051) 0:00:56.110 ******* 2019-12-16T22:39:09.729 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-16T22:39:09.729 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.773 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.051) 0:00:56.161 ******* 2019-12-16T22:39:09.779 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-16T22:39:09.780 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.823 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.049) 0:00:56.210 ******* 2019-12-16T22:39:09.830 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-16T22:39:09.831 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.894 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.071) 0:00:56.282 ******* 2019-12-16T22:39:09.902 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-16T22:39:09.903 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:09.960 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:09 +0000 (0:00:00.065) 0:00:56.348 ******* 2019-12-16T22:39:09.966 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-16T22:39:09.967 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.011 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.051) 0:00:56.399 ******* 2019-12-16T22:39:10.018 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-16T22:39:10.019 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.021 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.067 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.055) 0:00:56.455 ******* 2019-12-16T22:39:10.073 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-16T22:39:10.075 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.121 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.054) 0:00:56.509 ******* 2019-12-16T22:39:10.128 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-16T22:39:10.128 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.130 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.179 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.057) 0:00:56.567 ******* 2019-12-16T22:39:10.186 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-16T22:39:10.187 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.245 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.065) 0:00:56.632 ******* 2019-12-16T22:39:10.246 INFO:teuthology.task.ansible.out: 2019-12-16T22:39:10.252 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-16T22:39:10.254 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.255 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.297 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.052) 0:00:56.685 ******* 2019-12-16T22:39:10.304 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.349 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.048) 0:00:56.734 ******* 2019-12-16T22:39:10.352 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-16T22:39:10.353 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.402 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.056) 0:00:56.790 ******* 2019-12-16T22:39:10.455 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-16T22:39:10.457 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/18/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/18/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.461 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/18/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/18/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.508 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.105) 0:00:56.896 ******* 2019-12-16T22:39:10.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-16T22:39:10.526 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.046973", "end": "2019-12-16 22:39:10.500371", "rc": 0, "start": "2019-12-16 22:39:10.453398", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:10.594 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.086) 0:00:56.982 ******* 2019-12-16T22:39:10.632 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.689 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.094) 0:00:57.077 ******* 2019-12-16T22:39:10.695 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-16T22:39:10.696 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.027466", "end": "2019-12-16 22:39:10.734941", "rc": 0, "start": "2019-12-16 22:39:10.707475", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-16T22:39:10.740 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.051) 0:00:57.128 ******* 2019-12-16T22:39:10.783 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.823 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.082) 0:00:57.211 ******* 2019-12-16T22:39:10.851 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-16T22:39:10.853 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:10.904 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.081) 0:00:57.292 ******* 2019-12-16T22:39:10.913 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-16T22:39:10.914 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-12-16T22:39:10.916 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.024926", "end": "2019-12-16 22:39:10.827811", "rc": 0, "start": "2019-12-16 22:39:10.802885", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:10.965 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:10 +0000 (0:00:00.060) 0:00:57.352 ******* 2019-12-16T22:39:10.971 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:11.036 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:11 +0000 (0:00:00.071) 0:00:57.424 ******* 2019-12-16T22:39:11.066 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:11.113 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:11 +0000 (0:00:00.076) 0:00:57.500 ******* 2019-12-16T22:39:11.144 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-16T22:39:11.145 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:11.187 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:11 +0000 (0:00:00.074) 0:00:57.575 ******* 2019-12-16T22:39:11.215 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-16T22:39:11.216 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:11.260 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:11 +0000 (0:00:00.073) 0:00:57.648 ******* 2019-12-16T22:39:11.287 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-16T22:39:11.288 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:11.338 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:11 +0000 (0:00:00.077) 0:00:57.726 ******* 2019-12-16T22:39:12.464 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-16T22:39:12.466 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.980886", "end": "2019-12-16 22:39:12.500391", "rc": 0, "start": "2019-12-16 22:39:11.519505", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:12.541 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:12 +0000 (0:00:01.199) 0:00:58.925 ******* 2019-12-16T22:39:12.563 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-16T22:39:12.564 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:12.604 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:12 +0000 (0:00:00.066) 0:00:58.992 ******* 2019-12-16T22:39:12.756 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-16T22:39:12.757 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.023396", "end": "2019-12-16 22:39:12.812118", "rc": 0, "start": "2019-12-16 22:39:12.788722", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:12.813 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:12 +0000 (0:00:00.209) 0:00:59.201 ******* 2019-12-16T22:39:13.855 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-16T22:39:13.856 INFO:teuthology.task.ansible.out: [WARNING]: Could not find aptitude. Using apt-get instead ok: [smithi177.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:13.902 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:13 +0000 (0:00:01.088) 0:01:00.289 ******* 2019-12-16T22:39:14.745 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-16T22:39:14.746 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:14.788 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:14 +0000 (0:00:00.885) 0:01:01.175 ******* 2019-12-16T22:39:14.818 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-16T22:39:14.819 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:14.863 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:14 +0000 (0:00:00.075) 0:01:01.251 ******* 2019-12-16T22:39:15.444 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2019-12-16T22:39:15.479 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:15 +0000 (0:00:00.616) 0:01:01.867 ******* 2019-12-16T22:39:15.728 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-16T22:39:15.730 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:15.769 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:15 +0000 (0:00:00.290) 0:01:02.157 ******* 2019-12-16T22:39:16.317 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-16T22:39:16.318 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:16.359 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:16 +0000 (0:00:00.589) 0:01:02.747 ******* 2019-12-16T22:39:16.695 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:16.760 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:16 +0000 (0:00:00.398) 0:01:03.146 ******* 2019-12-16T22:39:16.767 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-16T22:39:16.768 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2019-12-16T22:39:16.780 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-16T22:39:16.781 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:16.823 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:16 +0000 (0:00:00.065) 0:01:03.211 ******* 2019-12-16T22:39:17.063 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi177.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2019-12-16T22:39:17.340 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2019-12-16T22:39:17.404 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:17 +0000 (0:00:00.580) 0:01:03.791 ******* 2019-12-16T22:39:17.411 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi177.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2019-12-16T22:39:17.476 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:17 +0000 (0:00:00.072) 0:01:03.864 ******* 2019-12-16T22:39:17.629 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-16T22:39:17.630 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2019-12-16T22:39:17.682 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:17 +0000 (0:00:00.206) 0:01:04.070 ******* 2019-12-16T22:39:18.020 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi177.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2019-12-16T22:39:18.252 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-16T22:39:18.254 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:18.315 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:18 +0000 (0:00:00.632) 0:01:04.703 ******* 2019-12-16T22:39:18.324 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-16T22:39:18.326 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2019-12-16T22:39:18.619 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2019-12-16T22:39:18.675 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:18 +0000 (0:00:00.359) 0:01:05.063 ******* 2019-12-16T22:39:18.681 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-16T22:39:18.682 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2019-12-16T22:39:18.717 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-16T22:39:18.718 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2019-12-16T22:39:18.767 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:18 +0000 (0:00:00.085) 0:01:05.148 ******* 2019-12-16T22:39:18.799 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-16T22:39:18.800 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:18.860 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:18 +0000 (0:00:00.099) 0:01:05.248 ******* 2019-12-16T22:39:18.908 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi177.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:18.948 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:18 +0000 (0:00:00.088) 0:01:05.336 ******* 2019-12-16T22:39:19.000 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-16T22:39:19.001 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:19.003 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:19.015 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:19.021 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi106.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2019-12-16T22:39:19.031 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-16T22:39:19.033 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:19.075 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:19 +0000 (0:00:00.126) 0:01:05.463 ******* 2019-12-16T22:39:19.108 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-16T22:39:19.109 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:19.164 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:19 +0000 (0:00:00.086) 0:01:05.550 ******* 2019-12-16T22:39:19.374 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-16T22:39:19.375 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2019-12-16T22:39:19.430 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:19 +0000 (0:00:00.267) 0:01:05.817 ******* 2019-12-16T22:39:19.581 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-16T22:39:19.584 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2019-12-16T22:39:19.634 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:19 +0000 (0:00:00.204) 0:01:06.022 ******* 2019-12-16T22:39:19.958 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-16T22:39:19.959 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 12725, "state": "file", "uid": 0} 2019-12-16T22:39:20.038 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-16T22:39:20.051 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:20.100 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:20 +0000 (0:00:00.466) 0:01:06.488 ******* 2019-12-16T22:39:20.330 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-16T22:39:20.334 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2019-12-16T22:39:20.450 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2019-12-16T22:39:20.496 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:20 +0000 (0:00:00.395) 0:01:06.884 ******* 2019-12-16T22:39:20.654 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** ok: [smithi106.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2019-12-16T22:39:20.698 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:20 +0000 (0:00:00.201) 0:01:07.085 ******* 2019-12-16T22:39:20.737 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-16T22:39:20.738 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2019-12-16T22:39:20.779 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:20 +0000 (0:00:00.082) 0:01:07.167 ******* 2019-12-16T22:39:20.807 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-16T22:39:20.808 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:20.852 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:20 +0000 (0:00:00.072) 0:01:07.240 ******* 2019-12-16T22:39:20.853 INFO:teuthology.task.ansible.out: 2019-12-16T22:39:20.872 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2019-12-16T22:39:20.915 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:20 +0000 (0:00:00.063) 0:01:07.303 ******* 2019-12-16T22:39:20.928 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:20.966 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:20 +0000 (0:00:00.050) 0:01:07.354 ******* 2019-12-16T22:39:21.004 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:21.016 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:21.017 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:21.029 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:21.073 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:21 +0000 (0:00:00.107) 0:01:07.461 ******* 2019-12-16T22:39:21.079 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-16T22:39:21.080 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:39:21.122 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:21 +0000 (0:00:00.049) 0:01:07.510 ******* 2019-12-16T22:39:21.128 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-16T22:39:21.129 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:21.179 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:21 +0000 (0:00:00.057) 0:01:07.567 ******* 2019-12-16T22:39:21.186 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-16T22:39:21.187 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:21.231 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:21 +0000 (0:00:00.050) 0:01:07.618 ******* 2019-12-16T22:39:21.271 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-16T22:39:21.273 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:21.325 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:21 +0000 (0:00:00.095) 0:01:07.713 ******* 2019-12-16T22:39:21.364 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:21.408 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:21 +0000 (0:00:00.082) 0:01:07.796 ******* 2019-12-16T22:39:21.795 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2019-12-16T22:39:21.850 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:21 +0000 (0:00:00.441) 0:01:08.238 ******* 2019-12-16T22:39:22.063 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:22.117 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.266) 0:01:08.505 ******* 2019-12-16T22:39:22.504 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-16T22:39:22.505 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2019-12-16T22:39:22.546 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.429) 0:01:08.934 ******* 2019-12-16T22:39:22.563 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-16T22:39:22.567 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-16 22:36:54 UTC", "ActiveEnterTimestampMonotonic": "17631517", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target nss-lookup.target basic.target var-run.mount network.target time-sync.target local-fs.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice -.mount remote-fs.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-16 22:36:54 UTC", "AssertTimestampMonotonic": "17630418", "Before": "getty@tty1.service plymouth-quit.service xdm.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-16 22:36:54 UTC", "ConditionTimestampMonotonic": "17630418", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2019-12-16T22:39:22.568 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1320", "ExecMainStartTimestamp": "Mon 2019-12-16 22:36:54 UTC", "ExecMainStartTimestampMonotonic": "17631482", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-16 22:36:54 UTC", "InactiveExitTimestampMonotonic": "17631517", "InvocationID": "e2e20706080746958ab3481979a55326", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2019-12-16T22:39:22.570 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1320", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2019-12-16T22:39:22.572 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-12-16 22:36:54 UTC", "StateChangeTimestampMonotonic": "17631517", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2019-12-16 22:36:54 UTC", "WatchdogTimestampMonotonic": "17631516", "WatchdogUSec": "0"}} 2019-12-16T22:39:22.609 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.063) 0:01:08.997 ******* 2019-12-16T22:39:22.637 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-16T22:39:22.639 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:22.682 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.072) 0:01:09.070 ******* 2019-12-16T22:39:22.714 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:22.769 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.087) 0:01:09.157 ******* 2019-12-16T22:39:22.818 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-16T22:39:22.821 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:22.868 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.098) 0:01:09.255 ******* 2019-12-16T22:39:22.894 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-16T22:39:22.896 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:22.939 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.071) 0:01:09.327 ******* 2019-12-16T22:39:22.962 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2019-12-16T22:39:22.999 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:22 +0000 (0:00:00.060) 0:01:09.387 ******* 2019-12-16T22:39:23.005 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-16T22:39:23.007 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:23.048 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.048) 0:01:09.436 ******* 2019-12-16T22:39:23.076 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-16T22:39:23.076 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:23.117 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.068) 0:01:09.505 ******* 2019-12-16T22:39:23.147 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:39:23.209 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.092) 0:01:09.597 ******* 2019-12-16T22:39:23.250 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.040) 0:01:09.638 ******* 2019-12-16T22:39:23.255 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-16T22:39:23.257 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:23.312 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.053) 0:01:09.691 ******* TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:23.355 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.051) 0:01:09.743 ******* 2019-12-16T22:39:23.363 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** skipping: [smithi106.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-16T22:39:23.405 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.049) 0:01:09.793 ******* 2019-12-16T22:39:23.410 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-16T22:39:23.412 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:23.452 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.047) 0:01:09.840 ******* 2019-12-16T22:39:23.458 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:23.501 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.049) 0:01:09.889 ******* 2019-12-16T22:39:23.512 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:23.554 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.052) 0:01:09.942 ******* 2019-12-16T22:39:23.591 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-16T22:39:23.593 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2019-12-16T22:39:23.635 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.081) 0:01:10.023 ******* 2019-12-16T22:39:23.683 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-16T22:39:23.694 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2019-12-16T22:39:23.760 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.124) 0:01:10.148 ******* 2019-12-16T22:39:23.807 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-16T22:39:23.813 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2019-12-16T22:39:23.850 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.090) 0:01:10.238 ******* 2019-12-16T22:39:23.866 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-16T22:39:23.867 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "9c3d1d79583cf76a6d81bb2ec150bc4af5ca3c5c", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1166, "state": "file", "uid": 0} 2019-12-16T22:39:23.913 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.061) 0:01:10.300 ******* 2019-12-16T22:39:23.918 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-16T22:39:23.919 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-16T22:39:23.963 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:23 +0000 (0:00:00.050) 0:01:10.350 ******* 2019-12-16T22:39:24.105 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-16T22:39:24.148 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.185) 0:01:10.535 ******* 2019-12-16T22:39:24.154 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-16T22:39:24.157 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-16 22:37:26 UTC", "ActiveEnterTimestampMonotonic": "17812414", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice remote-fs.target sysinit.target basic.target nss-lookup.target time-sync.target systemd-journald.socket var-run.mount -.mount network.target local-fs.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-16 22:37:26 UTC", "AssertTimestampMonotonic": "17811605", "Before": "getty@tty1.service plymouth-quit.service multi-user.target shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-16 22:37:26 UTC", "ConditionTimestampMonotonic": "17811605", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-ser 2019-12-16T22:39:24.159 INFO:teuthology.task.ansible.out:ver.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EnvironmentFile": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1345", "ExecMainStartTimestamp": "Mon 2019-12-16 22:37:26 UTC", "ExecMainStartTimestampMonotonic": "17812387", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-16 22:37:26 UTC", "InactiveExitTimestampMonotonic": "17812414", "InvocationID": "fca90f99d96342e580b4b1eed40e9e06", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "i 2019-12-16T22:39:24.160 INFO:teuthology.task.ansible.out:nfinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128033", "LimitNPROCSoft": "128033", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128033", "LimitSIGPENDINGSoft": "128033", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1345", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nagios/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no" 2019-12-16T22:39:24.164 INFO:teuthology.task.ansible.out:, "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-12-16 22:37:26 UTC", "StateChangeTimestampMonotonic": "17812414", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "109", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2019-12-16 22:37:26 UTC", "WatchdogTimestampMonotonic": "17812413", "WatchdogUSec": "0"}} 2019-12-16T22:39:24.210 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.062) 0:01:10.598 ******* 2019-12-16T22:39:24.236 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-16T22:39:24.238 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.279 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.069) 0:01:10.667 ******* 2019-12-16T22:39:24.284 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-16T22:39:24.285 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2019-12-16T22:39:24.328 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.048) 0:01:10.715 ******* 2019-12-16T22:39:24.335 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.377 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.049) 0:01:10.765 ******* 2019-12-16T22:39:24.384 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-16T22:39:24.384 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.436 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.058) 0:01:10.824 ******* 2019-12-16T22:39:24.442 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-16T22:39:24.442 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.488 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.052) 0:01:10.876 ******* 2019-12-16T22:39:24.494 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-16T22:39:24.495 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.539 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.050) 0:01:10.927 ******* 2019-12-16T22:39:24.546 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-16T22:39:24.547 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.593 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.053) 0:01:10.980 ******* 2019-12-16T22:39:24.619 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-16T22:39:24.621 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.676 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.082) 0:01:11.063 ******* 2019-12-16T22:39:24.702 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-16T22:39:24.704 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.748 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.070) 0:01:11.134 ******* 2019-12-16T22:39:24.752 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi177.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2019-12-16T22:39:24.797 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.050) 0:01:11.185 ******* 2019-12-16T22:39:24.803 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-16T22:39:24.805 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.846 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.049) 0:01:11.234 ******* 2019-12-16T22:39:24.872 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-16T22:39:24.874 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:24.922 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:24 +0000 (0:00:00.076) 0:01:11.310 ******* 2019-12-16T22:39:24.960 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-16T22:39:24.962 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:25.010 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.087) 0:01:11.398 ******* 2019-12-16T22:39:25.054 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-16T22:39:25.055 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:25.104 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.093) 0:01:11.492 ******* 2019-12-16T22:39:25.155 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-16T22:39:25.157 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2019-12-16T22:39:25.196 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.092) 0:01:11.584 ******* 2019-12-16T22:39:25.228 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2019-12-16T22:39:25.264 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.067) 0:01:11.652 ******* 2019-12-16T22:39:25.270 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-16T22:39:25.272 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-virtualenv", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "python-configobj", "python-gevent", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "btrfs-tools", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "python-nose", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "python-numpy", "python-matplotlib", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2019-12-16T22:39:25.319 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.054) 0:01:11.707 ******* 2019-12-16T22:39:25.325 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-16T22:39:25.326 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi177"}, "changed": false} 2019-12-16T22:39:25.373 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.053) 0:01:11.761 ******* 2019-12-16T22:39:25.380 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3", "libssl1.0.0"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_18.yml"} 2019-12-16T22:39:25.425 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.051) 0:01:11.812 ******* 2019-12-16T22:39:25.462 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2019-12-16T22:39:25.464 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-16T22:39:25.507 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.082) 0:01:11.895 ******* 2019-12-16T22:39:25.648 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-16T22:39:25.649 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2019-12-16T22:39:25.701 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.193) 0:01:12.089 ******* 2019-12-16T22:39:25.848 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-16T22:39:25.850 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "name": "ubuntu", "state": "present", "system": false} 2019-12-16T22:39:25.916 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.214) 0:01:12.304 ******* 2019-12-16T22:39:25.957 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-16T22:39:25.959 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:26.002 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:25 +0000 (0:00:00.085) 0:01:12.389 ******* 2019-12-16T22:39:26.030 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:26.071 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:26 +0000 (0:00:00.068) 0:01:12.458 ******* 2019-12-16T22:39:26.230 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2019-12-16T22:39:26.231 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2019-12-16T22:39:26.270 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:26 +0000 (0:00:00.199) 0:01:12.658 ******* 2019-12-16T22:39:26.296 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-16T22:39:26.298 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi177", "ansible_hostname": "smithi177", "ansible_nodename": "smithi177"}, "changed": false, "name": "smithi177"} 2019-12-16T22:39:26.341 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:26 +0000 (0:00:00.069) 0:01:12.727 ******* 2019-12-16T22:39:26.685 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-16T22:39:26.686 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2019-12-16T22:39:26.740 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:26 +0000 (0:00:00.400) 0:01:13.128 ******* 2019-12-16T22:39:26.746 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-16T22:39:26.748 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2019-12-16T22:39:26.794 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:26 +0000 (0:00:00.054) 0:01:13.182 ******* 2019-12-16T22:39:26.833 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-16T22:39:26.834 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi106"}, "changed": false} 2019-12-16T22:39:26.875 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:26 +0000 (0:00:00.081) 0:01:13.263 ******* 2019-12-16T22:39:27.069 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2019-12-16T22:39:27.115 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:27 +0000 (0:00:00.239) 0:01:13.502 ******* 2019-12-16T22:39:27.375 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-16T22:39:27.376 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi106", "ansible_hostname": "smithi106", "ansible_nodename": "smithi106"}, "changed": false, "name": "smithi106"} 2019-12-16T22:39:27.418 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:27 +0000 (0:00:00.303) 0:01:13.806 ******* 2019-12-16T22:39:27.632 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-16T22:39:27.634 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-16T22:39:27.676 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:27 +0000 (0:00:00.257) 0:01:14.063 ******* 2019-12-16T22:39:27.713 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-16T22:39:27.715 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:27.755 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:27 +0000 (0:00:00.079) 0:01:14.143 ******* 2019-12-16T22:39:27.781 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-16T22:39:27.782 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:27.834 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:27 +0000 (0:00:00.078) 0:01:14.222 ******* 2019-12-16T22:39:27.840 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-16T22:39:27.841 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2019-12-16T22:39:27.892 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:27 +0000 (0:00:00.057) 0:01:14.280 ******* 2019-12-16T22:39:27.901 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:27.944 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:27 +0000 (0:00:00.052) 0:01:14.332 ******* 2019-12-16T22:39:27.970 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.012 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.068) 0:01:14.400 ******* 2019-12-16T22:39:28.040 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-16T22:39:28.041 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.087 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.074) 0:01:14.475 ******* 2019-12-16T22:39:28.113 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-16T22:39:28.115 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.156 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.069) 0:01:14.544 ******* 2019-12-16T22:39:28.183 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-16T22:39:28.185 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.226 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.069) 0:01:14.613 ******* 2019-12-16T22:39:28.247 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-16T22:39:28.247 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2019-12-16T22:39:28.249 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-16T22:39:28.295 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.069) 0:01:14.683 ******* 2019-12-16T22:39:28.334 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.038) 0:01:14.722 ******* 2019-12-16T22:39:28.360 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-16T22:39:28.406 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.071) 0:01:14.793 ******* 2019-12-16T22:39:28.432 INFO:teuthology.task.ansible.out: 2019-12-16T22:39:28.434 INFO:teuthology.task.ansible.out:TASK [testnode : Enable copr repos] ******************************************** 2019-12-16T22:39:28.482 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.072) 0:01:14.866 ******* 2019-12-16T22:39:28.507 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-16T22:39:28.508 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.548 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.069) 0:01:14.936 ******* 2019-12-16T22:39:28.587 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-16T22:39:28.589 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.632 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.083) 0:01:15.020 ******* 2019-12-16T22:39:28.658 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-16T22:39:28.660 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.701 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.069) 0:01:15.089 ******* 2019-12-16T22:39:28.727 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-16T22:39:28.729 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.778 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.077) 0:01:15.166 ******* 2019-12-16T22:39:28.816 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-16T22:39:28.818 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-16T22:39:28.858 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.079) 0:01:15.246 ******* 2019-12-16T22:39:28.894 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.036) 0:01:15.282 ******* 2019-12-16T22:39:28.899 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-16T22:39:28.899 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.940 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.045) 0:01:15.328 ******* 2019-12-16T22:39:28.946 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-16T22:39:28.947 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:28.987 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:28 +0000 (0:00:00.047) 0:01:15.375 ******* 2019-12-16T22:39:28.992 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-16T22:39:28.994 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.033 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.045) 0:01:15.421 ******* 2019-12-16T22:39:29.040 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.083 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.049) 0:01:15.471 ******* 2019-12-16T22:39:29.089 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-16T22:39:29.090 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.141 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.058) 0:01:15.529 ******* 2019-12-16T22:39:29.147 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-16T22:39:29.149 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.189 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.048) 0:01:15.577 ******* 2019-12-16T22:39:29.195 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-16T22:39:29.195 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.240 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.050) 0:01:15.627 ******* 2019-12-16T22:39:29.246 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-16T22:39:29.247 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.291 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.051) 0:01:15.679 ******* 2019-12-16T22:39:29.297 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-16T22:39:29.298 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.341 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.049) 0:01:15.729 ******* 2019-12-16T22:39:29.348 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-16T22:39:29.349 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.391 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.049) 0:01:15.779 ******* 2019-12-16T22:39:29.396 INFO:teuthology.task.ansible.out: 2019-12-16T22:39:29.398 INFO:teuthology.task.ansible.out:TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.440 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.049) 0:01:15.828 ******* 2019-12-16T22:39:29.447 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-16T22:39:29.449 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.492 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.051) 0:01:15.879 ******* 2019-12-16T22:39:29.497 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.540 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.048) 0:01:15.928 ******* 2019-12-16T22:39:29.546 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-16T22:39:29.548 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.598 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.057) 0:01:15.986 ******* 2019-12-16T22:39:29.608 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-16T22:39:29.651 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.053) 0:01:16.039 ******* 2019-12-16T22:39:29.658 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-16T22:39:29.662 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.700 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.048) 0:01:16.088 ******* 2019-12-16T22:39:29.706 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-16T22:39:29.753 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.052) 0:01:16.141 ******* 2019-12-16T22:39:29.760 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-16T22:39:29.761 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.804 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.051) 0:01:16.192 ******* 2019-12-16T22:39:29.811 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2019-12-16T22:39:29.854 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.050) 0:01:16.242 ******* 2019-12-16T22:39:29.861 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-16T22:39:29.863 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.925 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.065) 0:01:16.308 ******* TASK [testnode : Install GPG] ************************************************** 2019-12-16T22:39:29.926 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:29.968 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:29 +0000 (0:00:00.048) 0:01:16.356 ******* 2019-12-16T22:39:29.974 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-16T22:39:29.976 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.022 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.053) 0:01:16.409 ******* 2019-12-16T22:39:30.031 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-16T22:39:30.032 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.033 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.084 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.062) 0:01:16.472 ******* 2019-12-16T22:39:30.094 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-16T22:39:30.095 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.157 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.072) 0:01:16.544 ******* 2019-12-16T22:39:30.163 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-16T22:39:30.164 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.207 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.050) 0:01:16.595 ******* 2019-12-16T22:39:30.247 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-16T22:39:30.249 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.292 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.085) 0:01:16.680 ******* 2019-12-16T22:39:30.300 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.004957", "end": "2019-12-16 22:39:30.279977", "rc": 0, "start": "2019-12-16 22:39:30.275020", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:30.341 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.049) 0:01:16.729 ******* 2019-12-16T22:39:30.348 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-16T22:39:30.348 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.390 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.048) 0:01:16.778 ******* 2019-12-16T22:39:30.396 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-16T22:39:30.455 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.064) 0:01:16.843 ******* 2019-12-16T22:39:30.464 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-16T22:39:30.465 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.510 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.054) 0:01:16.898 ******* 2019-12-16T22:39:30.538 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-16T22:39:30.540 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.607 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.097) 0:01:16.995 ******* 2019-12-16T22:39:30.638 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.689 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.078) 0:01:17.073 ******* 2019-12-16T22:39:30.725 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-16T22:39:30.727 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.766 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.080) 0:01:17.153 ******* 2019-12-16T22:39:30.803 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-16T22:39:30.804 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.847 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.081) 0:01:17.235 ******* 2019-12-16T22:39:30.854 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-16T22:39:30.855 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2019-12-16T22:39:30.898 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.051) 0:01:17.286 ******* 2019-12-16T22:39:30.904 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-16T22:39:30.906 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:30.953 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:30 +0000 (0:00:00.055) 0:01:17.341 ******* 2019-12-16T22:39:30.960 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-16T22:39:30.961 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:31.006 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.053) 0:01:17.394 ******* 2019-12-16T22:39:31.014 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:31.082 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.074) 0:01:17.469 ******* 2019-12-16T22:39:31.110 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-16T22:39:31.112 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:31.158 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.070) 0:01:17.540 ******* 2019-12-16T22:39:31.179 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-16T22:39:31.181 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:31.231 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.077) 0:01:17.617 ******* 2019-12-16T22:39:31.257 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-16T22:39:31.258 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:31.325 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.095) 0:01:17.713 ******* 2019-12-16T22:39:31.375 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-16T22:39:31.376 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:31.417 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.092) 0:01:17.805 ******* 2019-12-16T22:39:31.456 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:31.498 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.081) 0:01:17.886 ******* 2019-12-16T22:39:31.500 INFO:teuthology.task.ansible.out: 2019-12-16T22:39:31.644 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005116", "end": "2019-12-16 22:39:31.684131", "rc": 0, "start": "2019-12-16 22:39:31.679015", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:31.685 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.186) 0:01:18.072 ******* 2019-12-16T22:39:31.725 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-16T22:39:31.766 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:31 +0000 (0:00:00.081) 0:01:18.154 ******* 2019-12-16T22:39:32.144 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-16T22:39:32.146 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2019-12-16T22:39:32.198 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:32 +0000 (0:00:00.432) 0:01:18.586 ******* 2019-12-16T22:39:32.226 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:32.270 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:32 +0000 (0:00:00.071) 0:01:18.657 ******* 2019-12-16T22:39:32.280 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi177.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2019-12-16T22:39:33.193 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2019-12-16T22:39:33.233 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:33 +0000 (0:00:00.963) 0:01:19.621 ******* 2019-12-16T22:39:33.314 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2019-12-16T22:39:34.164 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:34.227 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:34 +0000 (0:00:00.993) 0:01:20.615 ******* 2019-12-16T22:39:34.255 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-16T22:39:34.257 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2019-12-16T22:39:34.259 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-16T22:39:34.307 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:34 +0000 (0:00:00.076) 0:01:20.691 ******* 2019-12-16T22:39:34.341 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:34 +0000 (0:00:00.037) 0:01:20.729 ******* 2019-12-16T22:39:34.538 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.036314", "end": "2019-12-16 22:39:34.519635", "rc": 0, "start": "2019-12-16 22:39:34.483321", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:34.596 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:34 +0000 (0:00:00.248) 0:01:20.977 ******* 2019-12-16T22:39:35.213 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-16T22:39:35.214 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:35.266 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:35 +0000 (0:00:00.676) 0:01:21.654 ******* 2019-12-16T22:39:35.296 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-16T22:39:35.347 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:35 +0000 (0:00:00.080) 0:01:21.735 ******* 2019-12-16T22:39:35.538 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-16T22:39:35.543 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.036102", "end": "2019-12-16 22:39:35.575782", "rc": 0, "start": "2019-12-16 22:39:35.539680", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:39:35.579 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:35 +0000 (0:00:00.230) 0:01:21.965 ******* 2019-12-16T22:39:37.313 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:37.352 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:37 +0000 (0:00:01.772) 0:01:23.738 ******* 2019-12-16T22:39:38.412 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:38.481 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:38 +0000 (0:00:01.130) 0:01:24.869 ******* 2019-12-16T22:39:47.544 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-16T22:39:47.546 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101857 files and directorie 2019-12-16T22:39:47.547 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2019-12-16T22:39:47.549 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101857 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-16T22:39:47.588 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:47 +0000 (0:00:09.107) 0:01:33.976 ******* 2019-12-16T22:39:48.196 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0\n libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1\n libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0\n libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0\n libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3\n libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0\n libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5\n libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.\nAfter this operation, 47.5 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101857 files and directorie 2019-12-16T22:39:48.198 INFO:teuthology.task.ansible.out:s currently installed.)\r\nRemoving qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nRemoving librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nRemoving librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1 libavc1394-0", " libbluetooth3 libbrlapi0.6 libcacard0 libcdparanoia0 libdv4 libfdt1", " libgstreamer-plugins-base1.0-0 libgstreamer-plugins-good1.0-0", " libgstreamer1.0-0 libiec61883-0 libiscsi7 libjack-jackd2-0 libmp3lame0", " libmpg123-0 libopus0 liborc-0.4-0 libraw1394-11 libsamplerate0 libshout3", " libspeex1 libspice-server1 libtag1v5 libtag1v5-vanilla libtwolame0", " libusbredirparser1 libv4l-0 libv4lconvert0 libvisual-0.4-0 libvpx5", " libwavpack1 libxen-4.9 libxenstore3.0 libyajl2 msr-tools seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 15 not upgraded.", "After this operation, 47.5 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Readin 2019-12-16T22:39:48.199 INFO:teuthology.task.ansible.out:g database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101857 files and directories currently installed.)", "Removing qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Removing qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Removing librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Removing librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-16T22:39:48.236 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:48 +0000 (0:00:00.648) 0:01:34.624 ******* 2019-12-16T22:39:48.485 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-16T22:39:48.486 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:48.553 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:48 +0000 (0:00:00.311) 0:01:34.936 ******* 2019-12-16T22:39:48.609 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-16T22:39:48.610 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:48.658 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:48 +0000 (0:00:00.110) 0:01:35.046 ******* 2019-12-16T22:39:49.112 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:49.155 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:49 +0000 (0:00:00.494) 0:01:35.541 ******* 2019-12-16T22:39:49.191 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-16T22:39:49.192 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:39:49.233 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:49 +0000 (0:00:00.079) 0:01:35.621 ******* 2019-12-16T22:39:57.513 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-16T22:39:57.518 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.5 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.4 MB in 1s (9464 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2019-12-16T22:39:57.520 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101715 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2019-12-16T22:39:57.524 INFO:teuthology.task.ansible.out:u1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.5 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.4 MB in 1s (9464 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2019-12-16T22:39:57.526 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101715 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-16T22:39:57.566 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:57 +0000 (0:00:08.332) 0:01:43.953 ******* 2019-12-16T22:39:58.156 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.17.1-1ubuntu0.5).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 sgabios ovmf debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.\nNeed to get 10.4 MB of archives.\nAfter this operation, 47.5 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]\nGet:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]\nGet:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]\nGet:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]\nGet:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]\nGet:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]\nFetched 10.4 MB in 1s (8961 kB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database .. 2019-12-16T22:39:58.157 INFO:teuthology.task.ansible.out:. 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 101715 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...\r\nUnpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...\r\nUnpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up librados2 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...\r\nSetting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...\r\nSetting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...\r\nProcessing triggers for man-db (2.8.3-2ubuntu0.1) ...\r\nProcessing triggers for libc-bin (2.27-3ubunt 2019-12-16T22:39:58.162 INFO:teuthology.task.ansible.out:u1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is already the newest version (1:2.17.1-1ubuntu0.5).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 sgabios ovmf debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 15 not upgraded.", "Need to get 10.4 MB of archives.", "After this operation, 47.5 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librados2 amd64 12.2.12-0ubuntu0.18.04.3 [2702 kB]", "Get:2 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 librbd1 amd64 12.2.12-0ubuntu0.18.04.3 [920 kB]", "Get:3 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-block-extra amd64 1:2.11+dfsg-1ubuntu7.21 [39.8 kB]", "Get:4 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-common amd64 1:2.11+dfsg-1ubuntu7.21 [672 kB]", "Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-system-x86 amd64 1:2.11+dfsg-1ubuntu7.21 [5197 kB]", "Get:6 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 qemu-utils amd64 1:2.11+dfsg-1ubuntu7.21 [868 kB]", "Fetched 10.4 MB in 1s (8961 kB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Rea 2019-12-16T22:39:58.167 INFO:teuthology.task.ansible.out:ding database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 101715 files and directories currently installed.)", "Preparing to unpack .../0-librados2_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_12.2.12-0ubuntu0.18.04.3_amd64.deb ...", "Unpacking librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-common (1:2.11+dfsg 2019-12-16T22:39:58.169 INFO:teuthology.task.ansible.out:-1ubuntu7.21) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a2.11+dfsg-1ubuntu7.21_amd64.deb ...", "Unpacking qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up librados2 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up librbd1 (12.2.12-0ubuntu0.18.04.3) ...", "Setting up qemu-block-extra:amd64 (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-utils (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-common (1:2.11+dfsg-1ubuntu7.21) ...", "Setting up qemu-system-x86 (1:2.11+dfsg-1ubuntu7.21) ...", "Processing triggers for man-db (2.8.3-2ubuntu0.1) ...", "Processing triggers for libc-bin (2.27-3ubuntu1) ..."]} 2019-12-16T22:39:58.226 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:58 +0000 (0:00:00.660) 0:01:44.614 ******* 2019-12-16T22:39:58.434 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-16T22:39:58.435 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:39:58.487 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:58 +0000 (0:00:00.261) 0:01:44.875 ******* 2019-12-16T22:39:58.632 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-16T22:39:58.634 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2019-12-16T22:39:58.674 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:58 +0000 (0:00:00.187) 0:01:45.062 ******* 2019-12-16T22:39:58.863 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 16 December 2019 22:39:58 +0000 (0:00:00.088) 0:01:45.151 ******* 2019-12-16T22:39:58.922 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-16T22:39:58.924 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2019-12-16T22:39:58.974 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:58 +0000 (0:00:00.210) 0:01:45.362 ******* 2019-12-16T22:39:59.176 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-16T22:39:59.177 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:39:59.222 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:59 +0000 (0:00:00.247) 0:01:45.609 ******* 2019-12-16T22:39:59.353 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2019-12-16T22:39:59.409 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:59 +0000 (0:00:00.184) 0:01:45.794 ******* 2019-12-16T22:39:59.412 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-16T22:39:59.413 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2019-12-16T22:39:59.461 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:59 +0000 (0:00:00.053) 0:01:45.848 ******* 2019-12-16T22:39:59.507 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-16T22:39:59.557 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Monday 16 December 2019 22:39:59 +0000 (0:00:00.096) 0:01:45.944 ******* 2019-12-16T22:39:59.574 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-16T22:39:59.575 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-16T22:39:59.632 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:59 +0000 (0:00:00.075) 0:01:46.020 ******* 2019-12-16T22:39:59.702 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-16T22:39:59.704 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2019-12-16T22:39:59.770 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:59 +0000 (0:00:00.138) 0:01:46.158 ******* 2019-12-16T22:39:59.786 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-16T22:39:59.787 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:39:59.832 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:39:59 +0000 (0:00:00.061) 0:01:46.219 ******* 2019-12-16T22:40:00.130 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-16T22:40:00.136 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2019-12-16 22:36:55 UTC", "ActiveEnterTimestampMonotonic": "18398925", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-tmpfiles-setup.service sysinit.target basic.target network.target system.slice remote-fs.target systemd-journald.socket nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-16 22:36:54 UTC", "AssertTimestampMonotonic": "17627317", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-16 22:36:54 UTC", "ConditionTimestampMonotonic": "17627317", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2019-12-16T22:40:00.138 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1408", "ExecMainStartTimestamp": "Mon 2019-12-16 22:36:55 UTC", "ExecMainStartTimestampMonotonic": "18398913", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-16 22:36:54 UTC", "InactiveExitTimestampMonotonic": "17627982", "InvocationID": "df6a453c39a54ceaa43367fdaef5cd32", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2019-12-16T22:40:00.139 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1408", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2019-12-16T22:40:00.141 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-12-16 22:36:55 UTC", "StateChangeTimestampMonotonic": "18398925", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2019-12-16 22:36:55 UTC", "WatchdogTimestampMonotonic": "18398923", "WatchdogUSec": "0"}} 2019-12-16T22:40:00.178 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.346) 0:01:46.566 ******* 2019-12-16T22:40:00.185 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-16T22:40:00.186 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2019-12-16T22:40:00.248 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.053) 0:01:46.620 ******* TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.284 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.051) 0:01:46.671 ******* 2019-12-16T22:40:00.321 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.367 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.081) 0:01:46.753 ******* 2019-12-16T22:40:00.404 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-16T22:40:00.405 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1205, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.452 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.087) 0:01:46.840 ******* 2019-12-16T22:40:00.517 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.061) 0:01:46.902 ******* 2019-12-16T22:40:00.566 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.613 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.098) 0:01:47.000 ******* 2019-12-16T22:40:00.641 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.688 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.075) 0:01:47.076 ******* 2019-12-16T22:40:00.702 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:40:00.743 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.054) 0:01:47.131 ******* 2019-12-16T22:40:00.752 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.800 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.056) 0:01:47.188 ******* 2019-12-16T22:40:00.827 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.869 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.069) 0:01:47.257 ******* 2019-12-16T22:40:00.898 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-16T22:40:00.900 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:00.948 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:00 +0000 (0:00:00.079) 0:01:47.336 ******* 2019-12-16T22:40:00.949 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:00.977 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:00.978 INFO:teuthology.task.ansible.out:TASK [testnode : Remove packages] ********************************************** 2019-12-16T22:40:00.980 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.024 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.075) 0:01:47.412 ******* 2019-12-16T22:40:01.073 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-16T22:40:01.075 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.124 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.098) 0:01:47.511 ******* 2019-12-16T22:40:01.165 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.218 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.094) 0:01:47.605 ******* 2019-12-16T22:40:01.228 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-16T22:40:01.240 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2019-12-16 22:37:27 UTC", "ActiveEnterTimestampMonotonic": "18585588", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target sysinit.target systemd-tmpfiles-setup.service network.target systemd-journald.socket system.slice remote-fs.target basic.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-16 22:37:26 UTC", "AssertTimestampMonotonic": "17812544", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-16 22:37:26 UTC", "ConditionTimestampMonotonic": "17812544", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", " 2019-12-16T22:40:01.244 INFO:teuthology.task.ansible.out:DropInPaths": "/lib/systemd/system/apache2.service.d/apache2-systemd.conf", "DynamicUser": "no", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1448", "ExecMainStartTimestamp": "Mon 2019-12-16 22:37:27 UTC", "ExecMainStartTimestampMonotonic": "18585577", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-16 22:37:26 UTC", "InactiveExitTimestampMonotonic": "17813133", "InvocationID": "e80505cb9bd44689970033daf2741554", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESof 2019-12-16T22:40:01.246 INFO:teuthology.task.ansible.out:t": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128033", "LimitNPROCSoft": "128033", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128033", "LimitSIGPENDINGSoft": "128033", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1448", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": 2019-12-16T22:40:01.248 INFO:teuthology.task.ansible.out: "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-12-16 22:37:27 UTC", "StateChangeTimestampMonotonic": "18585588", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2019-12-16 22:37:27 UTC", "WatchdogTimestampMonotonic": "18585587", "WatchdogUSec": "0"}} 2019-12-16T22:40:01.286 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.068) 0:01:47.674 ******* 2019-12-16T22:40:01.294 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.353 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.065) 0:01:47.739 ******* 2019-12-16T22:40:01.361 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.402 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.050) 0:01:47.789 ******* 2019-12-16T22:40:01.410 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.458 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.056) 0:01:47.846 ******* 2019-12-16T22:40:01.466 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-16T22:40:01.468 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.517 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.059) 0:01:47.905 ******* 2019-12-16T22:40:01.524 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:01.527 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.580 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.058) 0:01:47.964 ******* 2019-12-16T22:40:01.582 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-16T22:40:01.584 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.647 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.070) 0:01:48.035 ******* 2019-12-16T22:40:01.654 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-16T22:40:01.656 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.698 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.049) 0:01:48.085 ******* 2019-12-16T22:40:01.702 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-16T22:40:01.707 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.753 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.055) 0:01:48.140 ******* 2019-12-16T22:40:01.760 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-16T22:40:01.765 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.809 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.056) 0:01:48.197 ******* 2019-12-16T22:40:01.815 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-16T22:40:01.816 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.864 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.055) 0:01:48.252 ******* 2019-12-16T22:40:01.871 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.918 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.053) 0:01:48.306 ******* 2019-12-16T22:40:01.924 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:01.975 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:01 +0000 (0:00:00.056) 0:01:48.362 ******* 2019-12-16T22:40:01.984 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.027 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.052) 0:01:48.415 ******* 2019-12-16T22:40:02.029 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:02.036 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:02.037 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-16T22:40:02.039 INFO:teuthology.task.ansible.out: skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.090 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.062) 0:01:48.478 ******* 2019-12-16T22:40:02.099 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-16T22:40:02.101 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.149 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.058) 0:01:48.537 ******* 2019-12-16T22:40:02.156 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-16T22:40:02.157 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.211 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.061) 0:01:48.599 ******* 2019-12-16T22:40:02.220 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.276 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.064) 0:01:48.663 ******* 2019-12-16T22:40:02.282 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.330 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.053) 0:01:48.716 ******* 2019-12-16T22:40:02.338 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.387 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.056) 0:01:48.773 ******* 2019-12-16T22:40:02.392 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-16T22:40:02.393 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.453 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.064) 0:01:48.837 ******* 2019-12-16T22:40:02.457 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.502 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.050) 0:01:48.888 ******* 2019-12-16T22:40:02.510 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.555 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.053) 0:01:48.942 ******* 2019-12-16T22:40:02.568 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.626 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.061) 0:01:49.003 ******* TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.682 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.064) 0:01:49.068 ******* 2019-12-16T22:40:02.687 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-16T22:40:02.692 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.753 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.072) 0:01:49.140 ******* 2019-12-16T22:40:02.763 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.824 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.068) 0:01:49.209 ******* 2019-12-16T22:40:02.828 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.883 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.061) 0:01:49.271 ******* 2019-12-16T22:40:02.895 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:02.954 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:02 +0000 (0:00:00.068) 0:01:49.340 ******* 2019-12-16T22:40:02.991 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-16T22:40:02.992 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.043 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.090) 0:01:49.430 ******* 2019-12-16T22:40:03.049 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-16T22:40:03.050 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2019-12-16T22:40:03.119 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.075) 0:01:49.506 ******* 2019-12-16T22:40:03.131 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.178 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.058) 0:01:49.566 ******* 2019-12-16T22:40:03.235 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-16T22:40:03.236 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.326 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.147) 0:01:49.713 ******* 2019-12-16T22:40:03.368 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-16T22:40:03.370 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.421 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.095) 0:01:49.809 ******* 2019-12-16T22:40:03.458 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-16T22:40:03.460 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.518 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.096) 0:01:49.906 ******* 2019-12-16T22:40:03.560 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.562 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2019-12-16T22:40:03.607 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.088) 0:01:49.995 ******* 2019-12-16T22:40:03.658 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.050) 0:01:50.046 ******* 2019-12-16T22:40:03.665 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-16T22:40:03.667 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.739 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.080) 0:01:50.127 ******* 2019-12-16T22:40:03.749 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-16T22:40:03.753 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.803 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.063) 0:01:50.191 ******* 2019-12-16T22:40:03.809 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-16T22:40:03.811 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.856 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.050) 0:01:50.242 ******* 2019-12-16T22:40:03.894 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:03.932 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:03 +0000 (0:00:00.078) 0:01:50.320 ******* 2019-12-16T22:40:03.962 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:04.015 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:04 +0000 (0:00:00.081) 0:01:50.402 ******* 2019-12-16T22:40:04.056 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:04.112 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:04 +0000 (0:00:00.092) 0:01:50.494 ******* 2019-12-16T22:40:04.198 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-16T22:40:04.199 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2019-12-16T22:40:04.249 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:04 +0000 (0:00:00.142) 0:01:50.637 ******* 2019-12-16T22:40:04.265 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-16T22:40:04.266 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2019-12-16T22:40:04.309 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:04 +0000 (0:00:00.060) 0:01:50.697 ******* 2019-12-16T22:40:04.599 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-16T22:40:04.600 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2019-12-16T22:40:04.661 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:04 +0000 (0:00:00.351) 0:01:51.049 ******* 2019-12-16T22:40:04.676 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-16T22:40:04.678 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2019-12-16T22:40:04.730 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:04 +0000 (0:00:00.068) 0:01:51.117 ******* 2019-12-16T22:40:04.759 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-16T22:40:04.765 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:04.811 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:04 +0000 (0:00:00.081) 0:01:51.199 ******* 2019-12-16T22:40:05.010 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-16T22:40:05.011 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2019-12-16T22:40:05.067 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.256) 0:01:51.455 ******* 2019-12-16T22:40:05.197 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-16T22:40:05.198 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2019-12-16T22:40:05.239 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.172) 0:01:51.627 ******* 2019-12-16T22:40:05.246 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-16T22:40:05.247 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:40:05.295 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.056) 0:01:51.683 ******* 2019-12-16T22:40:05.343 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:05.412 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.109) 0:01:51.793 ******* 2019-12-16T22:40:05.432 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-16T22:40:05.433 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:05.481 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.071) 0:01:51.864 ******* 2019-12-16T22:40:05.515 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:05.572 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.095) 0:01:51.959 ******* 2019-12-16T22:40:05.598 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-16T22:40:05.600 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:05.658 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.087) 0:01:52.046 ******* 2019-12-16T22:40:05.666 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-16T22:40:05.667 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2019-12-16T22:40:05.709 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.050) 0:01:52.097 ******* 2019-12-16T22:40:05.715 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-16T22:40:05.717 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:05.788 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.078) 0:01:52.176 ******* 2019-12-16T22:40:05.837 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-16T22:40:05.839 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-16T22:40:05.898 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:05 +0000 (0:00:00.109) 0:01:52.286 ******* 2019-12-16T22:40:05.970 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-16T22:40:05.972 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:05.981 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:05.998 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.004 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.016 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.027 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.039 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.040 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.052 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.067 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-16T22:40:06.080 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.082 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.094 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.105 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.106 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-16T22:40:06.106 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2019-12-16T22:40:06.161 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.262) 0:01:52.549 ******* 2019-12-16T22:40:06.167 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2019-12-16T22:40:06.169 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.217 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.056) 0:01:52.605 ******* 2019-12-16T22:40:06.289 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-16T22:40:06.290 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:40:06.290 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:06.378 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.160) 0:01:52.766 ******* 2019-12-16T22:40:06.388 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-16T22:40:06.390 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004464", "end": "2019-12-16 22:40:06.365519", "rc": 0, "start": "2019-12-16 22:40:06.361055", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-16T22:40:06.440 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.062) 0:01:52.828 ******* 2019-12-16T22:40:06.446 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-16T22:40:06.448 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.502 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.061) 0:01:52.890 ******* 2019-12-16T22:40:06.510 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-16T22:40:06.512 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.585 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.083) 0:01:52.973 ******* 2019-12-16T22:40:06.597 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.643 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.053) 0:01:53.026 ******* 2019-12-16T22:40:06.645 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-16T22:40:06.646 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.698 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.058) 0:01:53.085 ******* 2019-12-16T22:40:06.703 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-16T22:40:06.708 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.752 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.055) 0:01:53.140 ******* 2019-12-16T22:40:06.761 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-16T22:40:06.762 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.818 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.062) 0:01:53.203 ******* 2019-12-16T22:40:06.827 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.887 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.064) 0:01:53.267 ******* 2019-12-16T22:40:06.923 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:06.969 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:06 +0000 (0:00:00.086) 0:01:53.354 ******* 2019-12-16T22:40:07.004 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-16T22:40:07.066 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.100) 0:01:53.454 ******* 2019-12-16T22:40:07.114 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi106.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.125 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.136 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.147 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.158 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi106.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.169 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.180 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.185 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:07.193 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.220 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-16T22:40:07.231 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.250 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.250 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.252 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:07.264 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.275 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.331 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.264) 0:01:53.719 ******* 2019-12-16T22:40:07.501 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-16T22:40:07.503 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005088", "end": "2019-12-16 22:40:07.477269", "rc": 0, "start": "2019-12-16 22:40:07.472181", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-16T22:40:07.555 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.223) 0:01:53.943 ******* 2019-12-16T22:40:07.593 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.649 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.083) 0:01:54.027 ******* 2019-12-16T22:40:07.676 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-16T22:40:07.677 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.717 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.078) 0:01:54.105 ******* 2019-12-16T22:40:07.724 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-16T22:40:07.724 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:40:07.768 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.048) 0:01:54.154 ******* 2019-12-16T22:40:07.773 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.829 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.063) 0:01:54.217 ******* 2019-12-16T22:40:07.837 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:07.879 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.050) 0:01:54.267 ******* 2019-12-16T22:40:07.931 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-16T22:40:07.932 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item={u'block_used': 13608075, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226487033, u'size_available': 927690887168, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60941454, u'device': u'/dev/sda1', u'inode_used': 113522, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226487033, "block_size": 4096, "block_total": 240095108, "block_used": 13608075, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941454, "inode_total": 61054976, "inode_used": 113522, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927690887168, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2019-12-16T22:40:07.981 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:07 +0000 (0:00:00.101) 0:01:54.369 ******* 2019-12-16T22:40:08.152 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010101", "end": "2019-12-16 22:40:08.147280", "rc": 0, "start": "2019-12-16 22:40:08.137179", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:08.187 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:08 +0000 (0:00:00.206) 0:01:54.575 ******* 2019-12-16T22:40:08.231 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-16T22:40:08.233 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'block_used': 13608075, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226487033, u'size_available': 927690887168, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60941454, u'device': u'/dev/sda1', u'inode_used': 113522, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226487033, "block_size": 4096, "block_total": 240095108, "block_used": 13608075, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941454, "inode_total": 61054976, "inode_used": 113522, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927690887168, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.276 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:08 +0000 (0:00:00.088) 0:01:54.663 ******* 2019-12-16T22:40:08.302 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-16T22:40:08.359 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:08 +0000 (0:00:00.082) 0:01:54.746 ******* 2019-12-16T22:40:08.427 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-16T22:40:08.428 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNXN', u'wwn-0x5000c5009294113e'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XNXN', u'wwn': u'0x5000c5009294113e', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNXN-part1', u'wwn-0x5000c5009294113e-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNXN", "wwn-0x5000c5009294113e"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNXN-part1", "wwn-0x5000c5009294113e-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNXN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2019-12-16T22:40:08.431 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c5009294113e"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.440 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.459 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.460 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.473 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.489 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.501 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.508 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.529 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.729 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-16T22:40:08.730 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:40:08.788 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:08 +0000 (0:00:00.429) 0:01:55.176 ******* 2019-12-16T22:40:08.815 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-16T22:40:08.817 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:08.862 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:08 +0000 (0:00:00.073) 0:01:55.250 ******* 2019-12-16T22:40:08.920 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-16T22:40:08.922 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item={u'block_used': 13608062, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226487046, u'size_available': 927690940416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60941454, u'device': u'/dev/sda1', u'inode_used': 113522, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226487046, "block_size": 4096, "block_total": 240095108, "block_used": 13608062, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941454, "inode_total": 61054976, "inode_used": 113522, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927690940416, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}} 2019-12-16T22:40:08.973 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:08 +0000 (0:00:00.111) 0:01:55.361 ******* 2019-12-16T22:40:09.132 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-16T22:40:09.133 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009994", "end": "2019-12-16 22:40:09.145231", "rc": 0, "start": "2019-12-16 22:40:09.135237", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:09.176 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:09 +0000 (0:00:00.203) 0:01:55.564 ******* 2019-12-16T22:40:09.248 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-16T22:40:09.261 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'block_used': 13608062, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226487046, u'size_available': 927690940416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60941454, u'device': u'/dev/sda1', u'inode_used': 113522, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226487046, "block_size": 4096, "block_total": 240095108, "block_used": 13608062, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941454, "inode_total": 61054976, "inode_used": 113522, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927690940416, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.295 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:09 +0000 (0:00:00.118) 0:01:55.683 ******* 2019-12-16T22:40:09.322 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-16T22:40:09.365 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:09 +0000 (0:00:00.070) 0:01:55.753 ******* 2019-12-16T22:40:09.418 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-16T22:40:09.419 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QHPJ', u'wwn-0x5000c50091e1aea6'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QHPJ', u'wwn': u'0x5000c50091e1aea6', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', u'wwn-0x5000c50091e1aea6-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB' 2019-12-16T22:40:09.425 INFO:teuthology.task.ansible.out:}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50091e1aea6"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.427 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.440 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.452 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.465 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.489 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.502 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.503 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:09.516 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:10.491 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-muqx70-9H6n-w991-VT8u-lfMf-ABXI-RJUxY2', u'nvme-INTEL_SSDPEDMD400G4_CVFT6233007S400BGN', u'nvme-nvme.8086-43564654363233333030375334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.832178", "end": "2019-12-16 22:40:10.480768", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-muqx70-9H6n-w991-VT8u-lfMf-ABXI-RJUxY2", "nvme-INTEL_SSDPEDMD400G4_CVFT6233007S400BGN", "nvme-nvme.8086-43564654363233333030375334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:08.648590", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2019-12-16T22:40:10.492 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:11.441 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-SUec7s-zlu8-qgUf-fJnE-aK7R-TwCf-GoKYPF', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', u'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta 2019-12-16T22:40:11.443 INFO:teuthology.task.ansible.out:": "0:00:01.773140", "end": "2019-12-16 22:40:11.441314", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-SUec7s-zlu8-qgUf-fJnE-aK7R-TwCf-GoKYPF", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:09.668174", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:11.762 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngvyCbCV6JTGAhLdoKXUnXMU1bPO0eYp0q'], u'uuids': [u'1037513d-4742-4d35-9642-3e97de85f204']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.132129", "end": "2019-12-16 22:40:11.745117", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngvyCbCV6JTGAhLdoKXUnXMU1bPO0eYp0q"], "labels": [], "masters": [], "uuids": ["1037513d-4742-4d35-9642-3e97de85f204"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:10.612988", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:12.710 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPirKXeRqo4uJZOkJfvc289BvViUnMH0ZRc'], u'uuids': [u'90207315-9fbf-4f55-a301-2e40c94462f5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.141308", "end": "2019-12-16 22:40:12.727971", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPirKXeRqo4uJZOkJfvc289BvViUnMH0ZRc"], "labels": [], "masters": [], "uuids": ["90207315-9fbf-4f55-a301-2e40c94462f5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:11.586663", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:13.051 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbnggU7dG7V6xa1QOPbep75gf2Cmi9z3a0GI'], u'uuids': [u'8cb78384-38ac-4356-bf7f-da6422e9d7ce']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.120671", "end": "2019-12-16 22:40:13.054417", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbnggU7dG7V6xa1QOPbep75gf2Cmi9z3a0GI"], "labels": [], "masters": [], "uuids": ["8cb78384-38ac-4356-bf7f-da6422e9d7ce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:11.933746", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:14.001 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi59ZDd13sIBn0zOS2TeXxLbu2j9fC7hvW'], u'uuids': [u'90ee0c5f-7ca9-4bf0-be64-b714d09c1fe2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.150152", "end": "2019-12-16 22:40:14.010679", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi59ZDd13sIBn0zOS2TeXxLbu2j9fC7hvW"], "labels": [], "masters": [], "uuids": ["90ee0c5f-7ca9-4bf0-be64-b714d09c1fe2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:12.860527", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:14.326 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngUbCb3C0peuht1R1YS7J2TpDvJW2YziJ1'], u'uuids': [u'd0fd65c0-75e9-42cc-a825-8fe3c4a52f87']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.138549", "end": "2019-12-16 22:40:14.321746", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngUbCb3C0peuht1R1YS7J2TpDvJW2YziJ1"], "labels": [], "masters": [], "uuids": ["d0fd65c0-75e9-42cc-a825-8fe3c4a52f87"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:13.183197", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:15.255 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiLGEOgxECnFvaRGMPY2bOhsBzRVQSpm0V'], u'uuids': [u'fedd1da3-d7d3-4358-8cc6-efbd4313c9f4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.103111", "end": "2019-12-16 22:40:15.260350", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiLGEOgxECnFvaRGMPY2bOhsBzRVQSpm0V"], "labels": [], "masters": [], "uuids": ["fedd1da3-d7d3-4358-8cc6-efbd4313c9f4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:14.157239", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:15.603 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngoHxgBVbYD6OTaaJVDq1lYPA1wrphaAZ0'], u'uuids': [u'e62c3ef3-9523-479a-8903-fe3b87cb7804']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.139930", "end": "2019-12-16 22:40:15.597635", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngoHxgBVbYD6OTaaJVDq1lYPA1wrphaAZ0"], "labels": [], "masters": [], "uuids": ["e62c3ef3-9523-479a-8903-fe3b87cb7804"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:14.457705", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:16.501 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi0YGAQvz1mjFwAdw7vOfgVybohCRIflEE'], u'uuids': [u'9f2deae2-8cdb-4b26-96b4-cd95c66d8d89']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.121000", "end": "2019-12-16 22:40:16.511045", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi0YGAQvz1mjFwAdw7vOfgVybohCRIflEE"], "labels": [], "masters": [], "uuids": ["9f2deae2-8cdb-4b26-96b4-cd95c66d8d89"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:15.390045", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:16.867 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbng4MKUeCEIxrV1B3tUNQtvQhpfdfPWVwAf'], u'uuids': [u'09c7fdd7-69c3-41c7-838f-f7492a568d20']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.150288", "end": "2019-12-16 22:40:16.874009", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbng4MKUeCEIxrV1B3tUNQtvQhpfdfPWVwAf"], "labels": [], "masters": [], "uuids": ["09c7fdd7-69c3-41c7-838f-f7492a568d20"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:15.723721", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:16.940 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:16 +0000 (0:00:07.574) 0:02:03.328 ******* 2019-12-16T22:40:16.995 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-16T22:40:16.997 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNXN', u'wwn-0x5000c5009294113e'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XNXN', u'wwn': u'0x5000c5009294113e', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XNXN-part1', u'wwn-0x5000c5009294113e-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNXN", "wwn-0x5000c5009294113e"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNXN-part1", "wwn-0x5000c5009294113e-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNXN", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2019-12-16T22:40:16.999 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c5009294113e"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.000 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.013 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.036 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.049 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.051 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.063 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.076 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.089 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.286 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-muqx70-9H6n-w991-VT8u-lfMf-ABXI-RJUxY2', u'nvme-INTEL_SSDPEDMD400G4_CVFT6233007S400BGN', u'nvme-nvme.8086-43564654363233333030375334303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.061887", "end": "2019-12-16 22:40:17.289938", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-muqx70-9H6n-w991-VT8u-lfMf-ABXI-RJUxY2", "nvme-INTEL_SSDPEDMD400G4_CVFT6233007S400BGN", "nvme-nvme.8086-43564654363233333030375334303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:17.228051", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2019-12-16T22:40:17.288 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0410848 s, 2.8 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0410848 s, 2.8 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:17.565 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngvyCbCV6JTGAhLdoKXUnXMU1bPO0eYp0q'], u'uuids': [u'1037513d-4742-4d35-9642-3e97de85f204']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.149878", "end": "2019-12-16 22:40:17.570167", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngvyCbCV6JTGAhLdoKXUnXMU1bPO0eYp0q"], "labels": [], "masters": [], "uuids": ["1037513d-4742-4d35-9642-3e97de85f204"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:17.420289", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.147065 s, 784 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.147065 s, 784 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:17.759 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-16T22:40:17.760 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiITSLaQ2kPNzxN7vRW0UuO8eKmdFSHCI2'], u'uuids': [u'5eecf783-8506-4c12-9089-4944629cc997']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.118556", "end": "2019-12-16 22:40:17.777632", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiITSLaQ2kPNzxN7vRW0UuO8eKmdFSHCI2"], "labels": [], "masters": [], "uuids": ["5eecf783-8506-4c12-9089-4944629cc997"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:16.659076", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-16T22:40:17.826 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:17 +0000 (0:00:00.885) 0:02:04.214 ******* 2019-12-16T22:40:17.865 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-16T22:40:17.867 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbnggU7dG7V6xa1QOPbep75gf2Cmi9z3a0GI'], u'uuids': [u'8cb78384-38ac-4356-bf7f-da6422e9d7ce']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.151928", "end": "2019-12-16 22:40:17.849443", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbnggU7dG7V6xa1QOPbep75gf2Cmi9z3a0GI"], "labels": [], "masters": [], "uuids": ["8cb78384-38ac-4356-bf7f-da6422e9d7ce"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:17.697515", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.148842 s, 775 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.148842 s, 775 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:17.891 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QHPJ', u'wwn-0x5000c50091e1aea6'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QHPJ', u'wwn': u'0x5000c50091e1aea6', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'cfq', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1', u'wwn-0x5000c50091e1aea6-part1'], u'uuids': [u'831992a6-90a2-4452-b219-e8f28acb0e82']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ", "wwn-0x5000c50091e1aea6"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QHPJ-part1", "wwn-0x5000c50091e1aea6-part1"], "labels": [], "masters": [], "uuids": ["831992a6-90a2-4452-b219-e8f28acb0e82"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "cfq", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QHPJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "vir 2019-12-16T22:40:17.892 INFO:teuthology.task.ansible.out:tual": 1, "wwn": "0x5000c50091e1aea6"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.905 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.907 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.920 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.932 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.945 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.947 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.958 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:17.960 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:17.971 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [], u'uuids': []}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'0', u'model': None, u'size': u'0.00 Bytes', u'scheduler_mode': u'none', u'rotational': u'1', u'sectors': u'0', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'loop4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:18.172 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-SUec7s-zlu8-qgUf-fJnE-aK7R-TwCf-GoKYPF', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN', u'nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.058626", "end": "2019-12-16 22:40:18.187781", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-SUec7s-zlu8-qgUf-fJnE-aK7R-TwCf-GoKYPF", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013R400BGN", "nvme-nvme.8086-50484654363230343031335234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:18.129155", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2019-12-16T22:40:18.174 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0381061 s, 3.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0381061 s, 3.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:18.183 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngUbCb3C0peuht1R1YS7J2TpDvJW2YziJ1'], u'uuids': [u'd0fd65c0-75e9-42cc-a825-8fe3c4a52f87']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.158341", "end": "2019-12-16 22:40:18.186320", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngUbCb3C0peuht1R1YS7J2TpDvJW2YziJ1"], "labels": [], "masters": [], "uuids": ["d0fd65c0-75e9-42cc-a825-8fe3c4a52f87"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:18.027979", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153396 s, 752 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153396 s, 752 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:18.484 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngoHxgBVbYD6OTaaJVDq1lYPA1wrphaAZ0'], u'uuids': [u'e62c3ef3-9523-479a-8903-fe3b87cb7804']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.158442", "end": "2019-12-16 22:40:18.473041", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbngoHxgBVbYD6OTaaJVDq1lYPA1wrphaAZ0"], "labels": [], "masters": [], "uuids": ["e62c3ef3-9523-479a-8903-fe3b87 2019-12-16T22:40:18.486 INFO:teuthology.task.ansible.out:cb7804"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:18.314599", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153722 s, 750 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153722 s, 750 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:18.513 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPirKXeRqo4uJZOkJfvc289BvViUnMH0ZRc'], u'uuids': [u'90207315-9fbf-4f55-a301-2e40c94462f5']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.161568", "end": "2019-12-16 22:40:18.518522", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPirKXeRqo4uJZOkJfvc289BvViUnMH0ZRc"], "labels": [], "masters": [], "uuids": ["90207315-9fbf-4f55-a301-2e40c94462f5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:18.356954", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158496 s, 728 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158496 s, 728 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:18.763 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbng4MKUeCEIxrV1B3tUNQtvQhpfdfPWVwAf'], u'uuids': [u'09c7fdd7-69c3-41c7-838f-f7492a568d20']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.154582", "end": "2019-12-16 22:40:18.770937", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-sVfq3VajagQKzKOXw5kU47MNJMQKtbng4MKUeCEIxrV1B3tUNQtvQhpfdfPWVwAf"], "labels": [], "masters": [], "uuids": ["09c7fdd7-69c3-41c7-838f-f7492a568d20"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:18.616355", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.15157 s, 761 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.15157 s, 761 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:18.793 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi59ZDd13sIBn0zOS2TeXxLbu2j9fC7hvW'], u'uuids': [u'90ee0c5f-7ca9-4bf0-be64-b714d09c1fe2']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.158052", "end": "2019-12-16 22:40:18.806635", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi59ZDd13sIBn0zOS2TeXxLbu2j9fC7hvW"], "labels": [], "masters": [], "uuids": ["90ee0c5f-7ca9-4bf0-be64-b714d09c1fe2"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:18.648583", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153229 s, 753 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153229 s, 753 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:18.845 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:18 +0000 (0:00:01.017) 0:02:05.231 ******* 2019-12-16T22:40:19.079 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiLGEOgxECnFvaRGMPY2bOhsBzRVQSpm0V'], u'uuids': [u'fedd1da3-d7d3-4358-8cc6-efbd4313c9f4']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.160824", "end": "2019-12-16 22:40:19.090030", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiLGEOgxECnFvaRGMPY2bOhsBzRVQSpm0V"], "labels": [], "masters": [], "uuids": ["fedd1da3-d7d3-4358-8cc6-efbd4313c9f4"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:18.929206", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156441 s, 737 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156441 s, 737 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:19.134 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-16T22:40:19.135 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.144942", "end": "2019-12-16 22:40:19.136580", "rc": 0, "start": "2019-12-16 22:40:18.991638", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:19.183 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.338) 0:02:05.570 ******* 2019-12-16T22:40:19.357 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-16T22:40:19.358 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi0YGAQvz1mjFwAdw7vOfgVybohCRIflEE'], u'uuids': [u'9f2deae2-8cdb-4b26-96b4-cd95c66d8d89']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.157742", "end": "2019-12-16 22:40:19.375740", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPi0YGAQvz1mjFwAdw7vOfgVybohCRIflEE"], "labels": [], "masters": [], "uuids": ["9f2deae2-8cdb-4b26-96b4-cd95c66d8d89"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:19.217998", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153062 s, 754 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153062 s, 754 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:19.370 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-16T22:40:19.372 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.047627", "end": "2019-12-16 22:40:19.374832", "rc": 0, "start": "2019-12-16 22:40:19.327205", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:19.419 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.231) 0:02:05.802 ******* 2019-12-16T22:40:19.443 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-16T22:40:19.496 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.081) 0:02:05.884 ******* 2019-12-16T22:40:19.525 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-16T22:40:19.525 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:19.573 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.076) 0:02:05.961 ******* 2019-12-16T22:40:19.601 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-16T22:40:19.603 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:19.652 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.079) 0:02:06.040 ******* 2019-12-16T22:40:19.661 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-16T22:40:19.663 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiITSLaQ2kPNzxN7vRW0UuO8eKmdFSHCI2'], u'uuids': [u'5eecf783-8506-4c12-9089-4944629cc997']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.154124", "end": "2019-12-16 22:40:19.652657", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gWxKifaMNBQ0JWhAPuYaZROrpooUmRPiITSLaQ2kPNzxN7vRW0UuO8eKmdFSHCI2"], "labels": [], "masters": [], "uuids": ["5eecf783-8506-4c12-9089-4944629cc997"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-16 22:40:19.498533", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.149648 s, 771 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.149648 s, 771 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:19.721 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.068) 0:02:06.109 ******* 2019-12-16T22:40:19.727 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-16T22:40:19.729 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:19.788 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.066) 0:02:06.175 ******* 2019-12-16T22:40:19.821 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:19.859 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:19 +0000 (0:00:00.071) 0:02:06.247 ******* 2019-12-16T22:40:19.971 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-16T22:40:19.972 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.114250", "end": "2019-12-16 22:40:19.984996", "rc": 0, "start": "2019-12-16 22:40:19.870746", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:20.018 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.159) 0:02:06.406 ******* 2019-12-16T22:40:20.029 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-16T22:40:20.030 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:40:20.092 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.073) 0:02:06.480 ******* 2019-12-16T22:40:20.151 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-16T22:40:20.152 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={u'block_used': 13608075, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226487033, u'size_available': 927690887168, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60941454, u'device': u'/dev/sda1', u'inode_used': 113522, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226487033, "block_size": 4096, "block_total": 240095108, "block_used": 13608075, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941454, "inode_total": 61054976, "inode_used": 113522, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927690887168, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.195 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.102) 0:02:06.583 ******* 2019-12-16T22:40:20.226 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.068231", "end": "2019-12-16 22:40:20.244529", "rc": 0, "start": "2019-12-16 22:40:20.176298", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:20.228 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.272 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.076) 0:02:06.659 ******* 2019-12-16T22:40:20.314 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.042) 0:02:06.702 ******* 2019-12-16T22:40:20.320 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-16T22:40:20.370 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.056) 0:02:06.758 ******* 2019-12-16T22:40:20.377 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.420 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.049) 0:02:06.808 ******* 2019-12-16T22:40:20.426 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-16T22:40:20.428 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.472 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.052) 0:02:06.860 ******* 2019-12-16T22:40:20.479 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-16T22:40:20.481 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.527 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.049) 0:02:06.910 ******* 2019-12-16T22:40:20.531 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.569 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.047) 0:02:06.957 ******* 2019-12-16T22:40:20.580 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.616 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.047) 0:02:07.004 ******* 2019-12-16T22:40:20.623 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.680 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.063) 0:02:07.068 ******* 2019-12-16T22:40:20.686 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-16T22:40:20.688 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.745 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.065) 0:02:07.133 ******* 2019-12-16T22:40:20.751 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-16T22:40:20.752 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.800 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.055) 0:02:07.188 ******* 2019-12-16T22:40:20.807 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-16T22:40:20.808 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:20.856 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.050) 0:02:07.239 ******* 2019-12-16T22:40:20.945 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-16T22:40:20.945 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-16T22:40:20.987 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:20 +0000 (0:00:00.136) 0:02:07.375 ******* 2019-12-16T22:40:21.037 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-16T22:40:21.039 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={u'block_used': 13608062, u'uuid': u'831992a6-90a2-4452-b219-e8f28acb0e82', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 226487046, u'size_available': 927690940416, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60941454, u'device': u'/dev/sda1', u'inode_used': 113522, u'block_size': 4096, u'options': u'rw,relatime,errors=remount-ro,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226487046, "block_size": 4096, "block_total": 240095108, "block_used": 13608062, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60941454, "inode_total": 61054976, "inode_used": 113522, "mount": "/", "options": "rw,relatime,errors=remount-ro,data=ordered", "size_available": 927690940416, "size_total": 983429562368, "uuid": "831992a6-90a2-4452-b219-e8f28acb0e82"}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:21.087 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.099) 0:02:07.474 ******* 2019-12-16T22:40:21.117 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:21.180 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.093) 0:02:07.568 ******* 2019-12-16T22:40:21.222 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-16T22:40:21.224 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:21.264 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.084) 0:02:07.652 ******* 2019-12-16T22:40:21.302 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:21.360 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.095) 0:02:07.748 ******* 2019-12-16T22:40:21.387 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-16T22:40:21.388 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:21.429 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.068) 0:02:07.817 ******* 2019-12-16T22:40:21.456 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-16T22:40:21.458 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:21.500 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.068) 0:02:07.885 ******* 2019-12-16T22:40:21.535 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-16T22:40:21.536 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:21.537 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-16T22:40:21.537 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-16T22:40:21.591 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.093) 0:02:07.978 ******* 2019-12-16T22:40:21.638 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.042) 0:02:08.021 ******* 2019-12-16T22:40:21.936 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-16T22:40:21.984 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:21 +0000 (0:00:00.350) 0:02:08.372 ******* 2019-12-16T22:40:22.213 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-16T22:40:22.215 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:22.283 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:22.465 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:22.520 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:22.722 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:22.756 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:22.988 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:22.999 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:23.250 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:23.298 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:23 +0000 (0:00:01.307) 0:02:09.679 ******* 2019-12-16T22:40:23.299 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-16T22:40:23.347 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:23 +0000 (0:00:00.056) 0:02:09.735 ******* 2019-12-16T22:40:23.428 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-16T22:40:23.430 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-16T22:40:23.478 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:23 +0000 (0:00:00.130) 0:02:09.866 ******* 2019-12-16T22:40:23.498 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-16T22:40:23.555 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:23 +0000 (0:00:00.077) 0:02:09.943 ******* 2019-12-16T22:40:23.562 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-16T22:40:23.563 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:23.598 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:23.663 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:23.665 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:23.737 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:23.795 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:23.863 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:23.940 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:23.997 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:24.083 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:24.145 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:24 +0000 (0:00:00.589) 0:02:10.533 ******* 2019-12-16T22:40:24.153 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-16T22:40:24.205 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:24 +0000 (0:00:00.060) 0:02:10.593 ******* 2019-12-16T22:40:24.297 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-16T22:40:24.299 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2019-12-16T22:40:24.347 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:24 +0000 (0:00:00.141) 0:02:10.735 ******* 2019-12-16T22:40:24.368 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2019-12-16T22:40:24.425 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:24 +0000 (0:00:00.077) 0:02:10.812 ******* 2019-12-16T22:40:24.432 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-16T22:40:24.432 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-16T22:40:24.496 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:24 +0000 (0:00:00.071) 0:02:10.884 ******* 2019-12-16T22:40:24.503 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-16T22:40:24.551 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:24 +0000 (0:00:00.055) 0:02:10.939 ******* 2019-12-16T22:40:25.006 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi106.front.sepia.ceph.com] => {"changed": true} 2019-12-16T22:40:25.061 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:25 +0000 (0:00:00.509) 0:02:11.449 ******* 2019-12-16T22:40:25.068 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true} 2019-12-16T22:40:25.128 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:25 +0000 (0:00:00.064) 0:02:11.514 ******* 2019-12-16T22:40:25.575 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-16T22:40:25.577 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-16T22:40:25.618 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:25 +0000 (0:00:00.491) 0:02:12.005 ******* 2019-12-16T22:40:25.668 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:25 +0000 (0:00:00.045) 0:02:12.051 ******* 2019-12-16T22:40:25.791 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-16T22:40:25.792 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2019-12-16T22:40:25.848 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:25 +0000 (0:00:00.185) 0:02:12.236 ******* 2019-12-16T22:40:25.864 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2019-12-16T22:40:25.926 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:25 +0000 (0:00:00.076) 0:02:12.313 ******* 2019-12-16T22:40:25.997 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-16T22:40:25.998 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2019-12-16T22:40:26.041 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:26 +0000 (0:00:00.115) 0:02:12.429 ******* 2019-12-16T22:40:26.059 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2019-12-16T22:40:26.103 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:26 +0000 (0:00:00.062) 0:02:12.491 ******* 2019-12-16T22:40:26.429 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-16T22:40:26.430 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2019-12-16T22:40:26.479 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:26 +0000 (0:00:00.369) 0:02:12.861 ******* 2019-12-16T22:40:26.481 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1205, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2019-12-16T22:40:26.534 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:26 +0000 (0:00:00.060) 0:02:12.921 ******* 2019-12-16T22:40:26.851 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2019-12-16T22:40:26.908 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:26 +0000 (0:00:00.369) 0:02:13.291 ******* 2019-12-16T22:40:26.943 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2019-12-16T22:40:26.998 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:26 +0000 (0:00:00.095) 0:02:13.386 ******* 2019-12-16T22:40:27.782 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:40:27.825 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:27 +0000 (0:00:00.826) 0:02:14.213 ******* 2019-12-16T22:40:27.909 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:40:27.955 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:27 +0000 (0:00:00.130) 0:02:14.343 ******* 2019-12-16T22:40:28.035 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-16T22:40:28.036 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.045729", "end": "2019-12-16 22:40:28.046772", "rc": 0, "start": "2019-12-16 22:40:28.001043", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2019-12-16T22:40:28.099 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:28 +0000 (0:00:00.142) 0:02:14.485 ******* 2019-12-16T22:40:28.135 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-16T22:40:28.137 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.046259", "end": "2019-12-16 22:40:28.152307", "rc": 0, "start": "2019-12-16 22:40:28.106048", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.26.1/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.26.1/Amazon/S3.pm"]} 2019-12-16T22:40:28.189 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:28 +0000 (0:00:00.092) 0:02:14.577 ******* 2019-12-16T22:40:28.236 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:28 +0000 (0:00:00.046) 0:02:14.624 ******* 2019-12-16T22:40:28.243 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-16T22:40:28.244 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:28.295 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:28 +0000 (0:00:00.052) 0:02:14.677 ******* TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-16T22:40:28.296 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:28.342 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:28 +0000 (0:00:00.051) 0:02:14.729 ******* 2019-12-16T22:40:28.402 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-16T22:40:28.404 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:28.452 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:28 +0000 (0:00:00.110) 0:02:14.839 ******* 2019-12-16T22:40:28.453 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:29.204 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-16T22:40:29.205 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:40:29.258 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.806) 0:02:15.646 ******* 2019-12-16T22:40:29.285 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:29.336 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.078) 0:02:15.724 ******* 2019-12-16T22:40:29.342 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-16T22:40:29.343 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:40:29.390 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.053) 0:02:15.778 ******* 2019-12-16T22:40:29.421 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:29.463 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.073) 0:02:15.851 ******* 2019-12-16T22:40:29.697 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2019-12-16T22:40:29.749 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.286) 0:02:16.137 ******* 2019-12-16T22:40:29.779 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-16T22:40:29.780 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:29.820 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.069) 0:02:16.207 ******* 2019-12-16T22:40:29.860 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-16T22:40:29.861 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2019-12-16T22:40:29.919 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.099) 0:02:16.307 ******* 2019-12-16T22:40:29.946 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-16T22:40:29.947 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:29.989 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:29 +0000 (0:00:00.069) 0:02:16.377 ******* 2019-12-16T22:40:30.038 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-16T22:40:30.041 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-16 22:37:34 UTC", "ActiveEnterTimestampMonotonic": "25317739", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target network.target system.slice systemd-tmpfiles-setup.service systemd-journald.socket basic.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-16 22:37:25 UTC", "AssertTimestampMonotonic": "17244077", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-16 22:37:25 UTC", "ConditionTimestampMonotonic": "17244077", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2019-12-16T22:40:30.043 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2039", "ExecMainStartTimestamp": "Mon 2019-12-16 22:37:34 UTC", "ExecMainStartTimestampMonotonic": "25317726", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-16 22:37:25 UTC", "InactiveExitTimestampMonotonic": "17244759", "InvocationID": "1640e9cf2dc347ffa524927efbaccee3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128033", "LimitNPROCSoft": "128033", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2019-12-16T22:40:30.044 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128033", "LimitSIGPENDINGSoft": "128033", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2039", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-12-16 22:37:34 UTC", "StateChangeTimestampMonoton 2019-12-16T22:40:30.046 INFO:teuthology.task.ansible.out:ic": "25317739", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2019-12-16 22:37:34 UTC", "WatchdogTimestampMonotonic": "25317738", "WatchdogUSec": "0"}} 2019-12-16T22:40:30.086 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:30 +0000 (0:00:00.094) 0:02:16.472 ******* 2019-12-16T22:40:30.119 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-16T22:40:30.120 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:30.160 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:30 +0000 (0:00:00.076) 0:02:16.548 ******* 2019-12-16T22:40:30.208 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-16T22:40:30.210 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2019-12-16 22:37:02 UTC", "ActiveEnterTimestampMonotonic": "25597846", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service sysinit.target systemd-journald.socket network.target basic.target -.mount system.slice", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2019-12-16 22:36:53 UTC", "AssertTimestampMonotonic": "17236074", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2019-12-16 22:36:53 UTC", "ConditionTimestampMonotonic": "17236074", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documen 2019-12-16T22:40:30.212 INFO:teuthology.task.ansible.out:tation": "man:ntpd(8)", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1993", "ExecMainStartTimestamp": "Mon 2019-12-16 22:37:02 UTC", "ExecMainStartTimestampMonotonic": "25597833", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2019-12-16 22:36:53 UTC", "InactiveExitTimestampMonotonic": "17236819", "InvocationID": "4a1db023236744c89784156ba874c901", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "128031", "LimitNPROCSoft": "128031", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "Limi 2019-12-16T22:40:30.214 INFO:teuthology.task.ansible.out:tRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "128031", "LimitSIGPENDINGSoft": "128031", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1993", "MemoryAccounting": "no", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2019-12-16 22:37:02 UTC", "StateChangeTimestampMonoton 2019-12-16T22:40:30.215 INFO:teuthology.task.ansible.out:ic": "25597846", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "4915", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Mon 2019-12-16 22:37:02 UTC", "WatchdogTimestampMonotonic": "25597845", "WatchdogUSec": "0"}} 2019-12-16T22:40:30.256 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:30 +0000 (0:00:00.095) 0:02:16.644 ******* 2019-12-16T22:40:30.310 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-16T22:40:30.312 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:30.355 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:30 +0000 (0:00:00.099) 0:02:16.743 ******* 2019-12-16T22:40:31.095 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-16T22:40:31.096 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"cache_update_time": 1576535881, "cache_updated": false, "changed": false} 2019-12-16T22:40:31.167 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:31 +0000 (0:00:00.811) 0:02:17.555 ******* 2019-12-16T22:40:31.197 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"cache_update_time": 1576535885, "cache_updated": false, "changed": false} 2019-12-16T22:40:31.200 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-16T22:40:31.202 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:31.249 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:31 +0000 (0:00:00.081) 0:02:17.637 ******* 2019-12-16T22:40:31.291 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:31 +0000 (0:00:00.041) 0:02:17.678 ******* 2019-12-16T22:40:31.329 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:31.377 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:31 +0000 (0:00:00.087) 0:02:17.765 ******* 2019-12-16T22:40:31.395 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2019-12-16T22:40:31.439 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:31 +0000 (0:00:00.061) 0:02:17.827 ******* 2019-12-16T22:40:31.528 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2019-12-16T22:40:31.568 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:31 +0000 (0:00:00.128) 0:02:17.956 ******* 2019-12-16T22:40:31.985 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-16T22:40:31.986 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2019-12-16T22:40:32.034 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:32 +0000 (0:00:00.465) 0:02:18.422 ******* 2019-12-16T22:40:32.193 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1205, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2019-12-16T22:40:32.244 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:32 +0000 (0:00:00.209) 0:02:18.632 ******* 2019-12-16T22:40:33.128 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-16T22:40:33.129 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-16T22:40:33.137 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages\nRequirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python2.7/dist-packages", "Requirement already satisfied: execnet in /usr/local/lib/python2.7/dist-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python2.7/dist-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-16T22:40:33.179 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:33 +0000 (0:00:00.934) 0:02:19.566 ******* 2019-12-16T22:40:33.223 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:33 +0000 (0:00:00.044) 0:02:19.611 ******* 2019-12-16T22:40:33.691 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-16T22:40:33.692 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false} 2019-12-16T22:40:33.743 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:33 +0000 (0:00:00.520) 0:02:20.131 ******* 2019-12-16T22:40:33.752 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false} 2019-12-16T22:40:33.822 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:33 +0000 (0:00:00.078) 0:02:20.210 ******* 2019-12-16T22:40:33.829 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-16T22:40:33.876 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:33 +0000 (0:00:00.053) 0:02:20.264 ******* 2019-12-16T22:40:33.889 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-16T22:40:33.931 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:33 +0000 (0:00:00.054) 0:02:20.318 ******* 2019-12-16T22:40:34.053 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-16T22:40:34.054 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1576535868.5737755, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1576535867.0945156, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1576535867.0945156, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2019-12-16T22:40:34.097 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.166) 0:02:20.485 ******* 2019-12-16T22:40:34.106 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1576535836.49048, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1576535835.0457582, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 107167, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1576535835.0457582, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "4209737475", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2019-12-16T22:40:34.151 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.049) 0:02:20.535 ******* 2019-12-16T22:40:34.533 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-16T22:40:34.534 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"changed": false, "msg": ""} ok: [smithi177.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2019-12-16T22:40:34.584 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.434) 0:02:20.969 ******* 2019-12-16T22:40:34.622 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.040) 0:02:21.010 ******* 2019-12-16T22:40:34.626 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-16T22:40:34.627 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-16T22:40:34.674 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.052) 0:02:21.062 ******* 2019-12-16T22:40:34.681 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-16T22:40:34.722 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.048) 0:02:21.110 ******* 2019-12-16T22:40:34.727 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-16T22:40:34.728 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:34.771 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.048) 0:02:21.159 ******* 2019-12-16T22:40:34.777 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:34.824 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.052) 0:02:21.211 ******* 2019-12-16T22:40:34.904 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-16T22:40:34.905 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-16T22:40:34.959 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:34 +0000 (0:00:00.135) 0:02:21.347 ******* 2019-12-16T22:40:34.968 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-16T22:40:35.017 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.057) 0:02:21.405 ******* 2019-12-16T22:40:35.086 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-16T22:40:35.093 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-16T22:40:35.135 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.117) 0:02:21.523 ******* 2019-12-16T22:40:35.152 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-16T22:40:35.193 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.058) 0:02:21.581 ******* 2019-12-16T22:40:35.198 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-16T22:40:35.199 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.242 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.048) 0:02:21.630 ******* 2019-12-16T22:40:35.249 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.294 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.052) 0:02:21.682 ******* 2019-12-16T22:40:35.300 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-16T22:40:35.300 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.302 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.303 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.305 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.305 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.352 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.057) 0:02:21.740 ******* 2019-12-16T22:40:35.358 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.359 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.360 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi177.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.362 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.409 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.056) 0:02:21.797 ******* 2019-12-16T22:40:35.415 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-16T22:40:35.417 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.418 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.418 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.420 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.421 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.475 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.066) 0:02:21.863 ******* 2019-12-16T22:40:35.484 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.486 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.488 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.489 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.490 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.535 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.059) 0:02:21.922 ******* 2019-12-16T22:40:35.540 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-16T22:40:35.540 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.603 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.068) 0:02:21.991 ******* 2019-12-16T22:40:35.611 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.655 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.052) 0:02:22.043 ******* 2019-12-16T22:40:35.661 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-16T22:40:35.663 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.706 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.050) 0:02:22.093 ******* 2019-12-16T22:40:35.712 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.758 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.051) 0:02:22.145 ******* 2019-12-16T22:40:35.762 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-16T22:40:35.763 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.812 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.055) 0:02:22.200 ******* 2019-12-16T22:40:35.819 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.871 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.054) 0:02:22.255 ******* 2019-12-16T22:40:35.875 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-16T22:40:35.876 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.919 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.051) 0:02:22.307 ******* 2019-12-16T22:40:35.929 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:35.974 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:35 +0000 (0:00:00.054) 0:02:22.361 ******* 2019-12-16T22:40:35.979 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-16T22:40:35.979 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.024 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.050) 0:02:22.412 ******* 2019-12-16T22:40:36.030 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.075 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.049) 0:02:22.461 ******* 2019-12-16T22:40:36.079 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-16T22:40:36.080 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.123 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.049) 0:02:22.511 ******* 2019-12-16T22:40:36.129 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.173 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.049) 0:02:22.561 ******* 2019-12-16T22:40:36.178 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-16T22:40:36.180 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.221 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.048) 0:02:22.609 ******* 2019-12-16T22:40:36.227 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.270 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.048) 0:02:22.658 ******* 2019-12-16T22:40:36.275 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-16T22:40:36.276 INFO:teuthology.task.ansible.out:skipping: [smithi106.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.315 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.045) 0:02:22.703 ******* 2019-12-16T22:40:36.322 INFO:teuthology.task.ansible.out:skipping: [smithi177.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-16T22:40:36.363 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:36 +0000 (0:00:00.047) 0:02:22.751 ******* 2019-12-16T22:40:36.527 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-16T22:40:36.529 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011016", "end": "2019-12-16 22:40:36.488307", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-16 22:40:36.477291", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:36.560 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011261", "end": "2019-12-16 22:40:36.559589", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-16 22:40:36.548328", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:36.561 INFO:teuthology.task.ansible.out: 2019-12-16T22:40:36.671 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006001", "end": "2019-12-16 22:40:36.668033", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-16 22:40:36.662032", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:36.689 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006086", "end": "2019-12-16 22:40:36.699947", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-16 22:40:36.693861", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:36.823 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005407", "end": "2019-12-16 22:40:36.811538", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-16 22:40:36.806131", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:36.846 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005666", "end": "2019-12-16 22:40:36.845941", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-16 22:40:36.840275", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:36.962 INFO:teuthology.task.ansible.out:ok: [smithi106.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.023108", "end": "2019-12-16 22:40:36.959994", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-16 22:40:36.936886", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:37.009 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:37 +0000 (0:00:00.646) 0:02:23.397 ******* 2019-12-16T22:40:37.037 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-16T22:40:37.113 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:37 +0000 (0:00:00.098) 0:02:23.496 ******* 2019-12-16T22:40:37.139 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-16T22:40:37.140 INFO:teuthology.task.ansible.out:ok: [smithi177.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.150693", "end": "2019-12-16 22:40:37.126821", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-16 22:40:36.976128", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-16T22:40:37.187 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:37 +0000 (0:00:00.078) 0:02:23.574 ******* 2019-12-16T22:40:37.216 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-16T22:40:37.259 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:37 +0000 (0:00:00.072) 0:02:23.647 ******* 2019-12-16T22:40:37.266 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-16T22:40:37.268 INFO:teuthology.task.ansible.out:changed: [smithi106.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2019-12-16T22:40:37.397 INFO:teuthology.task.ansible.out:changed: [smithi177.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2019-12-16T22:40:37.519 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** 2019-12-16T22:40:37.521 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2019-12-16T22:40:37.521 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-16T22:40:37.524 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2019-12-16T22:40:37.524 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi106.front.sepia.ceph.com : ok=113 changed=30 unreachable=0 failed=0 skipped=169 rescued=0 ignored=0 smithi177.front.sepia.ceph.com : ok=113 changed=30 unreachable=0 failed=0 skipped=169 rescued=0 ignored=0 2019-12-16T22:40:37.525 INFO:teuthology.task.ansible.out:Monday 16 December 2019 22:40:37 +0000 (0:00:00.265) 0:02:23.912 ******* =============================================================================== 2019-12-16T22:40:37.526 INFO:teuthology.task.ansible.out:users : Create all admin users with sudo access. ----------------------- 16.07s users : Update authorized_keys using the keys repo --------------------- 15.35s testnode : Ensure packages are not present. ----------------------------- 9.11s testnode : Install packages --------------------------------------------- 8.33s testnode : Zap all non-root disks --------------------------------------- 7.58s users : Remove revoked users -------------------------------------------- 4.87s Gathering Facts --------------------------------------------------------- 2.82s testnode : Update apt cache. -------------------------------------------- 1.77s ansible-managed : Add authorized keys for the ansible user. ------------- 1.54s testnode : Create logical volume(s) ------------------------------------- 1.31s common : Set the hardware clock ----------------------------------------- 1.20s common : Update apt cache ----------------------------------------------- 1.09s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.07s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.02s testnode : Install apt keys --------------------------------------------- 0.96s testnode : Install packages via pip ------------------------------------- 0.93s users : Update authorized_keys for each user with literal keys ---------- 0.85s testnode : Ensure perl-doc is installed on apt systems. ----------------- 0.83s testnode : Install python-pip on apt based systems. --------------------- 0.81s testnode : Install ntp package on apt based systems. -------------------- 0.81s 2019-12-16T22:40:37.814 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi177.front.sepia.ceph.com')] 2019-12-16T22:40:37.816 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-16T22:40:37.817 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi106.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:40:37.898 INFO:teuthology.orchestra.run.smithi106:> true 2019-12-16T22:40:38.113 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-16T22:40:38.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi177.front.sepia.ceph.com', 'timeout': 60} 2019-12-16T22:40:38.253 INFO:teuthology.orchestra.run.smithi177:> true 2019-12-16T22:40:38.464 INFO:teuthology.run_tasks:Running task clock... 2019-12-16T22:40:38.476 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-16T22:40:38.477 INFO:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-16T22:40:38.531 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: ntpd 4.2.8p10@1.3728-o (1): Starting 2019-12-16T22:40:38.531 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Command line: ntpd -gq 2019-12-16T22:40:38.534 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: proto: precision = 0.064 usec (-24) 2019-12-16T22:40:38.534 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-16T22:40:38.535 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: restrict ::: KOD does nothing without LIMITED. 2019-12-16T22:40:38.535 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Listen and drop on 0 v6wildcard [::]:123 2019-12-16T22:40:38.535 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2019-12-16T22:40:38.535 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Listen normally on 2 lo 127.0.0.1:123 2019-12-16T22:40:38.535 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2019-12-16T22:40:38.536 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Listen normally on 4 lo [::1]:123 2019-12-16T22:40:38.537 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2019-12-16T22:40:38.537 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:38 ntpd[8826]: Listening on routing socket on fd #22 for interface updates 2019-12-16T22:40:38.537 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-16T22:40:38.537 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2019-12-16T22:40:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:41 ntpd[8826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:41 ntpd[8826]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:41 ntpd[8826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:41 ntpd[8826]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:43.534 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:43 ntpd[8826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:43.534 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:43 ntpd[8826]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:43.534 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:43 ntpd[8826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:43.534 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:43 ntpd[8826]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:45.535 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:45 ntpd[8826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:45.535 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:45 ntpd[8826]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:45.535 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:45 ntpd[8826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:45.535 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:45 ntpd[8826]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:47.536 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:47 ntpd[8826]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:47.536 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:47 ntpd[8826]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:47.537 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:47 ntpd[8826]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:47.537 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:47 ntpd[8826]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:47.537 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:47 ntpd[8826]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2019-12-16T22:40:47.537 INFO:teuthology.orchestra.run.smithi106.stderr:16 Dec 22:40:47 ntpd[8826]: can't open /var/log/ntpstats/loopstats.20191216: Permission denied 2019-12-16T22:40:47.537 INFO:teuthology.orchestra.run.smithi106.stdout:16 Dec 22:40:47 ntpd[8826]: ntpd: time set -0.029362 s 2019-12-16T22:40:47.537 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time set -0.029362s 2019-12-16T22:40:47.795 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2019-12-16T22:40:47.795 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2019-12-16T22:40:47.795 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:47.796 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:47.796 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:47.796 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:47.797 INFO:teuthology.orchestra.run.smithi177:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-16T22:40:47.854 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: ntpd 4.2.8p10@1.3728-o (1): Starting 2019-12-16T22:40:47.854 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Command line: ntpd -gq 2019-12-16T22:40:47.856 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: proto: precision = 0.120 usec (-23) 2019-12-16T22:40:47.856 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-16T22:40:47.856 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: restrict ::: KOD does nothing without LIMITED. 2019-12-16T22:40:47.856 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Listen and drop on 0 v6wildcard [::]:123 2019-12-16T22:40:47.856 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2019-12-16T22:40:47.856 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Listen normally on 2 lo 127.0.0.1:123 2019-12-16T22:40:47.856 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Listen normally on 3 enp3s0f1 172.21.15.177:123 2019-12-16T22:40:47.857 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Listen normally on 4 lo [::1]:123 2019-12-16T22:40:47.857 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feea:b04b%5]:123 2019-12-16T22:40:47.857 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:47 ntpd[8761]: Listening on routing socket on fd #22 for interface updates 2019-12-16T22:40:47.857 INFO:teuthology.orchestra.run.smithi177.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2019-12-16T22:40:47.857 INFO:teuthology.orchestra.run.smithi177.stderr:restrict ::: KOD does nothing without LIMITED. 2019-12-16T22:40:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:50 ntpd[8761]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:50 ntpd[8761]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:50 ntpd[8761]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:50.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:50 ntpd[8761]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:52.853 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:52 ntpd[8761]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:52.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:52 ntpd[8761]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:52.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:52 ntpd[8761]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:52.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:52 ntpd[8761]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:54.863 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:54 ntpd[8761]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:54.863 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:54 ntpd[8761]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:54.864 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:54 ntpd[8761]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:54.864 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:54 ntpd[8761]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:56.854 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:56 ntpd[8761]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2019-12-16T22:40:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:56 ntpd[8761]: can't open /var/log/ntpstats/rawstats.20191216: Permission denied 2019-12-16T22:40:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:56 ntpd[8761]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2019-12-16T22:40:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:56 ntpd[8761]: can't open /var/log/ntpstats/peerstats.20191216: Permission denied 2019-12-16T22:40:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:56 ntpd[8761]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2019-12-16T22:40:56.855 INFO:teuthology.orchestra.run.smithi177.stderr:16 Dec 22:40:56 ntpd[8761]: can't open /var/log/ntpstats/loopstats.20191216: Permission denied 2019-12-16T22:40:56.855 INFO:teuthology.orchestra.run.smithi177.stdout:16 Dec 22:40:56 ntpd[8761]: ntpd: time slew -0.000280 s 2019-12-16T22:40:56.856 INFO:teuthology.orchestra.run.smithi177.stdout:ntpd: time slew -0.000280s 2019-12-16T22:40:56.905 INFO:teuthology.orchestra.run.smithi177.stdout: remote refid st t when poll reach delay offset jitter 2019-12-16T22:40:56.905 INFO:teuthology.orchestra.run.smithi177.stdout:============================================================================== 2019-12-16T22:40:56.905 INFO:teuthology.orchestra.run.smithi177.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:56.905 INFO:teuthology.orchestra.run.smithi177.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:56.906 INFO:teuthology.orchestra.run.smithi177.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:56.906 INFO:teuthology.orchestra.run.smithi177.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-16T22:40:56.907 INFO:teuthology.run_tasks:Running task install... 2019-12-16T22:40:56.936 DEBUG:teuthology.task.install:project ceph 2019-12-16T22:40:56.936 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}} 2019-12-16T22:40:56.937 DEBUG:teuthology.task.install:config {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455', 'extra_packages': ['rbd-mirror']} 2019-12-16T22:40:56.937 INFO:teuthology.task.install:Using flavor: basic 2019-12-16T22:40:56.943 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'cephadm', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse']} 2019-12-16T22:40:56.943 INFO:teuthology.task.install:extra packages: ['rbd-mirror'] 2019-12-16T22:40:56.943 INFO:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2019-12-16T22:40:56.997 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2019-12-16T22:40:57.005 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-16T22:40:57.005 INFO:teuthology.orchestra.run.smithi177:> sudo lsb_release -is 2019-12-16T22:40:57.006 INFO:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2019-12-16T22:40:57.066 INFO:teuthology.orchestra.run.smithi177.stdout:Ubuntu 2019-12-16T22:40:57.067 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-16T22:40:57.067 INFO:teuthology.orchestra.run.smithi177:> sudo apt-key list | grep Ceph 2019-12-16T22:40:57.105 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2019-12-16T22:40:57.156 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2019-12-16T22:40:57.157 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2019-12-16T22:40:57.157 INFO:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2019-12-16T22:40:57.171 INFO:teuthology.orchestra.run.smithi177.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2019-12-16T22:40:57.206 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2019-12-16T22:40:57.211 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-16T22:40:57.212 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, rbd-mirror on remote deb x86_64 2019-12-16T22:40:57.212 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=8a58d0694cce968d9a21937d52c2e48cfe306455 2019-12-16T22:40:57.228 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2019-12-16T22:40:57.228 INFO:teuthology.orchestra.run.smithi177.stdout:uid [ unknown] Ceph.com (release key) 2019-12-16T22:40:57.229 INFO:teuthology.orchestra.run.smithi177:> sudo lsb_release -is 2019-12-16T22:40:57.281 INFO:teuthology.orchestra.run.smithi177.stdout:Ubuntu 2019-12-16T22:40:57.286 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-16T22:40:57.286 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, rbd-mirror on remote deb x86_64 2019-12-16T22:40:57.286 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=8a58d0694cce968d9a21937d52c2e48cfe306455 2019-12-16T22:40:57.370 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default/ 2019-12-16T22:40:57.371 INFO:teuthology.task.install.deb:Package version is 15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:40:57.462 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default/ 2019-12-16T22:40:57.463 INFO:teuthology.task.install.deb:Package version is 15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:40:57.517 INFO:teuthology.orchestra.run.smithi106:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2019-12-16T22:40:57.567 INFO:teuthology.orchestra.run.smithi106:> sudo apt-get update 2019-12-16T22:40:57.602 INFO:teuthology.orchestra.run.smithi177:> sudo sh -c 'cat > /etc/apt/sources.list.d/ceph.list' 2019-12-16T22:40:57.653 INFO:teuthology.orchestra.run.smithi177:> sudo apt-get update 2019-12-16T22:40:57.754 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://security.ubuntu.com/ubuntu bionic-security InRelease 2019-12-16T22:40:57.850 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:2 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic InRelease 2019-12-16T22:40:57.863 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2019-12-16T22:40:57.872 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-16T22:40:57.888 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic Release.gpg 2019-12-16T22:40:57.909 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,600 B] 2019-12-16T22:40:57.915 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic InRelease 2019-12-16T22:40:57.936 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic Release [7,663 B] 2019-12-16T22:40:57.943 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.3 kB] 2019-12-16T22:40:57.951 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2019-12-16T22:40:57.964 INFO:teuthology.orchestra.run.smithi177.stdout:Hit:3 http://archive.ubuntu.com/ubuntu bionic InRelease 2019-12-16T22:40:57.964 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://security.ubuntu.com/ubuntu bionic-security InRelease [88.7 kB] 2019-12-16T22:40:57.964 INFO:teuthology.orchestra.run.smithi177.stdout:Ign:5 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic Release.gpg 2019-12-16T22:40:57.985 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 Packages [15.3 kB] 2019-12-16T22:40:58.018 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main i386 Packages [2,600 B] 2019-12-16T22:40:58.035 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic-updates InRelease [88.7 kB] 2019-12-16T22:40:58.258 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2019-12-16T22:40:58.348 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic-backports InRelease [74.6 kB] 2019-12-16T22:40:58.404 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [997 kB] 2019-12-16T22:40:58.557 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,033 kB] 2019-12-16T22:40:58.767 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 Packages [1,033 kB] 2019-12-16T22:40:58.931 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic-updates/universe i386 Packages [997 kB] 2019-12-16T22:40:59.061 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 2,218 kB in 1s (1,725 kB/s) 2019-12-16T22:40:59.221 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 2,307 kB in 1s (1,692 kB/s) 2019-12-16T22:41:00.190 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2019-12-16T22:41:00.237 INFO:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-8533-g8a58d06-1bionic cephadm=15.0.0-8533-g8a58d06-1bionic ceph-mds=15.0.0-8533-g8a58d06-1bionic ceph-mgr=15.0.0-8533-g8a58d06-1bionic ceph-common=15.0.0-8533-g8a58d06-1bionic ceph-fuse=15.0.0-8533-g8a58d06-1bionic ceph-test=15.0.0-8533-g8a58d06-1bionic radosgw=15.0.0-8533-g8a58d06-1bionic python3-rados=15.0.0-8533-g8a58d06-1bionic python3-rgw=15.0.0-8533-g8a58d06-1bionic python3-cephfs=15.0.0-8533-g8a58d06-1bionic python3-rbd=15.0.0-8533-g8a58d06-1bionic libcephfs2=15.0.0-8533-g8a58d06-1bionic libcephfs-dev=15.0.0-8533-g8a58d06-1bionic librados2=15.0.0-8533-g8a58d06-1bionic librbd1=15.0.0-8533-g8a58d06-1bionic rbd-fuse=15.0.0-8533-g8a58d06-1bionic rbd-mirror=15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:41:00.317 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2019-12-16T22:41:00.369 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2019-12-16T22:41:00.410 INFO:teuthology.orchestra.run.smithi177:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.0.0-8533-g8a58d06-1bionic cephadm=15.0.0-8533-g8a58d06-1bionic ceph-mds=15.0.0-8533-g8a58d06-1bionic ceph-mgr=15.0.0-8533-g8a58d06-1bionic ceph-common=15.0.0-8533-g8a58d06-1bionic ceph-fuse=15.0.0-8533-g8a58d06-1bionic ceph-test=15.0.0-8533-g8a58d06-1bionic radosgw=15.0.0-8533-g8a58d06-1bionic python3-rados=15.0.0-8533-g8a58d06-1bionic python3-rgw=15.0.0-8533-g8a58d06-1bionic python3-cephfs=15.0.0-8533-g8a58d06-1bionic python3-rbd=15.0.0-8533-g8a58d06-1bionic libcephfs2=15.0.0-8533-g8a58d06-1bionic libcephfs-dev=15.0.0-8533-g8a58d06-1bionic librados2=15.0.0-8533-g8a58d06-1bionic librbd1=15.0.0-8533-g8a58d06-1bionic rbd-fuse=15.0.0-8533-g8a58d06-1bionic rbd-mirror=15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:41:00.481 INFO:teuthology.orchestra.run.smithi177.stdout:Reading package lists... 2019-12-16T22:41:00.553 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2019-12-16T22:41:00.553 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2019-12-16T22:41:00.700 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2019-12-16T22:41:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-16T22:41:00.700 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2019-12-16T22:41:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 2019-12-16T22:41:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 2019-12-16T22:41:00.701 INFO:teuthology.orchestra.run.smithi106.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2019-12-16T22:41:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2019-12-16T22:41:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2019-12-16T22:41:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2019-12-16T22:41:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2019-12-16T22:41:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2019-12-16T22:41:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: python3-mako python3-markupsafe python3-matplotlib python3-monotonic 2019-12-16T22:41:00.702 INFO:teuthology.orchestra.run.smithi106.stdout: python3-nose python3-numpy python3-oauth2client python3-olefile 2019-12-16T22:41:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2019-12-16T22:41:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2019-12-16T22:41:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2019-12-16T22:41:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy 2019-12-16T22:41:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2019-12-16T22:41:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2019-12-16T22:41:00.703 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2019-12-16T22:41:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2019-12-16T22:41:00.704 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2019-12-16T22:41:00.704 INFO:teuthology.orchestra.run.smithi177.stdout:Building dependency tree... 2019-12-16T22:41:00.705 INFO:teuthology.orchestra.run.smithi177.stdout:Reading state information... 2019-12-16T22:41:00.705 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2019-12-16T22:41:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2019-12-16T22:41:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: python-pytest-xdist python-mock python-cryptography-doc 2019-12-16T22:41:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2019-12-16T22:41:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2019-12-16T22:41:00.705 INFO:teuthology.orchestra.run.smithi106.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2019-12-16T22:41:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2019-12-16T22:41:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2019-12-16T22:41:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: python-nose-doc python-numpy-doc python3-dev python3-numpy-dbg 2019-12-16T22:41:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2019-12-16T22:41:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-pil-doc 2019-12-16T22:41:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pil-dbg python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2019-12-16T22:41:00.706 INFO:teuthology.orchestra.run.smithi106.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2019-12-16T22:41:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2019-12-16T22:41:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2019-12-16T22:41:00.707 INFO:teuthology.orchestra.run.smithi106.stdout: python3-watchdog python-werkzeug-doc 2019-12-16T22:41:00.801 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2019-12-16T22:41:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2019-12-16T22:41:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-16T22:41:00.802 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2019-12-16T22:41:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 libleveldb1v5 2019-12-16T22:41:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 2019-12-16T22:41:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: librgw2 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2019-12-16T22:41:00.803 INFO:teuthology.orchestra.run.smithi106.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2019-12-16T22:41:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2019-12-16T22:41:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2019-12-16T22:41:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2019-12-16T22:41:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2019-12-16T22:41:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: python3-httplib2 python3-joblib python3-jwt python3-kubernetes 2019-12-16T22:41:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2019-12-16T22:41:00.804 INFO:teuthology.orchestra.run.smithi106.stdout: python3-matplotlib python3-monotonic python3-nose python3-numpy 2019-12-16T22:41:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2019-12-16T22:41:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2019-12-16T22:41:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2019-12-16T22:41:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2019-12-16T22:41:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rados python3-rbd python3-repoze.lru python3-rgw python3-routes 2019-12-16T22:41:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: python3-rsa python3-scipy python3-setuptools python3-simplegeneric 2019-12-16T22:41:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplejson python3-singledispatch python3-sklearn 2019-12-16T22:41:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tk python3-tz 2019-12-16T22:41:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob 2019-12-16T22:41:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: python3-websocket python3-webtest python3-werkzeug radosgw rbd-fuse 2019-12-16T22:41:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: rbd-mirror socat xmlstarlet 2019-12-16T22:41:00.807 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2019-12-16T22:41:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: librados2 librbd1 2019-12-16T22:41:00.852 INFO:teuthology.orchestra.run.smithi177.stdout:The following additional packages will be installed: 2019-12-16T22:41:00.853 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-16T22:41:00.853 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2019-12-16T22:41:00.854 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd jq libjq1 libleveldb1v5 liblttng-ust0 liboath0 libonig4 2019-12-16T22:41:00.855 INFO:teuthology.orchestra.run.smithi177.stdout: librabbitmq4 libradosstriper1 librdkafka1 librgw2 libsnappy1v5 libxslt1.1 2019-12-16T22:41:00.855 INFO:teuthology.orchestra.run.smithi177.stdout: python-attr python-funcsigs python-pastedeploy-tpl python-pluggy python-py 2019-12-16T22:41:00.855 INFO:teuthology.orchestra.run.smithi177.stdout: python-pytest python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2019-12-16T22:41:00.855 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse python3-ceph-common python3-cffi-backend 2019-12-16T22:41:00.855 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cherrypy3 python3-cryptography python3-cycler python3-dateutil 2019-12-16T22:41:00.855 INFO:teuthology.orchestra.run.smithi177.stdout: python3-decorator python3-fasteners python3-html5lib python3-httplib2 2019-12-16T22:41:00.855 INFO:teuthology.orchestra.run.smithi177.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2019-12-16T22:41:00.856 INFO:teuthology.orchestra.run.smithi177.stdout: python3-mako python3-markupsafe python3-matplotlib python3-monotonic 2019-12-16T22:41:00.856 INFO:teuthology.orchestra.run.smithi177.stdout: python3-nose python3-numpy python3-oauth2client python3-olefile 2019-12-16T22:41:00.856 INFO:teuthology.orchestra.run.smithi177.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2019-12-16T22:41:00.856 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pecan python3-pil python3-pluggy python3-prettytable python3-py 2019-12-16T22:41:00.861 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1 python3-pyasn1-modules python3-pyinotify python3-pyparsing 2019-12-16T22:41:00.861 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pytest python3-repoze.lru python3-routes python3-rsa python3-scipy 2019-12-16T22:41:00.861 INFO:teuthology.orchestra.run.smithi177.stdout: python3-setuptools python3-simplegeneric python3-simplejson 2019-12-16T22:41:00.861 INFO:teuthology.orchestra.run.smithi177.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib 2019-12-16T22:41:00.861 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sqlalchemy python3-tempita python3-tk python3-tz python3-uritemplate 2019-12-16T22:41:00.861 INFO:teuthology.orchestra.run.smithi177.stdout: python3-waitress python3-webencodings python3-webob python3-websocket 2019-12-16T22:41:00.862 INFO:teuthology.orchestra.run.smithi177.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2019-12-16T22:41:00.864 INFO:teuthology.orchestra.run.smithi177.stdout:Suggested packages: 2019-12-16T22:41:00.864 INFO:teuthology.orchestra.run.smithi177.stdout: python3-influxdb python-attr-doc python-funcsigs-doc subversion 2019-12-16T22:41:00.864 INFO:teuthology.orchestra.run.smithi177.stdout: python-pytest-xdist python-mock python-cryptography-doc 2019-12-16T22:41:00.864 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cryptography-vectors python-cycler-doc python3-genshi python3-crypto 2019-12-16T22:41:00.864 INFO:teuthology.orchestra.run.smithi177.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc dvipng 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: ffmpeg gir1.2-gtk-3.0 ghostscript inkscape ipython3 python-matplotlib-doc 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cairocffi python3-gi-cairo python3-gobject python3-pyqt4 python3-sip 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: python3-tornado texlive-extra-utils texlive-latex-extra ttf-staypuft 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: python-nose-doc python-numpy-doc python3-dev python3-numpy-dbg 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-pil-doc 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pil-dbg python-pyinotify-doc python-pyparsing-doc python-scipy-doc 2019-12-16T22:41:00.865 INFO:teuthology.orchestra.run.smithi177.stdout: python-setuptools-doc python3-dap python-sklearn-doc python-sqlalchemy-doc 2019-12-16T22:41:00.866 INFO:teuthology.orchestra.run.smithi177.stdout: python3-psycopg2 python3-pymysql python3-fdb tix python3-tk-dbg 2019-12-16T22:41:00.866 INFO:teuthology.orchestra.run.smithi177.stdout: python-waitress-doc python-webob-doc python-webtest-doc python3-termcolor 2019-12-16T22:41:00.866 INFO:teuthology.orchestra.run.smithi177.stdout: python3-watchdog python-werkzeug-doc 2019-12-16T22:41:00.953 INFO:teuthology.orchestra.run.smithi177.stdout:The following NEW packages will be installed: 2019-12-16T22:41:00.954 INFO:teuthology.orchestra.run.smithi177.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2019-12-16T22:41:00.955 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2019-12-16T22:41:00.955 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-rook ceph-mon 2019-12-16T22:41:00.957 INFO:teuthology.orchestra.run.smithi177.stdout: ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 libleveldb1v5 2019-12-16T22:41:00.958 INFO:teuthology.orchestra.run.smithi177.stdout: liblttng-ust0 liboath0 libonig4 librabbitmq4 libradosstriper1 librdkafka1 2019-12-16T22:41:00.958 INFO:teuthology.orchestra.run.smithi177.stdout: librgw2 libsnappy1v5 libxslt1.1 python-attr python-funcsigs 2019-12-16T22:41:00.958 INFO:teuthology.orchestra.run.smithi177.stdout: python-pastedeploy-tpl python-pluggy python-py python-pytest 2019-12-16T22:41:00.958 INFO:teuthology.orchestra.run.smithi177.stdout: python3-asn1crypto python3-attr python3-bcrypt python3-bs4 2019-12-16T22:41:00.958 INFO:teuthology.orchestra.run.smithi177.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs 2019-12-16T22:41:00.958 INFO:teuthology.orchestra.run.smithi177.stdout: python3-cffi-backend python3-cherrypy3 python3-cryptography python3-cycler 2019-12-16T22:41:00.958 INFO:teuthology.orchestra.run.smithi177.stdout: python3-dateutil python3-decorator python3-fasteners python3-html5lib 2019-12-16T22:41:00.959 INFO:teuthology.orchestra.run.smithi177.stdout: python3-httplib2 python3-joblib python3-jwt python3-kubernetes 2019-12-16T22:41:00.959 INFO:teuthology.orchestra.run.smithi177.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2019-12-16T22:41:00.959 INFO:teuthology.orchestra.run.smithi177.stdout: python3-matplotlib python3-monotonic python3-nose python3-numpy 2019-12-16T22:41:00.959 INFO:teuthology.orchestra.run.smithi177.stdout: python3-oauth2client python3-olefile python3-openssl python3-paste 2019-12-16T22:41:00.959 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pil 2019-12-16T22:41:00.959 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pluggy python3-prettytable python3-py python3-pyasn1 2019-12-16T22:41:00.959 INFO:teuthology.orchestra.run.smithi177.stdout: python3-pyasn1-modules python3-pyinotify python3-pyparsing python3-pytest 2019-12-16T22:41:00.960 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rados python3-rbd python3-repoze.lru python3-rgw python3-routes 2019-12-16T22:41:00.960 INFO:teuthology.orchestra.run.smithi177.stdout: python3-rsa python3-scipy python3-setuptools python3-simplegeneric 2019-12-16T22:41:00.960 INFO:teuthology.orchestra.run.smithi177.stdout: python3-simplejson python3-singledispatch python3-sklearn 2019-12-16T22:41:00.960 INFO:teuthology.orchestra.run.smithi177.stdout: python3-sklearn-lib python3-sqlalchemy python3-tempita python3-tk python3-tz 2019-12-16T22:41:00.961 INFO:teuthology.orchestra.run.smithi177.stdout: python3-uritemplate python3-waitress python3-webencodings python3-webob 2019-12-16T22:41:00.961 INFO:teuthology.orchestra.run.smithi177.stdout: python3-websocket python3-webtest python3-werkzeug radosgw rbd-fuse 2019-12-16T22:41:00.961 INFO:teuthology.orchestra.run.smithi177.stdout: rbd-mirror socat xmlstarlet 2019-12-16T22:41:00.961 INFO:teuthology.orchestra.run.smithi177.stdout:The following packages will be upgraded: 2019-12-16T22:41:00.961 INFO:teuthology.orchestra.run.smithi177.stdout: librados2 librbd1 2019-12-16T22:41:00.994 INFO:teuthology.orchestra.run.smithi106.stdout:2 upgraded, 108 newly installed, 0 to remove and 15 not upgraded. 2019-12-16T22:41:00.995 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 147 MB of archives. 2019-12-16T22:41:00.995 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 694 MB of additional disk space will be used. 2019-12-16T22:41:00.995 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2019-12-16T22:41:01.024 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-8533-g8a58d06-1bionic [1,573 kB] 2019-12-16T22:41:01.076 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2019-12-16T22:41:01.107 INFO:teuthology.orchestra.run.smithi177.stdout:2 upgraded, 108 newly installed, 0 to remove and 15 not upgraded. 2019-12-16T22:41:01.107 INFO:teuthology.orchestra.run.smithi177.stdout:Need to get 147 MB of archives. 2019-12-16T22:41:01.107 INFO:teuthology.orchestra.run.smithi177.stdout:After this operation, 694 MB of additional disk space will be used. 2019-12-16T22:41:01.107 INFO:teuthology.orchestra.run.smithi177.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 librbd1 amd64 15.0.0-8533-g8a58d06-1bionic [1,573 kB] 2019-12-16T22:41:01.150 INFO:teuthology.orchestra.run.smithi177.stdout:Get:2 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-uritemplate all 0.6-1ubuntu1 [5,126 B] 2019-12-16T22:41:01.167 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-8533-g8a58d06-1bionic [3,043 kB] 2019-12-16T22:41:01.237 INFO:teuthology.orchestra.run.smithi177.stdout:Get:3 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liblttng-ust0 amd64 2.10.1-1 [154 kB] 2019-12-16T22:41:01.264 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-8533-g8a58d06-1bionic [428 kB] 2019-12-16T22:41:01.278 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-8533-g8a58d06-1bionic [330 kB] 2019-12-16T22:41:01.291 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-8533-g8a58d06-1bionic [20.5 kB] 2019-12-16T22:41:01.292 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-8533-g8a58d06-1bionic [117 kB] 2019-12-16T22:41:01.296 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.0.0-8533-g8a58d06-1bionic [18.4 kB] 2019-12-16T22:41:01.296 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.0.0-8533-g8a58d06-1bionic [276 kB] 2019-12-16T22:41:01.306 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-8533-g8a58d06-1bionic [4,540 kB] 2019-12-16T22:41:01.331 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2019-12-16T22:41:01.345 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2019-12-16T22:41:01.365 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2019-12-16T22:41:01.463 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2019-12-16T22:41:01.465 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.0.0-8533-g8a58d06-1bionic [99.1 kB] 2019-12-16T22:41:01.466 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2019-12-16T22:41:01.468 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-8533-g8a58d06-1bionic [328 kB] 2019-12-16T22:41:01.479 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-8533-g8a58d06-1bionic [17.7 MB] 2019-12-16T22:41:01.491 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2019-12-16T22:41:01.501 INFO:teuthology.orchestra.run.smithi177.stdout:Get:4 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-prettytable all 0.7.2-3 [19.7 kB] 2019-12-16T22:41:01.501 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2019-12-16T22:41:01.513 INFO:teuthology.orchestra.run.smithi177.stdout:Get:5 http://archive.ubuntu.com/ubuntu bionic-updates/universe amd64 librabbitmq4 amd64 0.8.0-1ubuntu0.18.04.2 [33.9 kB] 2019-12-16T22:41:01.513 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2019-12-16T22:41:01.513 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2019-12-16T22:41:01.533 INFO:teuthology.orchestra.run.smithi177.stdout:Get:6 http://archive.ubuntu.com/ubuntu bionic/universe amd64 librdkafka1 amd64 0.11.3-1build1 [293 kB] 2019-12-16T22:41:01.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2019-12-16T22:41:01.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2019-12-16T22:41:01.545 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2019-12-16T22:41:01.576 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2019-12-16T22:41:01.579 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2019-12-16T22:41:01.580 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2019-12-16T22:41:01.633 INFO:teuthology.orchestra.run.smithi177.stdout:Get:7 http://archive.ubuntu.com/ubuntu bionic/main amd64 libsnappy1v5 amd64 1.1.7-1 [16.0 kB] 2019-12-16T22:41:01.633 INFO:teuthology.orchestra.run.smithi177.stdout:Get:8 http://archive.ubuntu.com/ubuntu bionic/main amd64 libleveldb1v5 amd64 1.20-2 [136 kB] 2019-12-16T22:41:01.657 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2019-12-16T22:41:01.659 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2019-12-16T22:41:01.660 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2019-12-16T22:41:01.660 INFO:teuthology.orchestra.run.smithi177.stdout:Get:9 http://archive.ubuntu.com/ubuntu bionic/universe amd64 liboath0 amd64 2.6.1-1 [44.7 kB] 2019-12-16T22:41:01.660 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2019-12-16T22:41:01.667 INFO:teuthology.orchestra.run.smithi177.stdout:Get:10 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-cffi-backend amd64 1.11.5-1 [64.6 kB] 2019-12-16T22:41:01.678 INFO:teuthology.orchestra.run.smithi177.stdout:Get:11 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-bcrypt amd64 3.1.4-2 [29.9 kB] 2019-12-16T22:41:01.684 INFO:teuthology.orchestra.run.smithi177.stdout:Get:12 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cherrypy3 all 8.9.1-2 [160 kB] 2019-12-16T22:41:01.705 INFO:teuthology.orchestra.run.smithi177.stdout:Get:13 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-jwt all 1.5.3+ds1-1 [15.9 kB] 2019-12-16T22:41:01.706 INFO:teuthology.orchestra.run.smithi177.stdout:Get:14 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-asn1crypto all 0.24.0-1 [72.8 kB] 2019-12-16T22:41:01.714 INFO:teuthology.orchestra.run.smithi177.stdout:Get:15 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-cryptography amd64 2.1.4-1ubuntu1.3 [221 kB] 2019-12-16T22:41:01.742 INFO:teuthology.orchestra.run.smithi177.stdout:Get:16 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-openssl all 17.5.0-1ubuntu1 [41.5 kB] 2019-12-16T22:41:01.747 INFO:teuthology.orchestra.run.smithi177.stdout:Get:17 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-logutils all 0.3.3-5 [16.7 kB] 2019-12-16T22:41:01.747 INFO:teuthology.orchestra.run.smithi177.stdout:Get:18 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-markupsafe amd64 1.0-1build1 [13.5 kB] 2019-12-16T22:41:01.823 INFO:teuthology.orchestra.run.smithi177.stdout:Get:19 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-mako all 1.0.7+ds1-1 [59.3 kB] 2019-12-16T22:41:01.824 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2019-12-16T22:41:01.826 INFO:teuthology.orchestra.run.smithi177.stdout:Get:20 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-simplegeneric all 0.8.1-1 [11.5 kB] 2019-12-16T22:41:01.826 INFO:teuthology.orchestra.run.smithi177.stdout:Get:21 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-singledispatch all 3.4.0.3-2 [7,022 B] 2019-12-16T22:41:01.827 INFO:teuthology.orchestra.run.smithi177.stdout:Get:22 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webob all 1:1.7.3-2fakesync1 [64.3 kB] 2019-12-16T22:41:01.985 INFO:teuthology.orchestra.run.smithi177.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 librados2 amd64 15.0.0-8533-g8a58d06-1bionic [3,043 kB] 2019-12-16T22:41:01.992 INFO:teuthology.orchestra.run.smithi177.stdout:Get:24 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-bs4 all 4.6.0-1 [67.8 kB] 2019-12-16T22:41:02.083 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2019-12-16T22:41:02.097 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2019-12-16T22:41:02.100 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2019-12-16T22:41:02.118 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-8533-g8a58d06-1bionic [5,093 kB] 2019-12-16T22:41:02.275 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-8533-g8a58d06-1bionic [1,391 kB] 2019-12-16T22:41:02.288 INFO:teuthology.orchestra.run.smithi177.stdout:Get:25 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-waitress all 1.0.1-1 [53.4 kB] 2019-12-16T22:41:02.318 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2019-12-16T22:41:02.319 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-8533-g8a58d06-1bionic [5,940 kB] 2019-12-16T22:41:02.320 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2019-12-16T22:41:02.324 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2019-12-16T22:41:02.327 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2019-12-16T22:41:02.336 INFO:teuthology.orchestra.run.smithi177.stdout:Get:26 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tempita all 0.5.2-2 [13.9 kB] 2019-12-16T22:41:02.340 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2019-12-16T22:41:02.350 INFO:teuthology.orchestra.run.smithi177.stdout:Get:27 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-paste all 2.0.3+dfsg-4ubuntu1 [456 kB] 2019-12-16T22:41:02.368 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2019-12-16T22:41:02.369 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2019-12-16T22:41:02.373 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2019-12-16T22:41:02.505 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2019-12-16T22:41:02.505 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2019-12-16T22:41:02.515 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-8533-g8a58d06-1bionic [22.6 MB] 2019-12-16T22:41:02.555 INFO:teuthology.orchestra.run.smithi177.stdout:Get:28 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-pastedeploy-tpl all 1.5.2-4 [4,796 B] 2019-12-16T22:41:02.556 INFO:teuthology.orchestra.run.smithi177.stdout:Get:29 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastedeploy all 1.5.2-4 [13.4 kB] 2019-12-16T22:41:02.558 INFO:teuthology.orchestra.run.smithi177.stdout:Get:30 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webtest all 2.0.28-1ubuntu1 [27.9 kB] 2019-12-16T22:41:02.564 INFO:teuthology.orchestra.run.smithi177.stdout:Get:31 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pecan all 1.2.1-2 [86.1 kB] 2019-12-16T22:41:02.578 INFO:teuthology.orchestra.run.smithi177.stdout:Get:32 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-werkzeug all 0.14.1+dfsg1-1 [174 kB] 2019-12-16T22:41:02.603 INFO:teuthology.orchestra.run.smithi177.stdout:Get:33 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-repoze.lru all 0.7-1 [11.7 kB] 2019-12-16T22:41:02.605 INFO:teuthology.orchestra.run.smithi177.stdout:Get:34 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-routes all 2.4.1-1 [28.4 kB] 2019-12-16T22:41:02.611 INFO:teuthology.orchestra.run.smithi177.stdout:Get:35 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-numpy amd64 1:1.13.3-2ubuntu1 [1,943 kB] 2019-12-16T22:41:02.755 INFO:teuthology.orchestra.run.smithi177.stdout:Get:36 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-decorator all 4.1.2-1 [9,364 B] 2019-12-16T22:41:02.755 INFO:teuthology.orchestra.run.smithi177.stdout:Get:37 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-scipy amd64 0.19.1-2ubuntu1 [9,619 kB] 2019-12-16T22:41:02.761 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2019-12-16T22:41:02.810 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2019-12-16T22:41:02.810 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2019-12-16T22:41:02.842 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2019-12-16T22:41:02.842 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2019-12-16T22:41:02.842 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2019-12-16T22:41:02.843 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2019-12-16T22:41:03.005 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2019-12-16T22:41:03.037 INFO:teuthology.orchestra.run.smithi177.stdout:Get:38 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn-lib amd64 0.19.1-3 [1,429 kB] 2019-12-16T22:41:03.075 INFO:teuthology.orchestra.run.smithi177.stdout:Get:39 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-joblib all 0.11-1 [109 kB] 2019-12-16T22:41:03.078 INFO:teuthology.orchestra.run.smithi177.stdout:Get:40 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-sklearn all 0.19.1-3 [1,373 kB] 2019-12-16T22:41:03.116 INFO:teuthology.orchestra.run.smithi177.stdout:Get:41 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-dateutil all 2.6.1-1 [52.3 kB] 2019-12-16T22:41:03.118 INFO:teuthology.orchestra.run.smithi177.stdout:Get:42 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-monotonic all 1.1-2 [5,332 B] 2019-12-16T22:41:03.119 INFO:teuthology.orchestra.run.smithi177.stdout:Get:43 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-fasteners all 0.12.0-3 [13.5 kB] 2019-12-16T22:41:03.119 INFO:teuthology.orchestra.run.smithi177.stdout:Get:44 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-httplib2 all 0.9.2+dfsg-1ubuntu0.1 [28.6 kB] 2019-12-16T22:41:03.246 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2019-12-16T22:41:03.281 INFO:teuthology.orchestra.run.smithi177.stdout:Get:45 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1 all 0.4.2-3 [46.8 kB] 2019-12-16T22:41:03.283 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2019-12-16T22:41:03.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-8533-g8a58d06-1bionic [3,792 B] 2019-12-16T22:41:03.322 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-8533-g8a58d06-1bionic [504 kB] 2019-12-16T22:41:03.325 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2019-12-16T22:41:03.335 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-8533-g8a58d06-1bionic [1,814 kB] 2019-12-16T22:41:03.402 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.0.0-8533-g8a58d06-1bionic [21.3 kB] 2019-12-16T22:41:03.402 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.0.0-8533-g8a58d06-1bionic [19.9 kB] 2019-12-16T22:41:03.403 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-8533-g8a58d06-1bionic [3,414 kB] 2019-12-16T22:41:03.527 INFO:teuthology.orchestra.run.smithi177.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs2 amd64 15.0.0-8533-g8a58d06-1bionic [428 kB] 2019-12-16T22:41:03.533 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-8533-g8a58d06-1bionic [34.1 kB] 2019-12-16T22:41:03.533 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-8533-g8a58d06-1bionic [7,889 kB] 2019-12-16T22:41:03.538 INFO:teuthology.orchestra.run.smithi177.stdout:Get:47 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyasn1-modules all 0.2.1-0.2 [32.9 kB] 2019-12-16T22:41:03.569 INFO:teuthology.orchestra.run.smithi177.stdout:Get:48 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-rsa all 3.4.2-1 [29.0 kB] 2019-12-16T22:41:03.570 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2019-12-16T22:41:03.589 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2019-12-16T22:41:03.612 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2019-12-16T22:41:03.615 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2019-12-16T22:41:03.618 INFO:teuthology.orchestra.run.smithi177.stdout:Get:49 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-sqlalchemy all 1.1.11+ds1-1ubuntu1 [680 kB] 2019-12-16T22:41:03.631 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2019-12-16T22:41:03.639 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2019-12-16T22:41:03.652 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2019-12-16T22:41:03.652 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2019-12-16T22:41:03.671 INFO:teuthology.orchestra.run.smithi177.stdout:Get:50 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-rados amd64 15.0.0-8533-g8a58d06-1bionic [330 kB] 2019-12-16T22:41:03.681 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2019-12-16T22:41:03.693 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2019-12-16T22:41:03.731 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2019-12-16T22:41:03.733 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2019-12-16T22:41:03.734 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2019-12-16T22:41:03.737 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2019-12-16T22:41:03.737 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2019-12-16T22:41:03.738 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2019-12-16T22:41:03.743 INFO:teuthology.orchestra.run.smithi177.stdout:Get:51 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-argparse all 15.0.0-8533-g8a58d06-1bionic [20.5 kB] 2019-12-16T22:41:03.743 INFO:teuthology.orchestra.run.smithi177.stdout:Get:52 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-cephfs amd64 15.0.0-8533-g8a58d06-1bionic [117 kB] 2019-12-16T22:41:03.811 INFO:teuthology.orchestra.run.smithi177.stdout:Get:53 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-ceph-common all 15.0.0-8533-g8a58d06-1bionic [18.4 kB] 2019-12-16T22:41:03.812 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2019-12-16T22:41:03.812 INFO:teuthology.orchestra.run.smithi177.stdout:Get:54 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-rbd amd64 15.0.0-8533-g8a58d06-1bionic [276 kB] 2019-12-16T22:41:03.829 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-8533-g8a58d06-1bionic [3,912 B] 2019-12-16T22:41:03.829 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-8533-g8a58d06-1bionic [13.3 kB] 2019-12-16T22:41:03.830 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-8533-g8a58d06-1bionic [36.2 MB] 2019-12-16T22:41:03.864 INFO:teuthology.orchestra.run.smithi177.stdout:Get:55 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-oauth2client all 4.1.2-3 [61.5 kB] 2019-12-16T22:41:03.873 INFO:teuthology.orchestra.run.smithi177.stdout:Get:56 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-setuptools all 39.0.1-2 [248 kB] 2019-12-16T22:41:03.886 INFO:teuthology.orchestra.run.smithi177.stdout:Get:57 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 librgw2 amd64 15.0.0-8533-g8a58d06-1bionic [4,540 kB] 2019-12-16T22:41:03.919 INFO:teuthology.orchestra.run.smithi177.stdout:Get:58 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-websocket all 0.44.0-0ubuntu2 [30.7 kB] 2019-12-16T22:41:03.919 INFO:teuthology.orchestra.run.smithi177.stdout:Get:59 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-kubernetes all 2.0.0-2ubuntu1 [181 kB] 2019-12-16T22:41:03.921 INFO:teuthology.orchestra.run.smithi177.stdout:Get:60 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libonig4 amd64 6.7.0-1 [119 kB] 2019-12-16T22:41:03.937 INFO:teuthology.orchestra.run.smithi177.stdout:Get:61 http://archive.ubuntu.com/ubuntu bionic/universe amd64 libjq1 amd64 1.5+dfsg-2 [111 kB] 2019-12-16T22:41:03.945 INFO:teuthology.orchestra.run.smithi177.stdout:Get:62 http://archive.ubuntu.com/ubuntu bionic/universe amd64 jq amd64 1.5+dfsg-2 [45.6 kB] 2019-12-16T22:41:03.946 INFO:teuthology.orchestra.run.smithi177.stdout:Get:63 http://archive.ubuntu.com/ubuntu bionic/main amd64 socat amd64 1.7.3.2-2ubuntu2 [342 kB] 2019-12-16T22:41:03.968 INFO:teuthology.orchestra.run.smithi177.stdout:Get:64 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 libxslt1.1 amd64 1.1.29-5ubuntu0.2 [150 kB] 2019-12-16T22:41:03.974 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2019-12-16T22:41:03.977 INFO:teuthology.orchestra.run.smithi177.stdout:Get:65 http://archive.ubuntu.com/ubuntu bionic/universe amd64 xmlstarlet amd64 1.6.1-2 [382 kB] 2019-12-16T22:41:04.027 INFO:teuthology.orchestra.run.smithi177.stdout:Get:66 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-attr all 17.4.0-2 [23.7 kB] 2019-12-16T22:41:04.028 INFO:teuthology.orchestra.run.smithi177.stdout:Get:67 http://archive.ubuntu.com/ubuntu bionic/main amd64 python-funcsigs all 1.0.2-4 [13.5 kB] 2019-12-16T22:41:04.029 INFO:teuthology.orchestra.run.smithi177.stdout:Get:68 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pluggy all 0.6.0-1 [12.2 kB] 2019-12-16T22:41:04.030 INFO:teuthology.orchestra.run.smithi177.stdout:Get:69 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-py all 1.5.2-1 [65.1 kB] 2019-12-16T22:41:04.032 INFO:teuthology.orchestra.run.smithi177.stdout:Get:70 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python-pytest all 3.3.2-2 [142 kB] 2019-12-16T22:41:04.042 INFO:teuthology.orchestra.run.smithi177.stdout:Get:71 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-attr all 17.4.0-2 [23.8 kB] 2019-12-16T22:41:04.042 INFO:teuthology.orchestra.run.smithi177.stdout:Get:72 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-cycler all 0.10.0-1 [7,622 B] 2019-12-16T22:41:04.055 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2019-12-16T22:41:04.202 INFO:teuthology.orchestra.run.smithi177.stdout:Get:73 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-webencodings all 0.5-2 [10.4 kB] 2019-12-16T22:41:04.219 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2019-12-16T22:41:04.313 INFO:teuthology.orchestra.run.smithi177.stdout:Get:74 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-html5lib all 0.999999999-1 [81.9 kB] 2019-12-16T22:41:04.504 INFO:teuthology.orchestra.run.smithi177.stdout:Get:75 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-lxml amd64 4.2.1-1ubuntu0.1 [1,091 kB] 2019-12-16T22:41:04.513 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2019-12-16T22:41:04.513 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2019-12-16T22:41:04.516 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2019-12-16T22:41:04.681 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB] 2019-12-16T22:41:04.683 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2019-12-16T22:41:04.685 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2019-12-16T22:41:04.685 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pil amd64 5.1.0-1 [328 kB] 2019-12-16T22:41:04.692 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2019-12-16T22:41:04.692 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2019-12-16T22:41:04.693 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2019-12-16T22:41:04.693 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2019-12-16T22:41:04.698 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2019-12-16T22:41:04.762 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2019-12-16T22:41:04.804 INFO:teuthology.orchestra.run.smithi177.stdout:Get:76 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 python3-rgw amd64 15.0.0-8533-g8a58d06-1bionic [99.1 kB] 2019-12-16T22:41:04.805 INFO:teuthology.orchestra.run.smithi177.stdout:Get:77 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyparsing all 2.2.0+dfsg1-2 [52.2 kB] 2019-12-16T22:41:04.805 INFO:teuthology.orchestra.run.smithi177.stdout:Get:78 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 libradosstriper1 amd64 15.0.0-8533-g8a58d06-1bionic [328 kB] 2019-12-16T22:41:04.814 INFO:teuthology.orchestra.run.smithi177.stdout:Get:79 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-tz all 2018.3-2 [25.1 kB] 2019-12-16T22:41:04.814 INFO:teuthology.orchestra.run.smithi177.stdout:Get:80 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-matplotlib amd64 2.1.1-2ubuntu3 [3,907 kB] 2019-12-16T22:41:04.864 INFO:teuthology.orchestra.run.smithi177.stdout:Get:81 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-common amd64 15.0.0-8533-g8a58d06-1bionic [17.7 MB] 2019-12-16T22:41:04.975 INFO:teuthology.orchestra.run.smithi177.stdout:Get:82 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-nose all 1.3.7-3 [115 kB] 2019-12-16T22:41:04.977 INFO:teuthology.orchestra.run.smithi177.stdout:Get:83 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-olefile all 0.45.1-1 [33.3 kB] 2019-12-16T22:41:04.978 INFO:teuthology.orchestra.run.smithi177.stdout:Get:84 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pastescript all 2.0.2-2 [54.6 kB] 2019-12-16T22:41:04.979 INFO:teuthology.orchestra.run.smithi177.stdout:Get:85 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pil amd64 5.1.0-1 [328 kB] 2019-12-16T22:41:04.988 INFO:teuthology.orchestra.run.smithi177.stdout:Get:86 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pluggy all 0.6.0-1 [12.3 kB] 2019-12-16T22:41:04.989 INFO:teuthology.orchestra.run.smithi177.stdout:Get:87 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-py all 1.5.2-1 [65.2 kB] 2019-12-16T22:41:04.990 INFO:teuthology.orchestra.run.smithi177.stdout:Get:88 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-pyinotify all 0.9.6-1 [24.7 kB] 2019-12-16T22:41:04.991 INFO:teuthology.orchestra.run.smithi177.stdout:Get:89 http://archive.ubuntu.com/ubuntu bionic/universe amd64 python3-pytest all 3.3.2-2 [142 kB] 2019-12-16T22:41:04.997 INFO:teuthology.orchestra.run.smithi177.stdout:Get:90 http://archive.ubuntu.com/ubuntu bionic/main amd64 python3-simplejson amd64 3.13.2-1 [49.6 kB] 2019-12-16T22:41:05.057 INFO:teuthology.orchestra.run.smithi177.stdout:Get:91 http://archive.ubuntu.com/ubuntu bionic-updates/main amd64 python3-tk amd64 3.6.9-1~18.04 [119 kB] 2019-12-16T22:41:05.251 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-8533-g8a58d06-1bionic [17.3 kB] 2019-12-16T22:41:05.251 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-8533-g8a58d06-1bionic [5,198 kB] 2019-12-16T22:41:05.453 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-8533-g8a58d06-1bionic [62.4 kB] 2019-12-16T22:41:05.454 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 rbd-mirror amd64 15.0.0-8533-g8a58d06-1bionic [2,264 kB] 2019-12-16T22:41:06.251 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 147 MB in 5s (31.1 MB/s) 2019-12-16T22:41:06.348 INFO:teuthology.orchestra.run.smithi177.stdout:Get:92 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-base amd64 15.0.0-8533-g8a58d06-1bionic [5,093 kB] 2019-12-16T22:41:06.391 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-uritemplate. 2019-12-16T22:41:06.429 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2019-12-16T22:41:06.432 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2019-12-16T22:41:06.474 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2019-12-16T22:41:06.630 INFO:teuthology.orchestra.run.smithi177.stdout:Get:93 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr amd64 15.0.0-8533-g8a58d06-1bionic [1,391 kB] 2019-12-16T22:41:06.708 INFO:teuthology.orchestra.run.smithi177.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mon amd64 15.0.0-8533-g8a58d06-1bionic [5,940 kB] 2019-12-16T22:41:06.784 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2019-12-16T22:41:06.795 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2019-12-16T22:41:06.876 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-16T22:41:07.028 INFO:teuthology.orchestra.run.smithi177.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-osd amd64 15.0.0-8533-g8a58d06-1bionic [22.6 MB] 2019-12-16T22:41:07.166 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-librbd1_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:07.263 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (15.0.0-8533-g8a58d06-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-16T22:41:07.794 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-librados2_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:07.918 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (15.0.0-8533-g8a58d06-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-16T22:41:08.222 INFO:teuthology.orchestra.run.smithi177.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph amd64 15.0.0-8533-g8a58d06-1bionic [3,792 B] 2019-12-16T22:41:08.222 INFO:teuthology.orchestra.run.smithi177.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-fuse amd64 15.0.0-8533-g8a58d06-1bionic [504 kB] 2019-12-16T22:41:08.244 INFO:teuthology.orchestra.run.smithi177.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mds amd64 15.0.0-8533-g8a58d06-1bionic [1,814 kB] 2019-12-16T22:41:08.340 INFO:teuthology.orchestra.run.smithi177.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 cephadm amd64 15.0.0-8533-g8a58d06-1bionic [21.3 kB] 2019-12-16T22:41:08.340 INFO:teuthology.orchestra.run.smithi177.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-cephadm all 15.0.0-8533-g8a58d06-1bionic [19.9 kB] 2019-12-16T22:41:08.340 INFO:teuthology.orchestra.run.smithi177.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-dashboard all 15.0.0-8533-g8a58d06-1bionic [3,414 kB] 2019-12-16T22:41:08.505 INFO:teuthology.orchestra.run.smithi177.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-cloud all 15.0.0-8533-g8a58d06-1bionic [34.1 kB] 2019-12-16T22:41:08.512 INFO:teuthology.orchestra.run.smithi177.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-diskprediction-local all 15.0.0-8533-g8a58d06-1bionic [7,889 kB] 2019-12-16T22:41:08.553 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2019-12-16T22:41:08.564 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-libcephfs2_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:08.595 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:08.856 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2019-12-16T22:41:08.868 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-python3-rados_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:08.898 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:08.905 INFO:teuthology.orchestra.run.smithi177.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-k8sevents all 15.0.0-8533-g8a58d06-1bionic [3,912 B] 2019-12-16T22:41:08.906 INFO:teuthology.orchestra.run.smithi177.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-mgr-rook all 15.0.0-8533-g8a58d06-1bionic [13.3 kB] 2019-12-16T22:41:08.906 INFO:teuthology.orchestra.run.smithi177.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 ceph-test amd64 15.0.0-8533-g8a58d06-1bionic [36.2 MB] 2019-12-16T22:41:09.234 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2019-12-16T22:41:09.246 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:09.285 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:09.586 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2019-12-16T22:41:09.597 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-python3-cephfs_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:09.637 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:09.922 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2019-12-16T22:41:09.935 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-python3-ceph-common_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:09.972 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:10.216 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2019-12-16T22:41:10.227 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2019-12-16T22:41:10.266 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2019-12-16T22:41:10.510 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2019-12-16T22:41:10.521 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-python3-rbd_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:10.560 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:10.579 INFO:teuthology.orchestra.run.smithi177.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 libcephfs-dev amd64 15.0.0-8533-g8a58d06-1bionic [17.3 kB] 2019-12-16T22:41:10.579 INFO:teuthology.orchestra.run.smithi177.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 radosgw amd64 15.0.0-8533-g8a58d06-1bionic [5,198 kB] 2019-12-16T22:41:10.797 INFO:teuthology.orchestra.run.smithi177.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 rbd-fuse amd64 15.0.0-8533-g8a58d06-1bionic [62.4 kB] 2019-12-16T22:41:10.803 INFO:teuthology.orchestra.run.smithi177.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-sage3-testing-2019-12-16-1157/8a58d0694cce968d9a21937d52c2e48cfe306455/ubuntu/bionic/flavors/default bionic/main amd64 rbd-mirror amd64 15.0.0-8533-g8a58d06-1bionic [2,264 kB] 2019-12-16T22:41:10.939 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librabbitmq4:amd64. 2019-12-16T22:41:10.950 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2019-12-16T22:41:10.988 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2019-12-16T22:41:11.283 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2019-12-16T22:41:11.294 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2019-12-16T22:41:11.324 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-16T22:41:11.600 INFO:teuthology.orchestra.run.smithi177.stdout:Fetched 147 MB in 10s (14.8 MB/s) 2019-12-16T22:41:11.660 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2019-12-16T22:41:11.673 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-librgw2_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:11.710 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:11.740 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-uritemplate. 2019-12-16T22:41:11.780 INFO:teuthology.orchestra.run.smithi177.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101858 files and directories currently installed.) 2019-12-16T22:41:11.782 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../000-python3-uritemplate_0.6-1ubuntu1_all.deb ... 2019-12-16T22:41:11.823 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-uritemplate (0.6-1ubuntu1) ... 2019-12-16T22:41:12.092 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2019-12-16T22:41:12.109 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../001-liblttng-ust0_2.10.1-1_amd64.deb ... 2019-12-16T22:41:12.185 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-16T22:41:12.362 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2019-12-16T22:41:12.373 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-python3-rgw_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:12.412 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:12.549 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../002-librbd1_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:12.671 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librbd1 (15.0.0-8533-g8a58d06-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-16T22:41:12.715 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2019-12-16T22:41:12.728 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2019-12-16T22:41:12.756 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-16T22:41:12.993 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2019-12-16T22:41:13.004 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2019-12-16T22:41:13.043 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2019-12-16T22:41:13.196 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../003-librados2_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:13.301 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librados2 (15.0.0-8533-g8a58d06-1bionic) over (12.2.12-0ubuntu0.18.04.3) ... 2019-12-16T22:41:13.420 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0. 2019-12-16T22:41:13.432 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2019-12-16T22:41:13.470 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0 (2.6.1-1) ... 2019-12-16T22:41:13.782 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2019-12-16T22:41:13.793 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-libradosstriper1_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:13.831 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:13.912 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs2. 2019-12-16T22:41:13.925 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../004-libcephfs2_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:13.962 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:14.201 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2019-12-16T22:41:14.213 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-ceph-common_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:14.239 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rados. 2019-12-16T22:41:14.243 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:14.253 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../005-python3-rados_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:14.289 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rados (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:14.634 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-argparse. 2019-12-16T22:41:14.647 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../006-python3-ceph-argparse_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:14.676 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-argparse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:14.952 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cephfs. 2019-12-16T22:41:14.959 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../007-python3-cephfs_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:14.995 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cephfs (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:15.325 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-ceph-common. 2019-12-16T22:41:15.329 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../008-python3-ceph-common_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:15.364 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:15.701 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-prettytable. 2019-12-16T22:41:15.723 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../009-python3-prettytable_0.7.2-3_all.deb ... 2019-12-16T22:41:15.751 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-prettytable (0.7.2-3) ... 2019-12-16T22:41:15.925 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2019-12-16T22:41:15.935 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-ceph-base_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:15.991 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:15.995 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rbd. 2019-12-16T22:41:16.007 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../010-python3-rbd_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:16.048 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rbd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:16.382 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librabbitmq4:amd64. 2019-12-16T22:41:16.391 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../011-librabbitmq4_0.8.0-1ubuntu0.18.04.2_amd64.deb ... 2019-12-16T22:41:16.431 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2019-12-16T22:41:16.753 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cffi-backend. 2019-12-16T22:41:16.765 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-python3-cffi-backend_1.11.5-1_amd64.deb ... 2019-12-16T22:41:16.769 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librdkafka1:amd64. 2019-12-16T22:41:16.781 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../012-librdkafka1_0.11.3-1build1_amd64.deb ... 2019-12-16T22:41:16.796 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2019-12-16T22:41:16.819 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-16T22:41:17.106 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2019-12-16T22:41:17.114 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package librgw2. 2019-12-16T22:41:17.118 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-python3-bcrypt_3.1.4-2_amd64.deb ... 2019-12-16T22:41:17.124 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../013-librgw2_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:17.155 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking librgw2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:17.156 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2019-12-16T22:41:17.450 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2019-12-16T22:41:17.468 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-python3-cherrypy3_8.9.1-2_all.deb ... 2019-12-16T22:41:17.500 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2019-12-16T22:41:17.774 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rgw. 2019-12-16T22:41:17.786 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../014-python3-rgw_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:17.786 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jwt. 2019-12-16T22:41:17.799 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-python3-jwt_1.5.3+ds1-1_all.deb ... 2019-12-16T22:41:17.824 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:17.837 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2019-12-16T22:41:18.144 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libsnappy1v5:amd64. 2019-12-16T22:41:18.156 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../015-libsnappy1v5_1.1.7-1_amd64.deb ... 2019-12-16T22:41:18.172 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asn1crypto. 2019-12-16T22:41:18.183 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2019-12-16T22:41:18.194 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-16T22:41:18.222 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2019-12-16T22:41:18.463 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libleveldb1v5:amd64. 2019-12-16T22:41:18.472 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../016-libleveldb1v5_1.20-2_amd64.deb ... 2019-12-16T22:41:18.505 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libleveldb1v5:amd64 (1.20-2) ... 2019-12-16T22:41:18.775 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cryptography. 2019-12-16T22:41:18.788 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2019-12-16T22:41:18.825 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2019-12-16T22:41:18.883 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package liboath0. 2019-12-16T22:41:18.895 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../017-liboath0_2.6.1-1_amd64.deb ... 2019-12-16T22:41:18.937 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking liboath0 (2.6.1-1) ... 2019-12-16T22:41:19.187 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2019-12-16T22:41:19.198 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2019-12-16T22:41:19.254 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2019-12-16T22:41:19.260 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libradosstriper1. 2019-12-16T22:41:19.272 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../018-libradosstriper1_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:19.310 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libradosstriper1 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:19.565 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2019-12-16T22:41:19.577 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-5_all.deb ... 2019-12-16T22:41:19.614 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-5) ... 2019-12-16T22:41:19.714 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-common. 2019-12-16T22:41:19.730 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../019-ceph-common_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:19.756 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:19.876 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2019-12-16T22:41:19.893 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-python3-markupsafe_1.0-1build1_amd64.deb ... 2019-12-16T22:41:19.917 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2019-12-16T22:41:20.214 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2019-12-16T22:41:20.224 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-python3-mako_1.0.7+ds1-1_all.deb ... 2019-12-16T22:41:20.262 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2019-12-16T22:41:20.598 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2019-12-16T22:41:20.609 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-1_all.deb ... 2019-12-16T22:41:20.648 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2019-12-16T22:41:20.960 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2019-12-16T22:41:20.972 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2_all.deb ... 2019-12-16T22:41:21.012 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2019-12-16T22:41:21.318 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2019-12-16T22:41:21.320 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2019-12-16T22:41:21.359 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2019-12-16T22:41:21.437 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-base. 2019-12-16T22:41:21.449 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../020-ceph-base_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:21.496 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-base (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:21.688 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bs4. 2019-12-16T22:41:21.697 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-bs4_4.6.0-1_all.deb ... 2019-12-16T22:41:21.737 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2019-12-16T22:41:22.023 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2019-12-16T22:41:22.041 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-waitress_1.0.1-1_all.deb ... 2019-12-16T22:41:22.075 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.0.1-1) ... 2019-12-16T22:41:22.283 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cffi-backend. 2019-12-16T22:41:22.295 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../021-python3-cffi-backend_1.11.5-1_amd64.deb ... 2019-12-16T22:41:22.352 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2019-12-16T22:41:22.365 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-2_all.deb ... 2019-12-16T22:41:22.400 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-2) ... 2019-12-16T22:41:22.566 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cffi-backend (1.11.5-1) ... 2019-12-16T22:41:22.709 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2019-12-16T22:41:22.721 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2019-12-16T22:41:22.772 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-16T22:41:22.936 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bcrypt. 2019-12-16T22:41:22.946 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../022-python3-bcrypt_3.1.4-2_amd64.deb ... 2019-12-16T22:41:22.986 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bcrypt (3.1.4-2) ... 2019-12-16T22:41:23.084 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2019-12-16T22:41:23.104 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2019-12-16T22:41:23.143 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2019-12-16T22:41:23.288 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cherrypy3. 2019-12-16T22:41:23.300 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../023-python3-cherrypy3_8.9.1-2_all.deb ... 2019-12-16T22:41:23.338 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cherrypy3 (8.9.1-2) ... 2019-12-16T22:41:23.434 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2019-12-16T22:41:23.446 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-pastedeploy_1.5.2-4_all.deb ... 2019-12-16T22:41:23.484 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2019-12-16T22:41:23.693 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-jwt. 2019-12-16T22:41:23.704 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../024-python3-jwt_1.5.3+ds1-1_all.deb ... 2019-12-16T22:41:23.742 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-jwt (1.5.3+ds1-1) ... 2019-12-16T22:41:23.805 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2019-12-16T22:41:23.817 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2019-12-16T22:41:23.855 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2019-12-16T22:41:24.003 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-asn1crypto. 2019-12-16T22:41:24.021 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../025-python3-asn1crypto_0.24.0-1_all.deb ... 2019-12-16T22:41:24.046 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-asn1crypto (0.24.0-1) ... 2019-12-16T22:41:24.230 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2019-12-16T22:41:24.249 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python3-pecan_1.2.1-2_all.deb ... 2019-12-16T22:41:24.280 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.2.1-2) ... 2019-12-16T22:41:24.364 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cryptography. 2019-12-16T22:41:24.377 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../026-python3-cryptography_2.1.4-1ubuntu1.3_amd64.deb ... 2019-12-16T22:41:24.416 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cryptography (2.1.4-1ubuntu1.3) ... 2019-12-16T22:41:24.628 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2019-12-16T22:41:24.639 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2019-12-16T22:41:24.669 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2019-12-16T22:41:24.784 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-openssl. 2019-12-16T22:41:24.796 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../027-python3-openssl_17.5.0-1ubuntu1_all.deb ... 2019-12-16T22:41:24.843 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-openssl (17.5.0-1ubuntu1) ... 2019-12-16T22:41:25.031 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2019-12-16T22:41:25.043 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-ceph-mgr_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:25.073 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:25.104 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-logutils. 2019-12-16T22:41:25.116 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../028-python3-logutils_0.3.3-5_all.deb ... 2019-12-16T22:41:25.150 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-logutils (0.3.3-5) ... 2019-12-16T22:41:25.448 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-markupsafe. 2019-12-16T22:41:25.461 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../029-python3-markupsafe_1.0-1build1_amd64.deb ... 2019-12-16T22:41:25.498 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-markupsafe (1.0-1build1) ... 2019-12-16T22:41:25.568 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2019-12-16T22:41:25.580 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-ceph-mon_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:25.617 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:25.820 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-mako. 2019-12-16T22:41:25.831 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../030-python3-mako_1.0.7+ds1-1_all.deb ... 2019-12-16T22:41:25.868 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-mako (1.0.7+ds1-1) ... 2019-12-16T22:41:26.196 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplegeneric. 2019-12-16T22:41:26.208 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../031-python3-simplegeneric_0.8.1-1_all.deb ... 2019-12-16T22:41:26.246 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplegeneric (0.8.1-1) ... 2019-12-16T22:41:26.475 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2019-12-16T22:41:26.485 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-ceph-osd_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:26.507 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-singledispatch. 2019-12-16T22:41:26.512 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:26.519 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../032-python3-singledispatch_3.4.0.3-2_all.deb ... 2019-12-16T22:41:26.549 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-singledispatch (3.4.0.3-2) ... 2019-12-16T22:41:26.834 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webob. 2019-12-16T22:41:26.844 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../033-python3-webob_1%3a1.7.3-2fakesync1_all.deb ... 2019-12-16T22:41:26.883 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webob (1:1.7.3-2fakesync1) ... 2019-12-16T22:41:27.193 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-bs4. 2019-12-16T22:41:27.204 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../034-python3-bs4_4.6.0-1_all.deb ... 2019-12-16T22:41:27.235 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-bs4 (4.6.0-1) ... 2019-12-16T22:41:27.575 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-waitress. 2019-12-16T22:41:27.587 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../035-python3-waitress_1.0.1-1_all.deb ... 2019-12-16T22:41:27.626 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-waitress (1.0.1-1) ... 2019-12-16T22:41:27.908 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tempita. 2019-12-16T22:41:27.921 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../036-python3-tempita_0.5.2-2_all.deb ... 2019-12-16T22:41:27.958 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tempita (0.5.2-2) ... 2019-12-16T22:41:28.249 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-paste. 2019-12-16T22:41:28.261 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../037-python3-paste_2.0.3+dfsg-4ubuntu1_all.deb ... 2019-12-16T22:41:28.296 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-16T22:41:28.367 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2019-12-16T22:41:28.379 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-ceph_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:28.417 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:28.625 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2019-12-16T22:41:28.635 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../038-python-pastedeploy-tpl_1.5.2-4_all.deb ... 2019-12-16T22:41:28.675 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pastedeploy-tpl (1.5.2-4) ... 2019-12-16T22:41:28.825 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2019-12-16T22:41:28.839 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-ceph-fuse_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:28.870 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:28.968 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastedeploy. 2019-12-16T22:41:28.979 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../039-python3-pastedeploy_1.5.2-4_all.deb ... 2019-12-16T22:41:29.038 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastedeploy (1.5.2-4) ... 2019-12-16T22:41:29.241 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2019-12-16T22:41:29.252 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-ceph-mds_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:29.290 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:29.352 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webtest. 2019-12-16T22:41:29.364 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../040-python3-webtest_2.0.28-1ubuntu1_all.deb ... 2019-12-16T22:41:29.402 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webtest (2.0.28-1ubuntu1) ... 2019-12-16T22:41:29.734 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pecan. 2019-12-16T22:41:29.747 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../041-python3-pecan_1.2.1-2_all.deb ... 2019-12-16T22:41:29.784 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pecan (1.2.1-2) ... 2019-12-16T22:41:29.785 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2019-12-16T22:41:29.796 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-cephadm_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:29.835 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:30.119 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-werkzeug. 2019-12-16T22:41:30.121 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2019-12-16T22:41:30.132 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../042-python3-werkzeug_0.14.1+dfsg1-1_all.deb ... 2019-12-16T22:41:30.134 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-ceph-mgr-cephadm_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:30.162 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:30.172 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-werkzeug (0.14.1+dfsg1-1) ... 2019-12-16T22:41:30.465 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2019-12-16T22:41:30.477 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-python3-repoze.lru_0.7-1_all.deb ... 2019-12-16T22:41:30.520 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2019-12-16T22:41:30.535 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr. 2019-12-16T22:41:30.546 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../043-ceph-mgr_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:30.585 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:30.803 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2019-12-16T22:41:30.821 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-python3-routes_2.4.1-1_all.deb ... 2019-12-16T22:41:30.858 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.4.1-1) ... 2019-12-16T22:41:31.037 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mon. 2019-12-16T22:41:31.050 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../044-ceph-mon_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:31.095 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mon (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:31.174 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2019-12-16T22:41:31.183 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-ceph-mgr-dashboard_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:31.221 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:32.007 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-osd. 2019-12-16T22:41:32.021 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../045-ceph-osd_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:32.053 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2019-12-16T22:41:32.057 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-osd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:32.065 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-ceph-mgr-diskprediction-cloud_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:32.103 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:32.439 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-numpy. 2019-12-16T22:41:32.453 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2019-12-16T22:41:32.489 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2019-12-16T22:41:33.041 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-decorator. 2019-12-16T22:41:33.051 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-python3-decorator_4.1.2-1_all.deb ... 2019-12-16T22:41:33.095 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-decorator (4.1.2-1) ... 2019-12-16T22:41:33.399 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-scipy. 2019-12-16T22:41:33.410 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2019-12-16T22:41:33.465 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2019-12-16T22:41:34.161 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph. 2019-12-16T22:41:34.181 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../046-ceph_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:34.211 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:34.531 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-fuse. 2019-12-16T22:41:34.543 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../047-ceph-fuse_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:34.581 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:34.934 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mds. 2019-12-16T22:41:34.946 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../048-ceph-mds_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:34.984 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mds (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:35.206 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib. 2019-12-16T22:41:35.217 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2019-12-16T22:41:35.256 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2019-12-16T22:41:35.478 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package cephadm. 2019-12-16T22:41:35.489 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../049-cephadm_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:35.537 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:35.701 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2019-12-16T22:41:35.712 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-python3-joblib_0.11-1_all.deb ... 2019-12-16T22:41:35.751 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.11-1) ... 2019-12-16T22:41:35.848 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2019-12-16T22:41:35.861 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../050-ceph-mgr-cephadm_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:35.898 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:36.113 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2019-12-16T22:41:36.125 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-python3-sklearn_0.19.1-3_all.deb ... 2019-12-16T22:41:36.163 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2019-12-16T22:41:36.200 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-repoze.lru. 2019-12-16T22:41:36.212 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../051-python3-repoze.lru_0.7-1_all.deb ... 2019-12-16T22:41:36.250 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-repoze.lru (0.7-1) ... 2019-12-16T22:41:36.494 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-routes. 2019-12-16T22:41:36.506 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../052-python3-routes_2.4.1-1_all.deb ... 2019-12-16T22:41:36.536 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-routes (2.4.1-1) ... 2019-12-16T22:41:36.669 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2019-12-16T22:41:36.682 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-ceph-mgr-diskprediction-local_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:36.728 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:36.839 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2019-12-16T22:41:36.850 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../053-ceph-mgr-dashboard_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:36.889 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-dashboard (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:37.703 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2019-12-16T22:41:37.717 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../054-ceph-mgr-diskprediction-cloud_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:37.761 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:37.823 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-dateutil. 2019-12-16T22:41:37.834 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-python3-dateutil_2.6.1-1_all.deb ... 2019-12-16T22:41:37.872 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2019-12-16T22:41:38.065 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-numpy. 2019-12-16T22:41:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../055-python3-numpy_1%3a1.13.3-2ubuntu1_amd64.deb ... 2019-12-16T22:41:38.114 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-numpy (1:1.13.3-2ubuntu1) ... 2019-12-16T22:41:38.217 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-monotonic. 2019-12-16T22:41:38.229 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-python3-monotonic_1.1-2_all.deb ... 2019-12-16T22:41:38.267 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-monotonic (1.1-2) ... 2019-12-16T22:41:38.566 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-fasteners. 2019-12-16T22:41:38.575 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-python3-fasteners_0.12.0-3_all.deb ... 2019-12-16T22:41:38.620 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2019-12-16T22:41:38.672 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-decorator. 2019-12-16T22:41:38.681 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../056-python3-decorator_4.1.2-1_all.deb ... 2019-12-16T22:41:38.720 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-decorator (4.1.2-1) ... 2019-12-16T22:41:38.881 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-httplib2. 2019-12-16T22:41:38.893 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2019-12-16T22:41:38.922 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-16T22:41:39.040 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-scipy. 2019-12-16T22:41:39.053 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../057-python3-scipy_0.19.1-2ubuntu1_amd64.deb ... 2019-12-16T22:41:39.104 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-scipy (0.19.1-2ubuntu1) ... 2019-12-16T22:41:39.259 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2019-12-16T22:41:39.271 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-python3-pyasn1_0.4.2-3_all.deb ... 2019-12-16T22:41:39.309 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2019-12-16T22:41:39.671 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2019-12-16T22:41:39.684 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2019-12-16T22:41:39.730 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2019-12-16T22:41:40.041 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2019-12-16T22:41:40.054 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-python3-rsa_3.4.2-1_all.deb ... 2019-12-16T22:41:40.098 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (3.4.2-1) ... 2019-12-16T22:41:40.216 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn-lib. 2019-12-16T22:41:40.227 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../058-python3-sklearn-lib_0.19.1-3_amd64.deb ... 2019-12-16T22:41:40.272 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn-lib (0.19.1-3) ... 2019-12-16T22:41:40.405 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sqlalchemy. 2019-12-16T22:41:40.414 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2019-12-16T22:41:40.451 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-16T22:41:40.650 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-joblib. 2019-12-16T22:41:40.664 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../059-python3-joblib_0.11-1_all.deb ... 2019-12-16T22:41:40.700 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-joblib (0.11-1) ... 2019-12-16T22:41:40.914 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-oauth2client. 2019-12-16T22:41:40.926 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-python3-oauth2client_4.1.2-3_all.deb ... 2019-12-16T22:41:40.964 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2019-12-16T22:41:41.019 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sklearn. 2019-12-16T22:41:41.033 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../060-python3-sklearn_0.19.1-3_all.deb ... 2019-12-16T22:41:41.079 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sklearn (0.19.1-3) ... 2019-12-16T22:41:41.301 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-setuptools. 2019-12-16T22:41:41.313 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-python3-setuptools_39.0.1-2_all.deb ... 2019-12-16T22:41:41.350 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2019-12-16T22:41:41.609 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2019-12-16T22:41:41.621 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../061-ceph-mgr-diskprediction-local_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:41.659 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-diskprediction-local (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:41.758 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2019-12-16T22:41:41.768 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2019-12-16T22:41:41.804 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2019-12-16T22:41:42.116 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2019-12-16T22:41:42.129 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2019-12-16T22:41:42.166 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2019-12-16T22:41:42.561 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2019-12-16T22:41:42.575 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-ceph-mgr-k8sevents_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:42.619 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:42.762 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-dateutil. 2019-12-16T22:41:42.776 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../062-python3-dateutil_2.6.1-1_all.deb ... 2019-12-16T22:41:42.887 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-dateutil (2.6.1-1) ... 2019-12-16T22:41:42.941 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-rook. 2019-12-16T22:41:42.953 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-ceph-mgr-rook_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:42.991 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-rook (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:43.215 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-monotonic. 2019-12-16T22:41:43.228 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../063-python3-monotonic_1.1-2_all.deb ... 2019-12-16T22:41:43.265 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-monotonic (1.1-2) ... 2019-12-16T22:41:43.302 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig4:amd64. 2019-12-16T22:41:43.315 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-libonig4_6.7.0-1_amd64.deb ... 2019-12-16T22:41:43.360 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2019-12-16T22:41:43.542 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-fasteners. 2019-12-16T22:41:43.554 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../064-python3-fasteners_0.12.0-3_all.deb ... 2019-12-16T22:41:43.592 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-fasteners (0.12.0-3) ... 2019-12-16T22:41:43.680 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2019-12-16T22:41:43.702 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-libjq1_1.5+dfsg-2_amd64.deb ... 2019-12-16T22:41:43.730 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2019-12-16T22:41:43.870 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-httplib2. 2019-12-16T22:41:43.884 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../065-python3-httplib2_0.9.2+dfsg-1ubuntu0.1_all.deb ... 2019-12-16T22:41:43.928 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-16T22:41:43.999 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2019-12-16T22:41:44.012 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-jq_1.5+dfsg-2_amd64.deb ... 2019-12-16T22:41:44.049 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.5+dfsg-2) ... 2019-12-16T22:41:44.231 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1. 2019-12-16T22:41:44.244 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../066-python3-pyasn1_0.4.2-3_all.deb ... 2019-12-16T22:41:44.281 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1 (0.4.2-3) ... 2019-12-16T22:41:44.327 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2019-12-16T22:41:44.340 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2019-12-16T22:41:44.377 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2019-12-16T22:41:44.592 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyasn1-modules. 2019-12-16T22:41:44.605 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../067-python3-pyasn1-modules_0.2.1-0.2_all.deb ... 2019-12-16T22:41:44.642 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2) ... 2019-12-16T22:41:44.755 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libxslt1.1:amd64. 2019-12-16T22:41:44.768 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2019-12-16T22:41:44.900 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-16T22:41:44.953 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-rsa. 2019-12-16T22:41:44.966 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../068-python3-rsa_3.4.2-1_all.deb ... 2019-12-16T22:41:45.003 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-rsa (3.4.2-1) ... 2019-12-16T22:41:45.181 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2019-12-16T22:41:45.187 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-xmlstarlet_1.6.1-2_amd64.deb ... 2019-12-16T22:41:45.227 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2019-12-16T22:41:45.315 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-sqlalchemy. 2019-12-16T22:41:45.328 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../069-python3-sqlalchemy_1.1.11+ds1-1ubuntu1_all.deb ... 2019-12-16T22:41:45.365 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-16T22:41:45.611 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2019-12-16T22:41:45.611 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-ceph-test_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:45.660 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:45.762 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-oauth2client. 2019-12-16T22:41:45.772 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../070-python3-oauth2client_4.1.2-3_all.deb ... 2019-12-16T22:41:45.802 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-oauth2client (4.1.2-3) ... 2019-12-16T22:41:46.189 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-setuptools. 2019-12-16T22:41:46.201 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../071-python3-setuptools_39.0.1-2_all.deb ... 2019-12-16T22:41:46.241 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-setuptools (39.0.1-2) ... 2019-12-16T22:41:46.609 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-websocket. 2019-12-16T22:41:46.622 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../072-python3-websocket_0.44.0-0ubuntu2_all.deb ... 2019-12-16T22:41:46.658 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-websocket (0.44.0-0ubuntu2) ... 2019-12-16T22:41:46.971 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-kubernetes. 2019-12-16T22:41:46.984 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../073-python3-kubernetes_2.0.0-2ubuntu1_all.deb ... 2019-12-16T22:41:47.031 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-kubernetes (2.0.0-2ubuntu1) ... 2019-12-16T22:41:47.407 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2019-12-16T22:41:47.421 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../074-ceph-mgr-k8sevents_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:47.457 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-k8sevents (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:47.751 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-mgr-rook. 2019-12-16T22:41:47.763 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../075-ceph-mgr-rook_15.0.0-8533-g8a58d06-1bionic_all.deb ... 2019-12-16T22:41:47.801 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-mgr-rook (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:48.128 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libonig4:amd64. 2019-12-16T22:41:48.141 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../076-libonig4_6.7.0-1_amd64.deb ... 2019-12-16T22:41:48.178 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libonig4:amd64 (6.7.0-1) ... 2019-12-16T22:41:48.445 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2019-12-16T22:41:48.462 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-libcephfs-dev_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:48.493 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:48.532 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libjq1:amd64. 2019-12-16T22:41:48.544 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../077-libjq1_1.5+dfsg-2_amd64.deb ... 2019-12-16T22:41:48.587 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libjq1:amd64 (1.5+dfsg-2) ... 2019-12-16T22:41:48.829 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-attr. 2019-12-16T22:41:48.834 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package jq. 2019-12-16T22:41:48.842 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-python-attr_17.4.0-2_all.deb ... 2019-12-16T22:41:48.847 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../078-jq_1.5+dfsg-2_amd64.deb ... 2019-12-16T22:41:48.883 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-attr (17.4.0-2) ... 2019-12-16T22:41:48.884 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking jq (1.5+dfsg-2) ... 2019-12-16T22:41:49.157 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-funcsigs. 2019-12-16T22:41:49.161 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package socat. 2019-12-16T22:41:49.171 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-python-funcsigs_1.0.2-4_all.deb ... 2019-12-16T22:41:49.175 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../079-socat_1.7.3.2-2ubuntu2_amd64.deb ... 2019-12-16T22:41:49.207 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2019-12-16T22:41:49.211 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking socat (1.7.3.2-2ubuntu2) ... 2019-12-16T22:41:49.573 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libxslt1.1:amd64. 2019-12-16T22:41:49.586 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../080-libxslt1.1_1.1.29-5ubuntu0.2_amd64.deb ... 2019-12-16T22:41:49.685 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pluggy. 2019-12-16T22:41:49.701 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-python-pluggy_0.6.0-1_all.deb ... 2019-12-16T22:41:49.725 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-16T22:41:49.745 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pluggy (0.6.0-1) ... 2019-12-16T22:41:49.994 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package xmlstarlet. 2019-12-16T22:41:50.006 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../081-xmlstarlet_1.6.1-2_amd64.deb ... 2019-12-16T22:41:50.044 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking xmlstarlet (1.6.1-2) ... 2019-12-16T22:41:50.071 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-py. 2019-12-16T22:41:50.082 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-python-py_1.5.2-1_all.deb ... 2019-12-16T22:41:50.121 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-py (1.5.2-1) ... 2019-12-16T22:41:50.348 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package ceph-test. 2019-12-16T22:41:50.360 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../082-ceph-test_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:50.398 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking ceph-test (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:50.441 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pytest. 2019-12-16T22:41:50.454 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-python-pytest_3.3.2-2_all.deb ... 2019-12-16T22:41:50.491 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pytest (3.3.2-2) ... 2019-12-16T22:41:50.836 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-attr. 2019-12-16T22:41:50.847 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-python3-attr_17.4.0-2_all.deb ... 2019-12-16T22:41:50.886 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-attr (17.4.0-2) ... 2019-12-16T22:41:51.214 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cycler. 2019-12-16T22:41:51.227 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-python3-cycler_0.10.0-1_all.deb ... 2019-12-16T22:41:51.264 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cycler (0.10.0-1) ... 2019-12-16T22:41:51.519 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webencodings. 2019-12-16T22:41:51.530 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-python3-webencodings_0.5-2_all.deb ... 2019-12-16T22:41:51.575 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webencodings (0.5-2) ... 2019-12-16T22:41:51.878 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-html5lib. 2019-12-16T22:41:51.891 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-python3-html5lib_0.999999999-1_all.deb ... 2019-12-16T22:41:51.936 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2019-12-16T22:41:52.281 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-lxml:amd64. 2019-12-16T22:41:52.293 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2019-12-16T22:41:52.331 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-16T22:41:52.792 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyparsing. 2019-12-16T22:41:52.805 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2019-12-16T22:41:52.843 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-16T22:41:53.155 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tz. 2019-12-16T22:41:53.167 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-python3-tz_2018.3-2_all.deb ... 2019-12-16T22:41:53.212 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tz (2018.3-2) ... 2019-12-16T22:41:53.452 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package libcephfs-dev. 2019-12-16T22:41:53.463 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../083-libcephfs-dev_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:53.482 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-matplotlib. 2019-12-16T22:41:53.495 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2019-12-16T22:41:53.502 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking libcephfs-dev (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:53.549 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2019-12-16T22:41:53.796 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-attr. 2019-12-16T22:41:53.809 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../084-python-attr_17.4.0-2_all.deb ... 2019-12-16T22:41:53.846 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-attr (17.4.0-2) ... 2019-12-16T22:41:54.107 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-funcsigs. 2019-12-16T22:41:54.118 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../085-python-funcsigs_1.0.2-4_all.deb ... 2019-12-16T22:41:54.149 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-funcsigs (1.0.2-4) ... 2019-12-16T22:41:54.204 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-nose. 2019-12-16T22:41:54.217 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-python3-nose_1.3.7-3_all.deb ... 2019-12-16T22:41:54.253 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-nose (1.3.7-3) ... 2019-12-16T22:41:54.451 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pluggy. 2019-12-16T22:41:54.464 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../086-python-pluggy_0.6.0-1_all.deb ... 2019-12-16T22:41:54.501 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pluggy (0.6.0-1) ... 2019-12-16T22:41:54.599 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-olefile. 2019-12-16T22:41:54.620 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-python3-olefile_0.45.1-1_all.deb ... 2019-12-16T22:41:54.649 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-olefile (0.45.1-1) ... 2019-12-16T22:41:54.787 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-py. 2019-12-16T22:41:54.801 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../087-python-py_1.5.2-1_all.deb ... 2019-12-16T22:41:54.845 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-py (1.5.2-1) ... 2019-12-16T22:41:54.935 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2019-12-16T22:41:54.948 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-2_all.deb ... 2019-12-16T22:41:54.985 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2019-12-16T22:41:55.174 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python-pytest. 2019-12-16T22:41:55.189 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../088-python-pytest_3.3.2-2_all.deb ... 2019-12-16T22:41:55.223 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python-pytest (3.3.2-2) ... 2019-12-16T22:41:55.338 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pil:amd64. 2019-12-16T22:41:55.352 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-python3-pil_5.1.0-1_amd64.deb ... 2019-12-16T22:41:55.397 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pil:amd64 (5.1.0-1) ... 2019-12-16T22:41:55.566 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-attr. 2019-12-16T22:41:55.572 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../089-python3-attr_17.4.0-2_all.deb ... 2019-12-16T22:41:55.627 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-attr (17.4.0-2) ... 2019-12-16T22:41:55.758 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2019-12-16T22:41:55.772 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-python3-pluggy_0.6.0-1_all.deb ... 2019-12-16T22:41:55.808 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2019-12-16T22:41:55.929 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-cycler. 2019-12-16T22:41:55.953 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../090-python3-cycler_0.10.0-1_all.deb ... 2019-12-16T22:41:55.979 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-cycler (0.10.0-1) ... 2019-12-16T22:41:56.119 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2019-12-16T22:41:56.134 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-python3-py_1.5.2-1_all.deb ... 2019-12-16T22:41:56.171 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.5.2-1) ... 2019-12-16T22:41:56.257 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-webencodings. 2019-12-16T22:41:56.269 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../091-python3-webencodings_0.5-2_all.deb ... 2019-12-16T22:41:56.307 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-webencodings (0.5-2) ... 2019-12-16T22:41:56.431 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2019-12-16T22:41:56.443 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1_all.deb ... 2019-12-16T22:41:56.472 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2019-12-16T22:41:56.614 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-html5lib. 2019-12-16T22:41:56.623 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../092-python3-html5lib_0.999999999-1_all.deb ... 2019-12-16T22:41:56.659 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-html5lib (0.999999999-1) ... 2019-12-16T22:41:56.776 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2019-12-16T22:41:56.787 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-python3-pytest_3.3.2-2_all.deb ... 2019-12-16T22:41:56.825 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (3.3.2-2) ... 2019-12-16T22:41:56.988 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-lxml:amd64. 2019-12-16T22:41:57.000 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../093-python3-lxml_4.2.1-1ubuntu0.1_amd64.deb ... 2019-12-16T22:41:57.038 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-16T22:41:57.189 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2019-12-16T22:41:57.199 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-python3-simplejson_3.13.2-1_amd64.deb ... 2019-12-16T22:41:57.237 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2019-12-16T22:41:57.474 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyparsing. 2019-12-16T22:41:57.487 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../094-python3-pyparsing_2.2.0+dfsg1-2_all.deb ... 2019-12-16T22:41:57.524 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-16T22:41:57.582 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tk:amd64. 2019-12-16T22:41:57.594 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-python3-tk_3.6.9-1~18.04_amd64.deb ... 2019-12-16T22:41:57.632 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2019-12-16T22:41:57.802 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tz. 2019-12-16T22:41:57.815 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../095-python3-tz_2018.3-2_all.deb ... 2019-12-16T22:41:57.843 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tz (2018.3-2) ... 2019-12-16T22:41:58.010 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2019-12-16T22:41:58.024 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-radosgw_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:58.068 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:58.147 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-matplotlib. 2019-12-16T22:41:58.159 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../096-python3-matplotlib_2.1.1-2ubuntu3_amd64.deb ... 2019-12-16T22:41:58.196 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-matplotlib (2.1.1-2ubuntu3) ... 2019-12-16T22:41:58.730 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2019-12-16T22:41:58.742 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-rbd-fuse_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:58.780 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:58.835 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-nose. 2019-12-16T22:41:58.847 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../097-python3-nose_1.3.7-3_all.deb ... 2019-12-16T22:41:58.881 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-nose (1.3.7-3) ... 2019-12-16T22:41:59.133 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-mirror. 2019-12-16T22:41:59.145 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-rbd-mirror_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:41:59.183 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-mirror (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:41:59.213 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-olefile. 2019-12-16T22:41:59.227 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../098-python3-olefile_0.45.1-1_all.deb ... 2019-12-16T22:41:59.265 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-olefile (0.45.1-1) ... 2019-12-16T22:41:59.566 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pastescript. 2019-12-16T22:41:59.579 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-2_all.deb ... 2019-12-16T22:41:59.615 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pastescript (2.0.2-2) ... 2019-12-16T22:41:59.719 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-5) ... 2019-12-16T22:41:59.952 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pil:amd64. 2019-12-16T22:41:59.964 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../100-python3-pil_5.1.0-1_amd64.deb ... 2019-12-16T22:42:00.002 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pil:amd64 (5.1.0-1) ... 2019-12-16T22:42:00.004 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2019-12-16T22:42:00.372 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pluggy. 2019-12-16T22:42:00.383 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-16T22:42:00.386 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../101-python3-pluggy_0.6.0-1_all.deb ... 2019-12-16T22:42:00.413 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pluggy (0.6.0-1) ... 2019-12-16T22:42:00.507 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-16T22:42:00.700 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-py. 2019-12-16T22:42:00.713 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../102-python3-py_1.5.2-1_all.deb ... 2019-12-16T22:42:00.750 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-py (1.5.2-1) ... 2019-12-16T22:42:01.069 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pyinotify. 2019-12-16T22:42:01.082 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1_all.deb ... 2019-12-16T22:42:01.118 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pil:amd64 (5.1.0-1) ... 2019-12-16T22:42:01.119 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pyinotify (0.9.6-1) ... 2019-12-16T22:42:01.430 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-pytest. 2019-12-16T22:42:01.443 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../104-python3-pytest_3.3.2-2_all.deb ... 2019-12-16T22:42:01.480 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-pytest (3.3.2-2) ... 2019-12-16T22:42:01.495 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2019-12-16T22:42:01.783 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-simplejson. 2019-12-16T22:42:01.796 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webencodings (0.5-2) ... 2019-12-16T22:42:01.797 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../105-python3-simplejson_3.13.2-1_amd64.deb ... 2019-12-16T22:42:01.841 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-simplejson (3.13.2-1) ... 2019-12-16T22:42:02.105 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-attr (17.4.0-2) ... 2019-12-16T22:42:02.178 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package python3-tk:amd64. 2019-12-16T22:42:02.189 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../106-python3-tk_3.6.9-1~18.04_amd64.deb ... 2019-12-16T22:42:02.228 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking python3-tk:amd64 (3.6.9-1~18.04) ... 2019-12-16T22:42:02.316 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2019-12-16T22:42:02.441 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.5.2-1) ... 2019-12-16T22:42:02.665 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package radosgw. 2019-12-16T22:42:02.677 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../107-radosgw_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:42:02.720 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking radosgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:02.801 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.0.1-1) ... 2019-12-16T22:42:03.215 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2019-12-16T22:42:03.376 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package rbd-fuse. 2019-12-16T22:42:03.387 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../108-rbd-fuse_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:42:03.417 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking rbd-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:03.504 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-olefile (0.45.1-1) ... 2019-12-16T22:42:03.720 INFO:teuthology.orchestra.run.smithi177.stdout:Selecting previously unselected package rbd-mirror. 2019-12-16T22:42:03.734 INFO:teuthology.orchestra.run.smithi177.stdout:Preparing to unpack .../109-rbd-mirror_15.0.0-8533-g8a58d06-1bionic_amd64.deb ... 2019-12-16T22:42:03.778 INFO:teuthology.orchestra.run.smithi177.stdout:Unpacking rbd-mirror (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:03.789 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:04.103 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-2) ... 2019-12-16T22:42:04.297 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-logutils (0.3.3-5) ... 2019-12-16T22:42:04.416 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2019-12-16T22:42:04.542 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2019-12-16T22:42:04.583 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-werkzeug (0.14.1+dfsg1-1) ... 2019-12-16T22:42:04.929 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librdkafka1:amd64 (0.11.3-1build1) ... 2019-12-16T22:42:05.027 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sqlalchemy (1.1.11+ds1-1ubuntu1) ... 2019-12-16T22:42:05.485 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2019-12-16T22:42:05.647 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pil:amd64 (5.1.0-1) ... 2019-12-16T22:42:05.788 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2019-12-16T22:42:06.031 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplegeneric (0.8.1-1) ... 2019-12-16T22:42:06.073 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-py (1.5.2-1) ... 2019-12-16T22:42:06.299 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.13.2-1) ... 2019-12-16T22:42:06.316 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webencodings (0.5-2) ... 2019-12-16T22:42:06.600 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-attr (17.4.0-2) ... 2019-12-16T22:42:06.650 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2019-12-16T22:42:06.776 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cffi-backend (1.11.5-1) ... 2019-12-16T22:42:06.777 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pluggy (0.6.0-1) ... 2019-12-16T22:42:06.885 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-py (1.5.2-1) ... 2019-12-16T22:42:06.978 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2019-12-16T22:42:07.195 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-waitress (1.0.1-1) ... 2019-12-16T22:42:07.262 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-16T22:42:07.537 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/waitress-serve-python3 to provide /usr/bin/waitress-serve (waitress-serve) in auto mode 2019-12-16T22:42:07.555 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cycler (0.10.0-1) ... 2019-12-16T22:42:07.848 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-olefile (0.45.1-1) ... 2019-12-16T22:42:07.865 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2019-12-16T22:42:08.141 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-argparse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:08.216 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bs4 (4.6.0-1) ... 2019-12-16T22:42:08.442 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tempita (0.5.2-2) ... 2019-12-16T22:42:08.559 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.6.0-1) ... 2019-12-16T22:42:08.726 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up socat (1.7.3.2-2ubuntu2) ... 2019-12-16T22:42:08.828 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-numpy (1:1.13.3-2ubuntu1) ... 2019-12-16T22:42:08.860 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:09.528 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2019-12-16T22:42:09.728 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2019-12-16T22:42:09.763 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webob (1:1.7.3-2fakesync1) ... 2019-12-16T22:42:10.077 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-16T22:42:10.081 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bcrypt (3.1.4-2) ... 2019-12-16T22:42:10.228 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2019-12-16T22:42:10.376 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-py (1.5.2-1) ... 2019-12-16T22:42:10.571 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (0.7.2-3) ... 2019-12-16T22:42:10.608 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-simplejson (3.13.2-1) ... 2019-12-16T22:42:10.872 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2019-12-16T22:42:10.918 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libonig4:amd64 (6.7.0-1) ... 2019-12-16T22:42:10.998 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2019-12-16T22:42:11.021 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pluggy (0.6.0-1) ... 2019-12-16T22:42:11.212 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-singledispatch (3.4.0.3-2) ... 2019-12-16T22:42:11.350 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:11.496 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyparsing (2.2.0+dfsg1-2) ... 2019-12-16T22:42:11.651 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-monotonic (1.1-2) ... 2019-12-16T22:42:11.821 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cycler (0.10.0-1) ... 2019-12-16T22:42:11.935 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-nose (1.3.7-3) ... 2019-12-16T22:42:12.115 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cherrypy3 (8.9.1-2) ... 2019-12-16T22:42:12.295 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-16T22:42:12.413 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-html5lib (0.999999999-1) ... 2019-12-16T22:42:12.466 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-bs4 (4.6.0-1) ... 2019-12-16T22:42:12.781 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-1) ... 2019-12-16T22:42:12.784 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pluggy (0.6.0-1) ... 2019-12-16T22:42:13.069 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:13.082 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-16T22:42:13.375 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2019-12-16T22:42:13.713 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user cephadm....done 2019-12-16T22:42:13.718 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-attr (17.4.0-2) ... 2019-12-16T22:42:13.844 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-markupsafe (1.0-1build1) ... 2019-12-16T22:42:14.011 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-funcsigs (1.0.2-4) ... 2019-12-16T22:42:14.128 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libxslt1.1:amd64 (1.1.29-5ubuntu0.2) ... 2019-12-16T22:42:14.204 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-16T22:42:14.254 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-asn1crypto (0.24.0-1) ... 2019-12-16T22:42:14.597 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-prettytable (0.7.2-3) ... 2019-12-16T22:42:14.606 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2019-12-16T22:42:14.695 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2019-12-16T22:42:14.898 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libjq1:amd64 (1.5+dfsg-2) ... 2019-12-16T22:42:14.933 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0 (2.6.1-1) ... 2019-12-16T22:42:15.024 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1 (0.4.2-3) ... 2019-12-16T22:42:15.109 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2019-12-16T22:42:15.235 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2019-12-16T22:42:15.350 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:15.503 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2019-12-16T22:42:15.626 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-monotonic (1.1-2) ... 2019-12-16T22:42:15.629 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-setuptools (39.0.1-2) ... 2019-12-16T22:42:15.894 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-nose (1.3.7-3) ... 2019-12-16T22:42:16.014 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-16T22:42:16.173 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-decorator (4.1.2-1) ... 2019-12-16T22:42:16.237 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libsnappy1v5:amd64 (1.1.7-1) ... 2019-12-16T22:42:16.363 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-html5lib (0.999999999-1) ... 2019-12-16T22:42:16.466 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tz (2018.3-2) ... 2019-12-16T22:42:16.715 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-repoze.lru (0.7-1) ... 2019-12-16T22:42:16.767 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2019-12-16T22:42:16.999 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-httplib2 (0.9.2+dfsg-1ubuntu0.1) ... 2019-12-16T22:42:17.060 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2019-12-16T22:42:17.300 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2) ... 2019-12-16T22:42:17.362 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.11-1) ... 2019-12-16T22:42:17.618 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-attr (17.4.0-2) ... 2019-12-16T22:42:17.755 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.4.1-1) ... 2019-12-16T22:42:17.894 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-funcsigs (1.0.2-4) ... 2019-12-16T22:42:18.039 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2019-12-16T22:42:18.070 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-paste (2.0.3+dfsg-4ubuntu1) ... 2019-12-16T22:42:18.374 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-dateutil (2.6.1-1) ... 2019-12-16T22:42:18.455 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-websocket (0.44.0-0ubuntu2) ... 2019-12-16T22:42:18.545 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2019-12-16T22:42:18.742 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2019-12-16T22:42:18.807 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liboath0 (2.6.1-1) ... 2019-12-16T22:42:18.999 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librabbitmq4:amd64 (0.8.0-1ubuntu0.18.04.2) ... 2019-12-16T22:42:19.102 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-fasteners (0.12.0-3) ... 2019-12-16T22:42:19.125 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tk:amd64 (3.6.9-1~18.04) ... 2019-12-16T22:42:19.360 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pastedeploy-tpl (1.5.2-4) ... 2019-12-16T22:42:19.412 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.5+dfsg-2) ... 2019-12-16T22:42:19.461 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-setuptools (39.0.1-2) ... 2019-12-16T22:42:19.537 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2019-12-16T22:42:19.825 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up liblttng-ust0:amd64 (2.10.1-1) ... 2019-12-16T22:42:19.946 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-decorator (4.1.2-1) ... 2019-12-16T22:42:20.239 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-tz (2018.3-2) ... 2019-12-16T22:42:20.542 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-uritemplate (0.6-1ubuntu1) ... 2019-12-16T22:42:20.718 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-16T22:42:20.841 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-jwt (1.5.3+ds1-1) ... 2019-12-16T22:42:21.071 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2019-12-16T22:42:21.142 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-joblib (0.11-1) ... 2019-12-16T22:42:21.393 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2019-12-16T22:42:21.485 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-routes (2.4.1-1) ... 2019-12-16T22:42:21.513 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (3.3.2-2) ... 2019-12-16T22:42:21.770 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pyinotify (0.9.6-1) ... 2019-12-16T22:42:21.877 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pytest (3.3.2-2) ... 2019-12-16T22:42:22.062 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-dateutil (2.6.1-1) ... 2019-12-16T22:42:22.158 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2019-12-16T22:42:22.269 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2) ... 2019-12-16T22:42:22.380 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cryptography (2.1.4-1ubuntu1.3) ... 2019-12-16T22:42:22.404 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:22.517 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (3.4.2-1) ... 2019-12-16T22:42:22.749 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-fasteners (0.12.0-3) ... 2019-12-16T22:42:22.837 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:22.961 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:23.050 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up jq (1.5+dfsg-2) ... 2019-12-16T22:42:23.080 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:23.184 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-scipy (0.19.1-2ubuntu1) ... 2019-12-16T22:42:23.224 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2019-12-16T22:42:23.523 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2019-12-16T22:42:23.823 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2019-12-16T22:42:24.140 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2019-12-16T22:42:24.314 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-lxml:amd64 (4.2.1-1ubuntu0.1) ... 2019-12-16T22:42:24.649 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-mako (1.0.7+ds1-1) ... 2019-12-16T22:42:24.971 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.19.1-3) ... 2019-12-16T22:42:24.983 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn-lib (0.19.1-3) ... 2019-12-16T22:42:25.109 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pytest (3.3.2-2) ... 2019-12-16T22:42:25.444 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python-pytest (3.3.2-2) ... 2019-12-16T22:42:25.670 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libleveldb1v5:amd64 (1.20-2) ... 2019-12-16T22:42:25.793 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2019-12-16T22:42:25.798 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up xmlstarlet (1.6.1-2) ... 2019-12-16T22:42:25.918 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librados2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.036 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rsa (3.4.2-1) ... 2019-12-16T22:42:26.093 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.296 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.330 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.455 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libcephfs-dev (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.589 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.590 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rados (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.710 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-openssl (17.5.0-1ubuntu1) ... 2019-12-16T22:42:26.723 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:26.943 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-16T22:42:26.943 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-16T22:42:26.996 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastedeploy (1.5.2-4) ... 2019-12-16T22:42:27.225 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:27.280 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-oauth2client (4.1.2-3) ... 2019-12-16T22:42:27.351 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.2.1-2) ... 2019-12-16T22:42:27.441 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2019-12-16T22:42:27.473 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2019-12-16T22:42:27.608 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-matplotlib (2.1.1-2ubuntu3) ... 2019-12-16T22:42:27.780 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2019-12-16T22:42:28.447 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-2) ... 2019-12-16T22:42:28.465 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-sklearn (0.19.1-3) ... 2019-12-16T22:42:28.740 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:28.869 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:29.000 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:29.151 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:29.280 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-webtest (2.0.28-1ubuntu1) ... 2019-12-16T22:42:29.582 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up libradosstriper1 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:29.700 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2019-12-16T22:42:29.792 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-cephfs (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:30.077 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librgw2 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:30.103 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2019-12-16T22:42:30.178 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:30.343 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2019-12-16T22:42:30.381 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-16T22:42:30.381 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2019-12-16T22:42:30.501 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2019-12-16T22:42:30.671 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up librbd1 (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:30.714 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2019-12-16T22:42:30.805 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pecan (1.2.1-2) ... 2019-12-16T22:42:30.895 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/python3-pecan to provide /usr/bin/pecan (pecan) in auto mode 2019-12-16T22:42:30.927 INFO:teuthology.orchestra.run.smithi177.stdout:update-alternatives: using /usr/bin/python3-gunicorn_pecan to provide /usr/bin/gunicorn_pecan (gunicorn_pecan) in auto mode 2019-12-16T22:42:31.015 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:31.225 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-kubernetes (2.0.0-2ubuntu1) ... 2019-12-16T22:42:31.277 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-16T22:42:31.278 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-16T22:42:31.684 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-mirror (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:31.897 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-pastescript (2.0.2-2) ... 2019-12-16T22:42:31.902 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2019-12-16T22:42:31.902 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2019-12-16T22:42:32.168 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:32.197 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:32.295 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:32.339 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up rbd-fuse (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:32.473 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up python3-rbd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:32.592 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-common (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:32.639 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2019-12-16T22:42:32.930 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:33.067 INFO:teuthology.orchestra.run.smithi177.stdout:Adding group ceph....done 2019-12-16T22:42:33.143 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-16T22:42:33.144 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-16T22:42:33.431 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:33.478 INFO:teuthology.orchestra.run.smithi177.stdout:Adding system user ceph....done 2019-12-16T22:42:33.577 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:33.658 INFO:teuthology.orchestra.run.smithi177.stdout:Setting system user ceph properties....done 2019-12-16T22:42:33.816 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2019-12-16T22:42:34.037 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-16T22:42:34.037 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-16T22:42:34.054 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2019-12-16T22:42:34.289 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:34.352 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up radosgw (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:34.427 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:34.570 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-rook (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:34.613 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-16T22:42:34.614 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2019-12-16T22:42:34.721 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:34.934 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-16T22:42:34.934 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-16T22:42:35.042 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up rbd-mirror (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:35.218 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:35.251 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2019-12-16T22:42:35.252 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target -> /lib/systemd/system/ceph-rbd-mirror.target. 2019-12-16T22:42:35.523 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-test (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:35.660 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-16T22:42:35.660 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-16T22:42:35.677 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-base (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:35.937 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:35.982 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2019-12-16T22:42:36.040 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:36.204 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:36.271 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:36.333 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2019-12-16T22:42:36.492 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-16T22:42:36.492 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2019-12-16T22:42:36.534 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2019-12-16T22:42:36.772 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-diskprediction-local (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:36.915 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-osd (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:37.374 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-16T22:42:37.374 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2019-12-16T22:42:37.651 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-cephadm (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:37.769 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-diskprediction-cloud (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:37.886 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-rook (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:38.012 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mds (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:38.055 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2019-12-16T22:42:38.099 INFO:teuthology.orchestra.run.smithi106.stdout:ureadahead will be reprofiled on next reboot 2019-12-16T22:42:38.155 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2019-12-16T22:42:38.229 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-16T22:42:38.230 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2019-12-16T22:42:38.522 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mon (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:38.595 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2019-12-16T22:42:38.597 DEBUG:teuthology.parallel:result is None 2019-12-16T22:42:38.743 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-16T22:42:38.743 INFO:teuthology.orchestra.run.smithi177.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2019-12-16T22:42:39.007 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-k8sevents (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:39.317 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph-mgr-dashboard (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:39.443 INFO:teuthology.orchestra.run.smithi177.stdout:Setting up ceph (15.0.0-8533-g8a58d06-1bionic) ... 2019-12-16T22:42:39.562 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for systemd (237-3ubuntu10.33) ... 2019-12-16T22:42:39.767 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for man-db (2.8.3-2ubuntu0.1) ... 2019-12-16T22:42:41.303 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for ureadahead (0.100.0-21) ... 2019-12-16T22:42:41.346 INFO:teuthology.orchestra.run.smithi177.stdout:ureadahead will be reprofiled on next reboot 2019-12-16T22:42:41.401 INFO:teuthology.orchestra.run.smithi177.stdout:Processing triggers for libc-bin (2.27-3ubuntu1) ... 2019-12-16T22:42:41.854 INFO:teuthology.orchestra.run.smithi177.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2019-12-16T22:42:41.856 DEBUG:teuthology.parallel:result is None 2019-12-16T22:42:41.856 INFO:teuthology.orchestra.run.smithi106:> sudo lsb_release -is 2019-12-16T22:42:41.914 INFO:teuthology.orchestra.run.smithi106.stdout:Ubuntu 2019-12-16T22:42:41.924 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-16T22:42:41.925 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=8a58d0694cce968d9a21937d52c2e48cfe306455 2019-12-16T22:42:42.083 INFO:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2019-12-16T22:42:42.107 INFO:teuthology.orchestra.run.smithi106.stdout:15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:42:42.108 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:42:42.108 INFO:teuthology.task.install:The correct ceph version 15.0.0-8533-g8a58d06-1bionic is installed. 2019-12-16T22:42:42.108 INFO:teuthology.orchestra.run.smithi177:> sudo lsb_release -is 2019-12-16T22:42:42.168 INFO:teuthology.orchestra.run.smithi177.stdout:Ubuntu 2019-12-16T22:42:42.168 DEBUG:teuthology.misc:System to be installed: Ubuntu 2019-12-16T22:42:42.168 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&sha1=8a58d0694cce968d9a21937d52c2e48cfe306455 2019-12-16T22:42:42.317 INFO:teuthology.orchestra.run.smithi177:> dpkg-query -W -f '${Version}' ceph 2019-12-16T22:42:42.341 INFO:teuthology.orchestra.run.smithi177.stdout:15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:42:42.342 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-8533-g8a58d06-1bionic 2019-12-16T22:42:42.342 INFO:teuthology.task.install:The correct ceph version 15.0.0-8533-g8a58d06-1bionic is installed. 2019-12-16T22:42:42.342 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-16T22:42:42.342 INFO:teuthology.orchestra.run.smithi106:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-16T22:42:42.358 INFO:teuthology.orchestra.run.smithi177:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-16T22:42:42.407 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-16T22:42:42.408 INFO:teuthology.orchestra.run.smithi106:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-16T22:42:42.424 INFO:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-16T22:42:42.477 INFO:teuthology.orchestra.run.smithi177:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-16T22:42:42.493 INFO:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-16T22:42:42.554 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-16T22:42:42.555 INFO:teuthology.orchestra.run.smithi106:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-16T22:42:42.608 INFO:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-16T22:42:42.683 INFO:teuthology.orchestra.run.smithi177:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-16T22:42:42.742 INFO:teuthology.orchestra.run.smithi177:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-16T22:42:42.802 INFO:teuthology.run_tasks:Running task ceph... 2019-12-16T22:42:43.056 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-12-16T22:42:43.057 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2019-12-16T22:42:43.059 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 777 /var/log/ceph 2019-12-16T22:42:43.075 INFO:tasks.ceph:Disabling ceph logrotate... 2019-12-16T22:42:43.075 INFO:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-16T22:42:43.118 INFO:teuthology.orchestra.run.smithi177:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-16T22:42:43.133 INFO:tasks.ceph:Creating extra log directories... 2019-12-16T22:42:43.133 INFO:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-16T22:42:43.174 INFO:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-16T22:42:43.190 INFO:tasks.ceph:Creating ceph cluster cluster1... 2019-12-16T22:42:43.190 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'cluster1', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'ms inject socket failures': 5000, 'mon client directed command retry': 5}, 'client': {'debug rbd': 20, 'rbd mirror image policy type': 'none', 'rbd default features': 125, 'debug rbd_mirror': 15, 'log to stderr': False}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'stupid', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}} 2019-12-16T22:42:43.190 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455', 'extra_packages': ['rbd-mirror']}}, {'ceph': {'cluster': 'cluster1', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'fs': 'xfs', 'conf': {'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'ms inject socket failures': 5000, 'mon client directed command retry': 5}, 'client': {'debug rbd': 20, 'rbd mirror image policy type': 'none', 'rbd default features': 125, 'debug rbd_mirror': 15, 'log to stderr': False}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'stupid', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}, 'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}}, {'ceph': {'cluster': 'cluster2'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.0'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.1'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.2'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.3'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.0'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.1'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.2'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.3'}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_prepare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_USE_RBD_MIRROR': '1', 'RBD_MIRROR_NOCLEANUP': '1', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1'}}}, {'rbd_fsx': {'pool_name': 'mirror', 'clients': ['cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5'], 'keep_images': True, 'ops': 6000}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_compare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_USE_RBD_MIRROR': '1', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1'}, 'timeout': '6h'}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.22728', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run multiple FSX workloads to simulate cluster load and then verify that the images were replicated'}], 'owner': 'scheduled_sage@teuthology', 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'targets': {'smithi106.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDz46hE/59V6G/yY7M/2TcudEH6hit23kIisw/8xoAMEnZSpLxOaZQaR8Cyn88j4jCN/k9GhXkjenp8UlNVZB3aOCbtRpXa+3+4NdnSmpk69ZOgClgfoAX9beOKoAbaDlJOdkbIfrgluBsn70iLBUYWbNBklKvq7zbjZtKphpMUxQADNloIrDR/+n0a0G/a9Yg9jZiWnUEESvrGIL7xsdQtYGgbs21wl5iBW8PnCZcKtlVR7hBvjmQlybI9O7tzT3x6rcHZiqEWHMrg2iOiqufrguPFe6qYOnnDg0JNrgn1iana8j0c1VUUUV21Ez06/zG7mof0Nxm+Gf3lQATzFF/N', 'smithi177.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV9HN4RP8xt43fd1193v7nr3U1BKwbZalDDz2rHylogjDJF1i7HwRkIiA3+qlgk1J3ZLt5vXF2Cu+pblnxitk4eI/70mwibcTmSE7vgBy4I5Dz5Ttu0ElVyIwiIX7T+32F2vaHT2+izWPvsBpQvXj529V0JUbd5HNtXycizW+Igy/GePuwM9YJtK5MHMYhIx/kjpdnoDMwhyU/9eOuYu/PssnWbgnvUsSSJ6Vl+LAcysYHDl3dkUtbXU1gzny0+0CEFspT++vUaknpbvt06em9ZHnziQRIHMS7YkKhV9yAe+l1ksB2Dtml3dNm194LPYEPnST1S/2bxn90SNE+nfMv'}, 'job_id': '4609548', 'tube': 'smithi', 'suite_branch': 'wip-sage3-testing-2019-12-16-1157', 'priority': 49, 'os_version': '18.04', 'first_in_suite': False, 'branch': 'wip-sage3-testing-2019-12-16-1157', 'suite': 'rbd', 'email': None, 'archive_path': '/home/teuthworker/archive/sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi/4609548', 'description': 'rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-fsx-workunit.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455', 'name': 'sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'conf': {'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'ms inject socket failures': 5000, 'mon client directed command retry': 5}, 'client': {'debug rbd': 20, 'rbd mirror image policy type': 'none', 'rbd default features': 125, 'debug rbd_mirror': 15, 'log to stderr': False}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'stupid', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}, 'fs': 'xfs', 'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'install': {'ceph': {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}}, 'admin_socket': {'branch': 'wip-sage3-testing-2019-12-16-1157'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'workunit': {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455', 'branch': 'wip-sage3-testing-2019-12-16-1157'}}, 'os_type': 'ubuntu', 'suite_sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'} 2019-12-16T22:42:43.191 INFO:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2019-12-16T22:42:43.230 INFO:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2019-12-16T22:42:43.237 INFO:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2019-12-16T22:42:43.282 INFO:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2019-12-16T22:42:43.353 DEBUG:teuthology.orchestra.remote:smithi106:/scratch_devs is 72B 2019-12-16T22:42:43.365 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-16T22:42:43.365 INFO:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-16T22:42:43.372 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2019-12-16T22:42:43.372 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:42:43.372 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 452 Links: 1 2019-12-16T22:42:43.373 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:42:43.373 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2019-12-16 22:40:22.652694157 +0000 2019-12-16T22:42:43.373 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2019-12-16 22:40:22.548746160 +0000 2019-12-16T22:42:43.373 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2019-12-16 22:40:22.548746160 +0000 2019-12-16T22:42:43.373 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2019-12-16T22:42:43.380 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2019-12-16T22:42:43.380 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2019-12-16T22:42:43.380 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000349975 s, 1.5 MB/s 2019-12-16T22:42:43.383 INFO:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-16T22:42:43.431 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2019-12-16T22:42:43.431 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:42:43.432 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 458 Links: 1 2019-12-16T22:42:43.432 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:42:43.432 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2019-12-16 22:40:22.772634155 +0000 2019-12-16T22:42:43.432 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2019-12-16 22:40:22.768636153 +0000 2019-12-16T22:42:43.432 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2019-12-16 22:40:22.768636153 +0000 2019-12-16T22:42:43.432 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2019-12-16T22:42:43.440 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2019-12-16T22:42:43.440 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2019-12-16T22:42:43.441 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000359063 s, 1.4 MB/s 2019-12-16T22:42:43.445 INFO:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-16T22:42:43.495 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2019-12-16T22:42:43.495 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:42:43.495 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 464 Links: 1 2019-12-16T22:42:43.495 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:42:43.496 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2019-12-16 22:40:23.160440146 +0000 2019-12-16T22:42:43.496 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2019-12-16 22:40:23.024508149 +0000 2019-12-16T22:42:43.496 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2019-12-16 22:40:23.024508149 +0000 2019-12-16T22:42:43.496 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2019-12-16T22:42:43.504 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2019-12-16T22:42:43.504 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2019-12-16T22:42:43.505 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000387524 s, 1.3 MB/s 2019-12-16T22:42:43.510 INFO:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-16T22:42:43.563 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2019-12-16T22:42:43.563 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:42:43.563 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 6h/6d Inode: 470 Links: 1 2019-12-16T22:42:43.563 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:42:43.563 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2019-12-16 22:42:26.991172780 +0000 2019-12-16T22:42:43.563 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2019-12-16 22:40:23.280380143 +0000 2019-12-16T22:42:43.564 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2019-12-16 22:40:23.280380143 +0000 2019-12-16T22:42:43.564 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2019-12-16T22:42:43.572 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2019-12-16T22:42:43.572 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2019-12-16T22:42:43.573 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000401358 s, 1.3 MB/s 2019-12-16T22:42:43.576 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-16T22:42:43.576 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-16T22:42:43.576 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-16T22:42:43.577 INFO:tasks.ceph:dev map: {'cluster1.osd.2': '/dev/vg_nvme/lv_2', 'cluster1.osd.1': '/dev/vg_nvme/lv_1', 'cluster1.osd.0': '/dev/vg_nvme/lv_4'} 2019-12-16T22:42:43.577 INFO:tasks.ceph:Generating config... 2019-12-16T22:42:43.578 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.578 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.578 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.579 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.579 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.579 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.579 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.579 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.579 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-12-16T22:42:43.579 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-12-16T22:42:43.579 INFO:tasks.ceph:[client] debug rbd = 20 2019-12-16T22:42:43.580 INFO:tasks.ceph:[client] rbd mirror image policy type = none 2019-12-16T22:42:43.580 INFO:tasks.ceph:[client] rbd default features = 125 2019-12-16T22:42:43.580 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2019-12-16T22:42:43.580 INFO:tasks.ceph:[client] log to stderr = False 2019-12-16T22:42:43.580 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-16T22:42:43.580 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-16T22:42:43.580 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-12-16T22:42:43.581 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] bdev async discard = True 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-16T22:42:43.582 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-12-16T22:42:43.583 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-12-16T22:42:43.583 INFO:tasks.ceph:Setting up cluster1.mon.a... 2019-12-16T22:42:43.583 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster1.keyring 2019-12-16T22:42:43.647 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/cluster1.keyring 2019-12-16T22:42:43.650 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster1.keyring 2019-12-16T22:42:43.731 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2019-12-16T22:42:43.794 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster1.mon.a', '172.21.15.106')] 2019-12-16T22:42:43.795 INFO:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.106 --print /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:43.866 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:43.866 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af 2019-12-16T22:42:43.866 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2019-12-16T22:42:43.866 INFO:teuthology.orchestra.run.smithi106.stdout:fsid fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af 2019-12-16T22:42:43.866 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2019-12-16T22:42:43.867699+0000 2019-12-16T22:42:43.866 INFO:teuthology.orchestra.run.smithi106.stdout:created 2019-12-16T22:42:43.867699+0000 2019-12-16T22:42:43.867 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 0 (unknown) 2019-12-16T22:42:43.867 INFO:teuthology.orchestra.run.smithi106.stdout:0: [v2:172.21.15.106:3300/0,v1:172.21.15.106:6789/0] mon.a 2019-12-16T22:42:43.867 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster1.monmap (1 monitors) 2019-12-16T22:42:43.868 INFO:tasks.ceph:Writing /etc/ceph/cluster1.conf for FSID fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af... 2019-12-16T22:42:43.869 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2019-12-16T22:42:43.910 INFO:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2019-12-16T22:42:43.942 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2019-12-16T22:42:43.943 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2019-12-16T22:42:43.943 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2019-12-16T22:42:43.943 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2019-12-16T22:42:43.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.943 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2019-12-16T22:42:43.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.944 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2019-12-16T22:42:43.944 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.944 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2019-12-16T22:42:43.944 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2019-12-16T22:42:43.944 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.944 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2019-12-16T22:42:43.944 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.945 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2019-12-16T22:42:43.946 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2019-12-16T22:42:43.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2019-12-16T22:42:43.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2019-12-16T22:42:43.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2019-12-16T22:42:43.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2019-12-16T22:42:43.946 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2019-12-16T22:42:43.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.948 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2019-12-16T22:42:43.948 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.948 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2019-12-16T22:42:43.948 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2019-12-16T22:42:43.948 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = 172.21.15.106 2019-12-16T22:42:43.948 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 5000 2019-12-16T22:42:43.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2019-12-16T22:42:43.951 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af 2019-12-16T22:42:43.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.951 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2019-12-16T22:42:43.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2019-12-16T22:42:43.952 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2019-12-16T22:42:43.952 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2019-12-16T22:42:43.952 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2019-12-16T22:42:43.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2019-12-16T22:42:43.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2019-12-16T22:42:43.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2019-12-16T22:42:43.953 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2019-12-16T22:42:43.954 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.954 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2019-12-16T22:42:43.954 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2019-12-16T22:42:43.954 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.954 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2019-12-16T22:42:43.954 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.955 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2019-12-16T22:42:43.956 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2019-12-16T22:42:43.956 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2019-12-16T22:42:43.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2019-12-16T22:42:43.956 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2019-12-16T22:42:43.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 25 2019-12-16T22:42:43.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2019-12-16T22:42:43.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2019-12-16T22:42:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2019-12-16T22:42:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2019-12-16T22:42:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: debug journal = 20 2019-12-16T22:42:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = stupid 2019-12-16T22:42:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2019-12-16T22:42:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2019-12-16T22:42:43.957 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout: debug filestore = 20 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2019-12-16T22:42:43.958 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2019-12-16T22:42:43.959 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2019-12-16T22:42:43.959 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2019-12-16T22:42:43.959 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:42:43.959 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:42:43.959 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2019-12-16T22:42:43.959 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.959 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:42:43.960 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2019-12-16T22:42:43.961 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2019-12-16T22:42:43.961 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:42:43.961 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:42:43.961 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2019-12-16T22:42:43.961 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2019-12-16T22:42:43.961 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2019-12-16T22:42:43.961 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2019-12-16T22:42:43.962 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2019-12-16T22:42:43.962 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2019-12-16T22:42:43.962 INFO:teuthology.orchestra.run.smithi106.stdout: debug rbd = 20 2019-12-16T22:42:43.962 INFO:teuthology.orchestra.run.smithi106.stdout: rbd mirror image policy type = none 2019-12-16T22:42:43.962 INFO:teuthology.orchestra.run.smithi106.stdout: rbd default features = 125 2019-12-16T22:42:43.962 INFO:teuthology.orchestra.run.smithi106.stdout: debug rbd_mirror = 15 2019-12-16T22:42:43.962 INFO:teuthology.orchestra.run.smithi106.stdout: log to stderr = False 2019-12-16T22:42:43.964 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2019-12-16T22:42:43.964 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.1] 2019-12-16T22:42:43.964 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.965 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.965 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.0] 2019-12-16T22:42:43.965 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.965 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.965 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.3] 2019-12-16T22:42:43.965 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.965 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.966 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.2] 2019-12-16T22:42:43.967 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.967 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.969 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2019-12-16T22:42:43.969 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2019-12-16T22:42:43.969 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2019-12-16T22:42:43.969 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2019-12-16T22:42:43.970 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.970 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2019-12-16T22:42:43.970 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.970 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2019-12-16T22:42:43.970 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.971 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2019-12-16T22:42:43.971 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2019-12-16T22:42:43.971 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.971 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2019-12-16T22:42:43.971 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2019-12-16T22:42:43.971 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.971 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2019-12-16T22:42:43.972 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2019-12-16T22:42:43.972 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.972 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2019-12-16T22:42:43.972 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2019-12-16T22:42:43.972 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.972 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2019-12-16T22:42:43.972 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.973 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2019-12-16T22:42:43.973 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2019-12-16T22:42:43.973 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2019-12-16T22:42:43.973 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2019-12-16T22:42:43.973 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2019-12-16T22:42:43.973 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2019-12-16T22:42:43.973 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2019-12-16T22:42:43.974 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2019-12-16T22:42:43.974 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2019-12-16T22:42:43.974 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.974 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2019-12-16T22:42:43.974 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.974 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2019-12-16T22:42:43.974 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = 172.21.15.106 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: ms inject socket failures = 5000 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: mon client directed command retry = 5 2019-12-16T22:42:43.975 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af 2019-12-16T22:42:43.976 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.976 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2019-12-16T22:42:43.976 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2019-12-16T22:42:43.976 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.976 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2019-12-16T22:42:43.976 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2019-12-16T22:42:43.976 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.977 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2019-12-16T22:42:43.977 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2019-12-16T22:42:43.977 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.977 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2019-12-16T22:42:43.977 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2019-12-16T22:42:43.977 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2019-12-16T22:42:43.977 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.978 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2019-12-16T22:42:43.979 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.979 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2019-12-16T22:42:43.979 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2019-12-16T22:42:43.979 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.979 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2019-12-16T22:42:43.979 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2019-12-16T22:42:43.979 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2019-12-16T22:42:43.980 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2019-12-16T22:42:43.980 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2019-12-16T22:42:43.980 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 25 2019-12-16T22:42:43.980 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 20 2019-12-16T22:42:43.980 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 20 2019-12-16T22:42:43.980 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2019-12-16T22:42:43.986 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 10 2019-12-16T22:42:43.987 INFO:teuthology.orchestra.run.smithi177.stdout: debug journal = 20 2019-12-16T22:42:43.987 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = stupid 2019-12-16T22:42:43.987 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2019-12-16T22:42:43.987 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2019-12-16T22:42:43.987 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2019-12-16T22:42:43.987 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2019-12-16T22:42:43.987 INFO:teuthology.orchestra.run.smithi177.stdout: debug filestore = 20 2019-12-16T22:42:43.988 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2019-12-16T22:42:43.988 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2019-12-16T22:42:43.988 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.988 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2019-12-16T22:42:43.988 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2019-12-16T22:42:43.988 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2019-12-16T22:42:43.988 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2019-12-16T22:42:43.989 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2019-12-16T22:42:43.990 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2019-12-16T22:42:43.990 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2019-12-16T22:42:43.990 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2019-12-16T22:42:43.990 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2019-12-16T22:42:43.991 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:42:43.991 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2019-12-16T22:42:43.991 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2019-12-16T22:42:43.991 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:42:43.991 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:42:43.991 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2019-12-16T22:42:43.992 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2019-12-16T22:42:43.992 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2019-12-16T22:42:43.992 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2019-12-16T22:42:43.992 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2019-12-16T22:42:43.992 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2019-12-16T22:42:43.992 INFO:teuthology.orchestra.run.smithi177.stdout: debug rbd = 20 2019-12-16T22:42:43.992 INFO:teuthology.orchestra.run.smithi177.stdout: rbd mirror image policy type = none 2019-12-16T22:42:43.993 INFO:teuthology.orchestra.run.smithi177.stdout: rbd default features = 125 2019-12-16T22:42:43.993 INFO:teuthology.orchestra.run.smithi177.stdout: debug rbd_mirror = 15 2019-12-16T22:42:43.993 INFO:teuthology.orchestra.run.smithi177.stdout: log to stderr = False 2019-12-16T22:42:43.993 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2019-12-16T22:42:43.993 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.1] 2019-12-16T22:42:43.993 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.993 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.994 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.0] 2019-12-16T22:42:43.994 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.994 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.994 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.3] 2019-12-16T22:42:43.994 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.994 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.994 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.2] 2019-12-16T22:42:43.995 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:42:43.995 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:42:43.995 INFO:tasks.ceph:Creating admin key on cluster1.mon.a... 2019-12-16T22:42:43.995 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster1.keyring 2019-12-16T22:42:44.060 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-16T22:42:44.108 DEBUG:teuthology.orchestra.remote:smithi106:/etc/ceph/cluster1.keyring is 206B 2019-12-16T22:42:44.132 DEBUG:teuthology.orchestra.remote:smithi106:/home/ubuntu/cephtest/cluster1.monmap is 179B 2019-12-16T22:42:44.142 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2019-12-16T22:42:44.143 INFO:teuthology.orchestra.run.smithi106:> sudo sh -c 'cat > /etc/ceph/cluster1.keyring' && sudo chmod 0644 /etc/ceph/cluster1.keyring 2019-12-16T22:42:44.201 INFO:teuthology.orchestra.run.smithi106:> cat > /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:44.293 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2019-12-16T22:42:44.293 INFO:teuthology.orchestra.run.smithi177:> sudo sh -c 'cat > /etc/ceph/cluster1.keyring' && sudo chmod 0644 /etc/ceph/cluster1.keyring 2019-12-16T22:42:44.351 INFO:teuthology.orchestra.run.smithi177:> cat > /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:44.436 INFO:tasks.ceph:Setting up mon nodes... 2019-12-16T22:42:44.437 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-16T22:42:44.437 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/cluster1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster1-x/keyring 2019-12-16T22:42:44.481 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/cluster1-x/keyring 2019-12-16T22:42:44.482 INFO:tasks.ceph:Setting up mds nodes... 2019-12-16T22:42:44.483 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-16T22:42:44.483 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster1.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.0.keyring 2019-12-16T22:42:44.564 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/cluster1.client.0.keyring 2019-12-16T22:42:44.574 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster1.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.keyring 2019-12-16T22:42:44.607 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.keyring 2019-12-16T22:42:44.619 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster1.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.0.keyring 2019-12-16T22:42:44.694 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.0.keyring 2019-12-16T22:42:44.706 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster1.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.1.keyring 2019-12-16T22:42:44.779 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.1.keyring 2019-12-16T22:42:44.792 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster1.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.2.keyring 2019-12-16T22:42:44.867 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.2.keyring 2019-12-16T22:42:44.879 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster1.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.3.keyring 2019-12-16T22:42:44.952 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.3.keyring 2019-12-16T22:42:44.964 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster1.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.4.keyring 2019-12-16T22:42:45.063 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.4.keyring 2019-12-16T22:42:45.075 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster1.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.5.keyring 2019-12-16T22:42:45.190 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.5.keyring 2019-12-16T22:42:45.202 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster1.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.6.keyring 2019-12-16T22:42:45.291 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster1.client.mirror.6.keyring 2019-12-16T22:42:45.303 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-16T22:42:45.303 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'cluster1.osd.2': '/dev/vg_nvme/lv_2', 'cluster1.osd.1': '/dev/vg_nvme/lv_1', 'cluster1.osd.0': '/dev/vg_nvme/lv_4'}} 2019-12-16T22:42:45.303 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/cluster1-0 2019-12-16T22:42:45.325 INFO:tasks.ceph:{'cluster1.osd.2': '/dev/vg_nvme/lv_2', 'cluster1.osd.1': '/dev/vg_nvme/lv_1', 'cluster1.osd.0': '/dev/vg_nvme/lv_4'} 2019-12-16T22:42:45.325 INFO:tasks.ceph:{} 2019-12-16T22:42:45.325 INFO:tasks.ceph:cluster1.osd.0 2019-12-16T22:42:45.325 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com 2019-12-16T22:42:45.325 INFO:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-16T22:42:45.877 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-16T22:42:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-16T22:42:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-16T22:42:45.877 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-16T22:42:45.877 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2019-12-16T22:42:45.878 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-16T22:42:45.878 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-16T22:42:45.878 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-16T22:42:45.878 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-16T22:42:45.879 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2019-12-16T22:42:45.879 INFO:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/cluster1-0 2019-12-16T22:42:45.969 INFO:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-0 2019-12-16T22:42:45.979 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2019-12-16T22:42:45.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:42:45.980 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/cluster1-1 2019-12-16T22:42:46.040 INFO:tasks.ceph:{'cluster1.osd.2': '/dev/vg_nvme/lv_2', 'cluster1.osd.1': '/dev/vg_nvme/lv_1', 'cluster1.osd.0': '/dev/vg_nvme/lv_4'} 2019-12-16T22:42:46.040 INFO:tasks.ceph:{} 2019-12-16T22:42:46.040 INFO:tasks.ceph:cluster1.osd.1 2019-12-16T22:42:46.040 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2019-12-16T22:42:46.041 INFO:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-16T22:42:46.581 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-16T22:42:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-16T22:42:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-16T22:42:46.581 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-16T22:42:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2019-12-16T22:42:46.582 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-16T22:42:46.582 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-16T22:42:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-16T22:42:46.582 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-16T22:42:46.583 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2019-12-16T22:42:46.584 INFO:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster1-1 2019-12-16T22:42:46.616 INFO:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-1 2019-12-16T22:42:46.672 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2019-12-16T22:42:46.672 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:42:46.673 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/cluster1-2 2019-12-16T22:42:46.729 INFO:tasks.ceph:{'cluster1.osd.2': '/dev/vg_nvme/lv_2', 'cluster1.osd.1': '/dev/vg_nvme/lv_1', 'cluster1.osd.0': '/dev/vg_nvme/lv_4'} 2019-12-16T22:42:46.729 INFO:tasks.ceph:{} 2019-12-16T22:42:46.730 INFO:tasks.ceph:cluster1.osd.2 2019-12-16T22:42:46.730 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2019-12-16T22:42:46.730 INFO:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-16T22:42:47.272 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-16T22:42:47.273 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-16T22:42:47.273 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-16T22:42:47.273 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-16T22:42:47.273 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2019-12-16T22:42:47.273 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-16T22:42:47.275 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-16T22:42:47.275 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-16T22:42:47.275 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-16T22:42:47.276 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2019-12-16T22:42:47.276 INFO:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster1-2 2019-12-16T22:42:47.331 INFO:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-2 2019-12-16T22:42:47.342 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2019-12-16T22:42:47.342 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:42:47.343 INFO:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:47.445 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:47.439+0000 7fe42a329d80 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-0/keyring: can't open /var/lib/ceph/osd/cluster1-0/keyring: (2) No such file or directory 2019-12-16T22:42:47.446 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:47.439+0000 7fe42a329d80 -1 created new key in keyring /var/lib/ceph/osd/cluster1-0/keyring 2019-12-16T22:42:47.446 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:47.439+0000 7fe42a329d80 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2019-12-16T22:42:47.446 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:47.439+0000 7fe42a329d80 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2019-12-16T22:42:47.446 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:47.439+0000 7fe42a329d80 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2019-12-16T22:42:47.452 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:47.451+0000 7fe42a329d80 -1 bluestore(/var/lib/ceph/osd/cluster1-0) _read_fsid unparsable uuid 2019-12-16T22:42:49.883 INFO:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-0 2019-12-16T22:42:49.901 INFO:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:49.979 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:49.975+0000 7f817b130d80 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-1/keyring: can't open /var/lib/ceph/osd/cluster1-1/keyring: (2) No such file or directory 2019-12-16T22:42:49.980 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:49.975+0000 7f817b130d80 -1 created new key in keyring /var/lib/ceph/osd/cluster1-1/keyring 2019-12-16T22:42:49.980 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:49.975+0000 7f817b130d80 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2019-12-16T22:42:49.980 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:49.975+0000 7f817b130d80 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2019-12-16T22:42:49.980 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:49.975+0000 7f817b130d80 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2019-12-16T22:42:49.981 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:49.979+0000 7f817b130d80 -1 bluestore(/var/lib/ceph/osd/cluster1-1) _read_fsid unparsable uuid 2019-12-16T22:42:52.431 INFO:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-1 2019-12-16T22:42:52.504 INFO:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:52.589 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:52.587+0000 7f8e6d376d80 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-2/keyring: can't open /var/lib/ceph/osd/cluster1-2/keyring: (2) No such file or directory 2019-12-16T22:42:52.589 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:52.587+0000 7f8e6d376d80 -1 created new key in keyring /var/lib/ceph/osd/cluster1-2/keyring 2019-12-16T22:42:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:52.587+0000 7f8e6d376d80 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2019-12-16T22:42:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:52.587+0000 7f8e6d376d80 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2019-12-16T22:42:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:52.587+0000 7f8e6d376d80 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2019-12-16T22:42:52.590 INFO:teuthology.orchestra.run.smithi106.stderr:2019-12-16T22:42:52.587+0000 7f8e6d376d80 -1 bluestore(/var/lib/ceph/osd/cluster1-2) _read_fsid unparsable uuid 2019-12-16T22:42:55.034 INFO:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-2 2019-12-16T22:42:55.099 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-16T22:42:55.100 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:42:55.150 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.jIkqQS3l75 2019-12-16T22:42:55.151 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/mgr/cluster1-x/keyring /tmp/tmp.jIkqQS3l75 2019-12-16T22:42:55.207 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.jIkqQS3l75 2019-12-16T22:42:55.316 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.jIkqQS3l75 is 56B 2019-12-16T22:42:55.333 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.jIkqQS3l75 2019-12-16T22:42:55.340 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:42:55.390 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.K7ykmQExlG 2019-12-16T22:42:55.390 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/osd/cluster1-0/keyring /tmp/tmp.K7ykmQExlG 2019-12-16T22:42:55.447 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.K7ykmQExlG 2019-12-16T22:42:55.559 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.K7ykmQExlG is 56B 2019-12-16T22:42:55.570 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.K7ykmQExlG 2019-12-16T22:42:55.576 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:42:55.626 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.HOSuRlrrwa 2019-12-16T22:42:55.626 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/osd/cluster1-1/keyring /tmp/tmp.HOSuRlrrwa 2019-12-16T22:42:55.683 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.HOSuRlrrwa 2019-12-16T22:42:55.792 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.HOSuRlrrwa is 56B 2019-12-16T22:42:55.808 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.HOSuRlrrwa 2019-12-16T22:42:55.815 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:42:55.866 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.M6v46r7qaU 2019-12-16T22:42:55.866 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/osd/cluster1-2/keyring /tmp/tmp.M6v46r7qaU 2019-12-16T22:42:55.920 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.M6v46r7qaU 2019-12-16T22:42:56.025 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.M6v46r7qaU is 56B 2019-12-16T22:42:56.075 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.M6v46r7qaU 2019-12-16T22:42:56.147 DEBUG:teuthology.orchestra.remote:smithi106:/etc/ceph/cluster1.client.0.keyring is 59B 2019-12-16T22:42:56.172 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.keyring is 64B 2019-12-16T22:42:56.190 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.0.keyring is 66B 2019-12-16T22:42:56.210 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.1.keyring is 66B 2019-12-16T22:42:56.274 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.2.keyring is 66B 2019-12-16T22:42:56.293 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.3.keyring is 66B 2019-12-16T22:42:56.355 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.4.keyring is 66B 2019-12-16T22:42:56.380 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.5.keyring is 66B 2019-12-16T22:42:56.398 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster1.client.mirror.6.keyring is 66B 2019-12-16T22:42:56.408 INFO:tasks.ceph:Adding keys to all mons... 2019-12-16T22:42:56.408 INFO:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/cluster1.keyring 2019-12-16T22:42:56.455 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2019-12-16T22:42:56.455 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCPhdLbXBHBAAaMNBthw7y1Egafs7CT2rDw== 2019-12-16T22:42:56.455 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2019-12-16T22:42:56.456 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBnCPhdxrCTGhAAVOEf51mZ8x0pCDU55hebHw== 2019-12-16T22:42:56.456 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2019-12-16T22:42:56.456 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBpCPhdWYx8OhAAvfbuoRCoS4DmQ15ge8sF2g== 2019-12-16T22:42:56.456 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2019-12-16T22:42:56.456 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBsCPhdifQ6IxAA8MsQHmBSgt3Uhd6/H8AO+g== 2019-12-16T22:42:56.456 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2019-12-16T22:42:56.456 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCPhd6nCoIRAAOsRVv50gbw6k3CtiQkONfw== 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror] 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCPhdVQBOJBAAmQGQngQdUpwmvht9ArqkUQ== 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.0] 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCPhdizyGKRAAzYDWr8kD3wMt60rOASJBGw== 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.1] 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCPhdUf6SLhAAGE+MORFmZ4kizG6lk5fHCQ== 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.2] 2019-12-16T22:42:56.457 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCPhdzZDbMxAA7qt5HAO0EWDvxTYLQP/FRA== 2019-12-16T22:42:56.459 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.3] 2019-12-16T22:42:56.459 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBkCPhdKLjbOBAAOYVpJspCT3k2mRwW981Vgg== 2019-12-16T22:42:56.459 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.4] 2019-12-16T22:42:56.459 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBlCPhdnzrlAxAAAFaroaELM/MnXGGvpTKnqg== 2019-12-16T22:42:56.460 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.5] 2019-12-16T22:42:56.460 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBlCPhd0QA9CxAApe8sxA8u4MAV0gJZqFOz3A== 2019-12-16T22:42:56.460 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.6] 2019-12-16T22:42:56.460 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQBlCPhdpPRzERAAKYpSjSOmWt7u78Ka8Vzj7Q== 2019-12-16T22:42:56.460 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-16T22:42:56.539 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-16T22:42:56.620 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-16T22:42:56.704 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-16T22:42:56.797 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:56.883 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:56.968 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:57.055 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:57.142 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:57.228 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:57.317 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.4 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:57.407 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.5 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:57.491 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.6 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:42:57.575 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-16T22:42:57.576 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/cluster1-a 2019-12-16T22:42:57.631 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster1 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster1.monmap --keyring /etc/ceph/cluster1.keyring 2019-12-16T22:42:57.730 INFO:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster1-a 2019-12-16T22:42:57.743 INFO:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/cluster1.monmap 2019-12-16T22:42:57.790 INFO:tasks.ceph:Starting mon daemons in cluster cluster1... 2019-12-16T22:42:57.790 INFO:tasks.ceph.cluster1.mon.a:Restarting daemon 2019-12-16T22:42:57.790 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster1 -i a 2019-12-16T22:42:57.838 INFO:tasks.ceph.cluster1.mon.a:Started 2019-12-16T22:42:57.838 INFO:tasks.ceph:Starting mgr daemons in cluster cluster1... 2019-12-16T22:42:57.838 INFO:tasks.ceph.cluster1.mgr.x:Restarting daemon 2019-12-16T22:42:57.838 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster1 -i x 2019-12-16T22:42:57.841 INFO:tasks.ceph.cluster1.mgr.x:Started 2019-12-16T22:42:57.841 INFO:tasks.ceph:Setting crush tunables to default 2019-12-16T22:42:57.841 INFO:teuthology.orchestra.run.smithi106:> sudo ceph --cluster cluster1 osd crush tunables default 2019-12-16T22:42:58.179 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2019-12-16T22:42:58.192 INFO:tasks.ceph:Starting osd daemons in cluster cluster1... 2019-12-16T22:42:58.193 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:42:58.216 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.GnEj3XWO6a 2019-12-16T22:42:58.217 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/osd/cluster1-0/fsid /tmp/tmp.GnEj3XWO6a 2019-12-16T22:42:58.277 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.GnEj3XWO6a 2019-12-16T22:42:58.394 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.GnEj3XWO6a is 37B 2019-12-16T22:42:58.412 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.GnEj3XWO6a 2019-12-16T22:42:58.419 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:42:58.468 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.pN4VzAeygY 2019-12-16T22:42:58.468 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/osd/cluster1-1/fsid /tmp/tmp.pN4VzAeygY 2019-12-16T22:42:58.527 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.pN4VzAeygY 2019-12-16T22:42:58.631 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.pN4VzAeygY is 37B 2019-12-16T22:42:58.682 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.pN4VzAeygY 2019-12-16T22:42:58.691 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:42:58.738 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.svjcTdhqQj 2019-12-16T22:42:58.739 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/osd/cluster1-2/fsid /tmp/tmp.svjcTdhqQj 2019-12-16T22:42:58.795 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.svjcTdhqQj 2019-12-16T22:42:58.900 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.svjcTdhqQj is 37B 2019-12-16T22:42:58.911 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.svjcTdhqQj 2019-12-16T22:42:58.917 INFO:teuthology.orchestra.run.smithi106:> sudo ceph --cluster cluster1 osd new 4762357c-120b-4c5a-9f38-af8248b97957 0 2019-12-16T22:42:59.162 INFO:teuthology.orchestra.run.smithi106.stdout:0 2019-12-16T22:42:59.177 INFO:teuthology.orchestra.run.smithi106:> sudo ceph --cluster cluster1 osd new 57f5653f-6c04-404f-a1f8-1b1b31636007 1 2019-12-16T22:42:59.375 INFO:teuthology.orchestra.run.smithi106.stdout:1 2019-12-16T22:42:59.387 INFO:teuthology.orchestra.run.smithi106:> sudo ceph --cluster cluster1 osd new d6dbb302-891e-4200-8c3d-dd67d8d06ce3 2 2019-12-16T22:42:59.583 INFO:teuthology.orchestra.run.smithi106.stdout:2 2019-12-16T22:42:59.595 INFO:tasks.ceph.cluster1.osd.0:Restarting daemon 2019-12-16T22:42:59.595 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 0 2019-12-16T22:42:59.597 INFO:tasks.ceph.cluster1.osd.0:Started 2019-12-16T22:42:59.597 INFO:tasks.ceph.cluster1.osd.1:Restarting daemon 2019-12-16T22:42:59.598 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 1 2019-12-16T22:42:59.600 INFO:tasks.ceph.cluster1.osd.1:Started 2019-12-16T22:42:59.600 INFO:tasks.ceph.cluster1.osd.2:Restarting daemon 2019-12-16T22:42:59.600 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 2 2019-12-16T22:42:59.603 INFO:tasks.ceph.cluster1.osd.2:Started 2019-12-16T22:42:59.603 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-16T22:42:59.906 INFO:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2019-12-16T22:42:59.962 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:42:59.959+0000 7f85dd728d80 -1 Falling back to public interface 2019-12-16T22:43:00.089 INFO:teuthology.misc.health.smithi106.stdout: 2019-12-16T22:43:00.089 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":5,"fsid":"fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af","created":"2019-12-16T22:42:57.957674+0000","modified":"2019-12-16T22:42:59.582029+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4762357c-120b-4c5a-9f38-af8248b97957","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"57f5653f-6c04-404f-a1f8-1b1b31636007","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d6dbb302-891e-4200-8c3d-dd67d8d06ce3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:00.104 DEBUG:teuthology.misc:0 of 3 OSDs are up 2019-12-16T22:43:00.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:43:00.191+0000 7f670cb0fd80 -1 Falling back to public interface 2019-12-16T22:43:00.217 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:43:00.215+0000 7f885d998d80 -1 Falling back to public interface 2019-12-16T22:43:01.118 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:43:01.115+0000 7f85dd728d80 -1 osd.1 0 log_to_monitors {default=true} 2019-12-16T22:43:01.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:43:01.351+0000 7f670cb0fd80 -1 osd.2 0 log_to_monitors {default=true} 2019-12-16T22:43:01.400 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:43:01.399+0000 7f885d998d80 -1 osd.0 0 log_to_monitors {default=true} 2019-12-16T22:43:02.998 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:43:02.995+0000 7f85c695b700 -1 osd.1 0 waiting for initial osdmap 2019-12-16T22:43:02.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:43:02.995+0000 7f66f5d42700 -1 osd.2 0 waiting for initial osdmap 2019-12-16T22:43:03.000 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:43:02.999+0000 7f8846bcb700 -1 osd.0 0 waiting for initial osdmap 2019-12-16T22:43:06.409 INFO:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2019-12-16T22:43:06.658 INFO:teuthology.misc.health.smithi106.stdout: 2019-12-16T22:43:06.658 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":9,"fsid":"fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af","created":"2019-12-16T22:42:57.957674+0000","modified":"2019-12-16T22:43:05.031969+0000","last_up_change":"2019-12-16T22:43:03.994002+0000","last_in_change":"2019-12-16T22:43:03.994002+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4762357c-120b-4c5a-9f38-af8248b97957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":12910},{"type":"v1","addr":"172.21.15.106:6817","nonce":12910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":12910},{"type":"v1","addr":"172.21.15.106:6819","nonce":12910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":12910},{"type":"v1","addr":"172.21.15.106:6823","nonce":12910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":12910},{"type":"v1","addr":"172.21.15.106:6821","nonce":12910}]},"public_addr":"172.21.15.106:6817/12910","cluster_addr":"172.21.15.106:6819/12910","heartbeat_back_addr":"172.21.15.106:6823/12910","heartbeat_front_addr":"172.21.15.106:6821/12910","state":["exists","up"]},{"osd":1,"uuid":"57f5653f-6c04-404f-a1f8-1b1b31636007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":12909},{"type":"v1","addr":"172.21.15.106:6801","nonce":12909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":12909},{"type":"v1","addr":"172.21.15.106:6803","nonce":12909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":12909},{"type":"v1","addr":"172.21.15.106:6807","nonce":12909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":12909},{"type":"v1","addr":"172.21.15.106:6805","nonce":12909}]},"public_addr":"172.21.15.106:6801/12909","cluster_addr":"172.21.15.106:6803/12909","heartbeat_back_addr":"172.21.15.106:6807/12909","heartbeat_front_addr":"172.21.15.106:6805/12909","state":["exists","up"]},{"osd":2,"uuid":"d6dbb302-891e-4200-8c3d-dd67d8d06ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":12908},{"type":"v1","addr":"172.21.15.106:6809","nonce":12908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":12908},{"type":"v1","addr":"172.21.15.106:6811","nonce":12908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":12908},{"type":"v1","addr":"172.21.15.106:6815","nonce":12908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":12908},{"type":"v1","addr":"172.21.15.106:6813","nonce":12908}]},"public_addr":"172.21.15.106:6809/12908","cluster_addr":"172.21.15.106:6811/12908","heartbeat_back_addr":"172.21.15.106:6815/12908","heartbeat_front_addr":"172.21.15.106:6813/12908","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.412549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.138013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.384573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:06.671 DEBUG:teuthology.misc:3 of 3 OSDs are up 2019-12-16T22:43:06.671 INFO:tasks.ceph:Creating RBD pool 2019-12-16T22:43:06.671 INFO:teuthology.orchestra.run.smithi106:> sudo ceph --cluster cluster1 osd pool create rbd 8 2019-12-16T22:43:07.052 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'rbd' created 2019-12-16T22:43:07.062 INFO:teuthology.orchestra.run.smithi106:> sudo ceph --cluster cluster1 osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-16T22:43:08.063 INFO:teuthology.orchestra.run.smithi106.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-16T22:43:08.073 INFO:tasks.ceph:Starting mds daemons in cluster cluster1... 2019-12-16T22:43:08.074 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2019-12-16T22:43:08.074 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-16T22:43:08.309 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:08.309 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":11,"fsid":"fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af","created":"2019-12-16T22:42:57.957674+0000","modified":"2019-12-16T22:43:08.046102+0000","last_up_change":"2019-12-16T22:43:03.994002+0000","last_in_change":"2019-12-16T22:43:03.994002+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-16T22:43:06.953812+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4762357c-120b-4c5a-9f38-af8248b97957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":12910},{"type":"v1","addr":"172.21.15.106:6817","nonce":12910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":12910},{"type":"v1","addr":"172.21.15.106:6819","nonce":12910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":12910},{"type":"v1","addr":"172.21.15.106:6823","nonce":12910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":12910},{"type":"v1","addr":"172.21.15.106:6821","nonce":12910}]},"public_addr":"172.21.15.106:6817/12910","cluster_addr":"172.21.15.106:6819/12910","heartbeat_back_addr":"172.21.15.106:6823/12910","heartbeat_front_addr":"172.21.15.106:6821/12910","state":["exists","up"]},{"osd":1,"uuid":"57f5653f-6c04-404f-a1f8-1b1b31636007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":12909},{"type":"v1","addr":"172.21.15.106:6801","nonce":12909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":12909},{"type":"v1","addr":"172.21.15.106:6803","nonce":12909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":12909},{"type":"v1","addr":"172.21.15.106:6807","nonce":12909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":12909},{"type":"v1","addr":"172.21.15.106:6805","nonce":12909}]},"public_addr":"172.21.15.106:6801/12909","cluster_addr":"172.21.15.106:6803/12909","heartbeat_back_addr":"172.21.15.106:6807/12909","heartbeat_front_addr":"172.21.15.106:6805/12909","state":["exists","up"]},{"osd":2,"uuid":"d6dbb302-891e-4200-8c3d-dd67d8d06ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":12908},{"type":"v1","addr":"172.21.15.106:6809","nonce":12908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":12908},{"type":"v1","addr":"172.21.15.106:6811","nonce":12908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":12908},{"type":"v1","addr":"172.21.15.106:6815","nonce":12908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":12908},{"type":"v1","addr":"172.21.15.106:6813","nonce":12908}]},"public_addr":"172.21.15.106:6809/12908","cluster_addr":"172.21.15.106:6811/12908","heartbeat_back_addr":"172.21.15.106:6815/12908","heartbeat_front_addr":"172.21.15.106:6813/12908","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.412549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.138013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.384573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:08.322 INFO:tasks.ceph.ceph_manager.cluster1:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-16T22:43:06.953812+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-16T22:43:08.322 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd pool get rbd pg_num 2019-12-16T22:43:08.570 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 8 2019-12-16T22:43:08.583 INFO:tasks.ceph:Waiting until cluster1 daemons up and pgs clean... 2019-12-16T22:43:08.583 INFO:tasks.ceph.ceph_manager.cluster1:waiting for mgr available 2019-12-16T22:43:08.583 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 mgr dump --format=json 2019-12-16T22:43:08.849 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:08.866 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":3,"active_gid":4098,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6824","nonce":12691},{"type":"v1","addr":"172.21.15.106:6825","nonce":12691}]},"active_addr":"172.21.15.106:6825/12691","active_change":"2019-12-16T22:43:01.712118+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[]}} 2019-12-16T22:43:08.870 INFO:tasks.ceph.ceph_manager.cluster1:mgr available! 2019-12-16T22:43:08.870 INFO:tasks.ceph.ceph_manager.cluster1:waiting for all up 2019-12-16T22:43:08.870 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2019-12-16T22:43:09.128 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:09.129 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":12,"fsid":"fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af","created":"2019-12-16T22:42:57.957674+0000","modified":"2019-12-16T22:43:09.052035+0000","last_up_change":"2019-12-16T22:43:03.994002+0000","last_in_change":"2019-12-16T22:43:03.994002+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-16T22:43:06.953812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4762357c-120b-4c5a-9f38-af8248b97957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":12910},{"type":"v1","addr":"172.21.15.106:6817","nonce":12910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":12910},{"type":"v1","addr":"172.21.15.106:6819","nonce":12910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":12910},{"type":"v1","addr":"172.21.15.106:6823","nonce":12910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":12910},{"type":"v1","addr":"172.21.15.106:6821","nonce":12910}]},"public_addr":"172.21.15.106:6817/12910","cluster_addr":"172.21.15.106:6819/12910","heartbeat_back_addr":"172.21.15.106:6823/12910","heartbeat_front_addr":"172.21.15.106:6821/12910","state":["exists","up"]},{"osd":1,"uuid":"57f5653f-6c04-404f-a1f8-1b1b31636007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":12909},{"type":"v1","addr":"172.21.15.106:6801","nonce":12909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":12909},{"type":"v1","addr":"172.21.15.106:6803","nonce":12909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":12909},{"type":"v1","addr":"172.21.15.106:6807","nonce":12909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":12909},{"type":"v1","addr":"172.21.15.106:6805","nonce":12909}]},"public_addr":"172.21.15.106:6801/12909","cluster_addr":"172.21.15.106:6803/12909","heartbeat_back_addr":"172.21.15.106:6807/12909","heartbeat_front_addr":"172.21.15.106:6805/12909","state":["exists","up"]},{"osd":2,"uuid":"d6dbb302-891e-4200-8c3d-dd67d8d06ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":12908},{"type":"v1","addr":"172.21.15.106:6809","nonce":12908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":12908},{"type":"v1","addr":"172.21.15.106:6811","nonce":12908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":12908},{"type":"v1","addr":"172.21.15.106:6815","nonce":12908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":12908},{"type":"v1","addr":"172.21.15.106:6813","nonce":12908}]},"public_addr":"172.21.15.106:6809/12908","cluster_addr":"172.21.15.106:6811/12908","heartbeat_back_addr":"172.21.15.106:6815/12908","heartbeat_front_addr":"172.21.15.106:6813/12908","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.412549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.138013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.384573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:09.145 INFO:tasks.ceph.ceph_manager.cluster1:all up! 2019-12-16T22:43:09.145 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2019-12-16T22:43:09.386 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:09.387 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":12,"fsid":"fb59f1b4-9c4b-4ba6-94f2-27a9e694c9af","created":"2019-12-16T22:42:57.957674+0000","modified":"2019-12-16T22:43:09.052035+0000","last_up_change":"2019-12-16T22:43:03.994002+0000","last_in_change":"2019-12-16T22:43:03.994002+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-16T22:43:06.953812+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4762357c-120b-4c5a-9f38-af8248b97957","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6816","nonce":12910},{"type":"v1","addr":"172.21.15.106:6817","nonce":12910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6818","nonce":12910},{"type":"v1","addr":"172.21.15.106:6819","nonce":12910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6822","nonce":12910},{"type":"v1","addr":"172.21.15.106:6823","nonce":12910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6820","nonce":12910},{"type":"v1","addr":"172.21.15.106:6821","nonce":12910}]},"public_addr":"172.21.15.106:6817/12910","cluster_addr":"172.21.15.106:6819/12910","heartbeat_back_addr":"172.21.15.106:6823/12910","heartbeat_front_addr":"172.21.15.106:6821/12910","state":["exists","up"]},{"osd":1,"uuid":"57f5653f-6c04-404f-a1f8-1b1b31636007","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6800","nonce":12909},{"type":"v1","addr":"172.21.15.106:6801","nonce":12909}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6802","nonce":12909},{"type":"v1","addr":"172.21.15.106:6803","nonce":12909}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6806","nonce":12909},{"type":"v1","addr":"172.21.15.106:6807","nonce":12909}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6804","nonce":12909},{"type":"v1","addr":"172.21.15.106:6805","nonce":12909}]},"public_addr":"172.21.15.106:6801/12909","cluster_addr":"172.21.15.106:6803/12909","heartbeat_back_addr":"172.21.15.106:6807/12909","heartbeat_front_addr":"172.21.15.106:6805/12909","state":["exists","up"]},{"osd":2,"uuid":"d6dbb302-891e-4200-8c3d-dd67d8d06ce3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6808","nonce":12908},{"type":"v1","addr":"172.21.15.106:6809","nonce":12908}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6810","nonce":12908},{"type":"v1","addr":"172.21.15.106:6811","nonce":12908}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6814","nonce":12908},{"type":"v1","addr":"172.21.15.106:6815","nonce":12908}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6812","nonce":12908},{"type":"v1","addr":"172.21.15.106:6813","nonce":12908}]},"public_addr":"172.21.15.106:6809/12908","cluster_addr":"172.21.15.106:6811/12908","heartbeat_back_addr":"172.21.15.106:6815/12908","heartbeat_front_addr":"172.21.15.106:6813/12908","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.412549+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.138013+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:02.384573+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:09.399 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.0 flush_pg_stats 2019-12-16T22:43:09.564 INFO:teuthology.orchestra.run.smithi106.stdout:34359738371 2019-12-16T22:43:09.564 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.1 flush_pg_stats 2019-12-16T22:43:09.724 INFO:teuthology.orchestra.run.smithi106.stdout:34359738371 2019-12-16T22:43:09.725 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.2 flush_pg_stats 2019-12-16T22:43:09.877 INFO:teuthology.orchestra.run.smithi106.stdout:34359738372 2019-12-16T22:43:09.878 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2019-12-16T22:43:10.125 INFO:teuthology.orchestra.run.smithi106.stdout:34359738371 2019-12-16T22:43:10.138 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738371 got 34359738371 for osd.0 2019-12-16T22:43:10.139 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2019-12-16T22:43:10.374 INFO:teuthology.orchestra.run.smithi106.stdout:34359738371 2019-12-16T22:43:10.392 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738371 got 34359738371 for osd.1 2019-12-16T22:43:10.393 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2019-12-16T22:43:10.637 INFO:teuthology.orchestra.run.smithi106.stdout:34359738371 2019-12-16T22:43:10.650 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738372 got 34359738371 for osd.2 2019-12-16T22:43:11.650 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2019-12-16T22:43:11.907 INFO:teuthology.orchestra.run.smithi106.stdout:34359738371 2019-12-16T22:43:11.920 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738372 got 34359738371 for osd.2 2019-12-16T22:43:12.920 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2019-12-16T22:43:13.177 INFO:teuthology.orchestra.run.smithi106.stdout:34359738372 2019-12-16T22:43:13.185 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738372 got 34359738372 for osd.2 2019-12-16T22:43:13.186 INFO:tasks.ceph.ceph_manager.cluster1:waiting for clean 2019-12-16T22:43:13.186 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2019-12-16T22:43:13.424 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:13.427 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2019-12-16T22:43:13.436 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2019-12-16T22:43:11.721794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146044,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969476,"statfs":{"total":289910292480,"available":286688743424,"internally_reserved":3221225472,"allocated":299008,"data_stored":73596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.061925+0000","last_change":"2019-12-16T22:43:08.061925+0000","last_active":"2019-12-16T22:43:08.061925+0000","last_peered":"2019-12-16T22:43:08.061925+0000","last_clean":"2019-12-16T22:43:08.061925+0000","last_became_active":"2019-12-16T22:43:08.061443+0000","last_became_peered":"2019-12-16T22:43:08.061443+0000","last_unstale":"2019-12-16T22:43:08.061925+0000","last_undegraded":"2019-12-16T22:43:08.061925+0000","last_fullsized":"2019-12-16T22:43:08.061925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.063697+0000","last_change":"2019-12-16T22:43:08.063697+0000","last_active":"2019-12-16T22:43:08.063697+0000","last_peered":"2019-12-16T22:43:08.063697+0000","last_clean":"2019-12-16T22:43:08.063697+0000","last_became_active":"2019-12-16T22:43:08.063316+0000","last_became_peered":"2019-12-16T22:43:08.063316+0000","last_unstale":"2019-12-16T22:43:08.063697+0000","last_undegraded":"2019-12-16T22:43:08.063697+0000","last_fullsized":"2019-12-16T22:43:08.063697+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.063268+0000","last_change":"2019-12-16T22:43:08.062223+0000","last_active":"2019-12-16T22:43:08.063268+0000","last_peered":"2019-12-16T22:43:08.063268+0000","last_clean":"2019-12-16T22:43:08.063268+0000","last_became_active":"2019-12-16T22:43:08.061739+0000","last_became_peered":"2019-12-16T22:43:08.061739+0000","last_unstale":"2019-12-16T22:43:08.063268+0000","last_undegraded":"2019-12-16T22:43:08.063268+0000","last_fullsized":"2019-12-16T22:43:08.063268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.059804+0000","last_change":"2019-12-16T22:43:08.059804+0000","last_active":"2019-12-16T22:43:08.059804+0000","last_peered":"2019-12-16T22:43:08.059804+0000","last_clean":"2019-12-16T22:43:08.059804+0000","last_became_active":"2019-12-16T22:43:08.059379+0000","last_became_peered":"2019-12-16T22:43:08.059379+0000","last_unstale":"2019-12-16T22:43:08.059804+0000","last_undegraded":"2019-12-16T22:43:08.059804+0000","last_fullsized":"2019-12-16T22:43:08.059804+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.065209+0000","last_change":"2019-12-16T22:43:08.064824+0000","last_active":"2019-12-16T22:43:08.065209+0000","last_peered":"2019-12-16T22:43:08.065209+0000","last_clean":"2019-12-16T22:43:08.065209+0000","last_became_active":"2019-12-16T22:43:08.064448+0000","last_became_peered":"2019-12-16T22:43:08.064448+0000","last_unstale":"2019-12-16T22:43:08.065209+0000","last_undegraded":"2019-12-16T22:43:08.065209+0000","last_fullsized":"2019-12-16T22:43:08.065209+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.059924+0000","last_change":"2019-12-16T22:43:08.059924+0000","last_active":"2019-12-16T22:43:08.059924+0000","last_peered":"2019-12-16T22:43:08.059924+0000","last_clean":"2019-12-16T22:43:08.059924+0000","last_became_active":"2019-12-16T22:43:08.059518+0000","last_became_peered":"2019-12-16T22:43:08.059518+0000","last_unstale":"2019-12-16T22:43:08.059924+0000","last_undegraded":"2019-12-16T22:43:08.059924+0000","last_fullsized":"2019-12-16T22:43:08.059924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.062040+0000","last_change":"2019-12-16T22:43:08.062040+0000","last_active":"2019-12-16T22:43:08.062040+0000","last_peered":"2019-12-16T22:43:08.062040+0000","last_clean":"2019-12-16T22:43:08.062040+0000","last_became_active":"2019-12-16T22:43:08.061465+0000","last_became_peered":"2019-12-16T22:43:08.061465+0000","last_unstale":"2019-12-16T22:43:08.062040+0000","last_undegraded":"2019-12-16T22:43:08.062040+0000","last_fullsized":"2019-12-16T22:43:08.062040+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.063284+0000","last_change":"2019-12-16T22:43:08.062814+0000","last_active":"2019-12-16T22:43:08.063284+0000","last_peered":"2019-12-16T22:43:08.063284+0000","last_clean":"2019-12-16T22:43:08.063284+0000","last_became_active":"2019-12-16T22:43:08.062422+0000","last_became_peered":"2019-12-16T22:43:08.062422+0000","last_unstale":"2019-12-16T22:43:08.063284+0000","last_undegraded":"2019-12-16T22:43:08.063284+0000","last_fullsized":"2019-12-16T22:43:08.063284+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":23687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.433}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":26800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.410}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.563}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048676,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323164,"statfs":{"total":96636764160,"available":95562919936,"internally_reserved":1073741824,"allocated":94208,"data_stored":23109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.475}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.700}]}]}]}} 2019-12-16T22:43:13.438 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2019-12-16T22:43:13.680 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:13.682 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2019-12-16T22:43:13.693 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2019-12-16T22:43:11.721794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146044,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969476,"statfs":{"total":289910292480,"available":286688743424,"internally_reserved":3221225472,"allocated":299008,"data_stored":73596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.061925+0000","last_change":"2019-12-16T22:43:08.061925+0000","last_active":"2019-12-16T22:43:08.061925+0000","last_peered":"2019-12-16T22:43:08.061925+0000","last_clean":"2019-12-16T22:43:08.061925+0000","last_became_active":"2019-12-16T22:43:08.061443+0000","last_became_peered":"2019-12-16T22:43:08.061443+0000","last_unstale":"2019-12-16T22:43:08.061925+0000","last_undegraded":"2019-12-16T22:43:08.061925+0000","last_fullsized":"2019-12-16T22:43:08.061925+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.063697+0000","last_change":"2019-12-16T22:43:08.063697+0000","last_active":"2019-12-16T22:43:08.063697+0000","last_peered":"2019-12-16T22:43:08.063697+0000","last_clean":"2019-12-16T22:43:08.063697+0000","last_became_active":"2019-12-16T22:43:08.063316+0000","last_became_peered":"2019-12-16T22:43:08.063316+0000","last_unstale":"2019-12-16T22:43:08.063697+0000","last_undegraded":"2019-12-16T22:43:08.063697+0000","last_fullsized":"2019-12-16T22:43:08.063697+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.063268+0000","last_change":"2019-12-16T22:43:08.062223+0000","last_active":"2019-12-16T22:43:08.063268+0000","last_peered":"2019-12-16T22:43:08.063268+0000","last_clean":"2019-12-16T22:43:08.063268+0000","last_became_active":"2019-12-16T22:43:08.061739+0000","last_became_peered":"2019-12-16T22:43:08.061739+0000","last_unstale":"2019-12-16T22:43:08.063268+0000","last_undegraded":"2019-12-16T22:43:08.063268+0000","last_fullsized":"2019-12-16T22:43:08.063268+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.059804+0000","last_change":"2019-12-16T22:43:08.059804+0000","last_active":"2019-12-16T22:43:08.059804+0000","last_peered":"2019-12-16T22:43:08.059804+0000","last_clean":"2019-12-16T22:43:08.059804+0000","last_became_active":"2019-12-16T22:43:08.059379+0000","last_became_peered":"2019-12-16T22:43:08.059379+0000","last_unstale":"2019-12-16T22:43:08.059804+0000","last_undegraded":"2019-12-16T22:43:08.059804+0000","last_fullsized":"2019-12-16T22:43:08.059804+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.065209+0000","last_change":"2019-12-16T22:43:08.064824+0000","last_active":"2019-12-16T22:43:08.065209+0000","last_peered":"2019-12-16T22:43:08.065209+0000","last_clean":"2019-12-16T22:43:08.065209+0000","last_became_active":"2019-12-16T22:43:08.064448+0000","last_became_peered":"2019-12-16T22:43:08.064448+0000","last_unstale":"2019-12-16T22:43:08.065209+0000","last_undegraded":"2019-12-16T22:43:08.065209+0000","last_fullsized":"2019-12-16T22:43:08.065209+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.059924+0000","last_change":"2019-12-16T22:43:08.059924+0000","last_active":"2019-12-16T22:43:08.059924+0000","last_peered":"2019-12-16T22:43:08.059924+0000","last_clean":"2019-12-16T22:43:08.059924+0000","last_became_active":"2019-12-16T22:43:08.059518+0000","last_became_peered":"2019-12-16T22:43:08.059518+0000","last_unstale":"2019-12-16T22:43:08.059924+0000","last_undegraded":"2019-12-16T22:43:08.059924+0000","last_fullsized":"2019-12-16T22:43:08.059924+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.062040+0000","last_change":"2019-12-16T22:43:08.062040+0000","last_active":"2019-12-16T22:43:08.062040+0000","last_peered":"2019-12-16T22:43:08.062040+0000","last_clean":"2019-12-16T22:43:08.062040+0000","last_became_active":"2019-12-16T22:43:08.061465+0000","last_became_peered":"2019-12-16T22:43:08.061465+0000","last_unstale":"2019-12-16T22:43:08.062040+0000","last_undegraded":"2019-12-16T22:43:08.062040+0000","last_fullsized":"2019-12-16T22:43:08.062040+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:08.063284+0000","last_change":"2019-12-16T22:43:08.062814+0000","last_active":"2019-12-16T22:43:08.063284+0000","last_peered":"2019-12-16T22:43:08.063284+0000","last_clean":"2019-12-16T22:43:08.063284+0000","last_became_active":"2019-12-16T22:43:08.062422+0000","last_became_peered":"2019-12-16T22:43:08.062422+0000","last_unstale":"2019-12-16T22:43:08.063284+0000","last_undegraded":"2019-12-16T22:43:08.063284+0000","last_fullsized":"2019-12-16T22:43:08.063284+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:07.040306+0000","last_clean_scrub_stamp":"2019-12-16T22:43:07.040306+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":23687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.626}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.433}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":26800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.410}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.563}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048676,"kb_used_data":92,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323164,"statfs":{"total":96636764160,"available":95562919936,"internally_reserved":1073741824,"allocated":94208,"data_stored":23109,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.475}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.700}]}]}]}} 2019-12-16T22:43:13.695 INFO:tasks.ceph.ceph_manager.cluster1:clean! 2019-12-16T22:43:13.695 INFO:tasks.ceph:Waiting until ceph cluster cluster1 is healthy... 2019-12-16T22:43:13.695 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy 2019-12-16T22:43:13.695 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 health --format=json 2019-12-16T22:43:13.964 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:13.977 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-16T22:43:13.977 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy done 2019-12-16T22:43:13.978 INFO:teuthology.run_tasks:Running task ceph... 2019-12-16T22:43:13.989 INFO:tasks.ceph:Creating ceph cluster cluster2... 2019-12-16T22:43:13.989 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'cluster2', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'ms inject socket failures': 5000, 'mon client directed command retry': 5}, 'client': {'debug rbd': 20, 'rbd mirror image policy type': 'none', 'rbd default features': 125, 'debug rbd_mirror': 15, 'log to stderr': False}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'stupid', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}} 2019-12-16T22:43:13.989 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455', 'extra_packages': ['rbd-mirror']}}, {'ceph': {'cluster': 'cluster1', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'fs': 'xfs', 'conf': {'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'ms inject socket failures': 5000, 'mon client directed command retry': 5}, 'client': {'debug rbd': 20, 'rbd mirror image policy type': 'none', 'rbd default features': 125, 'debug rbd_mirror': 15, 'log to stderr': False}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'stupid', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}, 'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}}, {'ceph': {'cluster': 'cluster2', 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'fs': 'xfs', 'conf': {'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'ms inject socket failures': 5000, 'mon client directed command retry': 5}, 'client': {'debug rbd': 20, 'rbd mirror image policy type': 'none', 'rbd default features': 125, 'debug rbd_mirror': 15, 'log to stderr': False}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'stupid', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}, 'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.0'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.1'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.2'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster1.client.mirror.3'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.0'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.1'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.2'}}, {'rbd-mirror': {'thrash': True, 'client': 'cluster2.client.mirror.3'}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_prepare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_USE_RBD_MIRROR': '1', 'RBD_MIRROR_NOCLEANUP': '1', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1'}}}, {'rbd_fsx': {'pool_name': 'mirror', 'clients': ['cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5'], 'keep_images': True, 'ops': 6000}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_fsx_compare.sh']}, 'env': {'CEPH_ARGS': '', 'RBD_MIRROR_USE_RBD_MIRROR': '1', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1'}, 'timeout': '6h'}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.22728', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run multiple FSX workloads to simulate cluster load and then verify that the images were replicated'}], 'owner': 'scheduled_sage@teuthology', 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'targets': {'smithi106.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDz46hE/59V6G/yY7M/2TcudEH6hit23kIisw/8xoAMEnZSpLxOaZQaR8Cyn88j4jCN/k9GhXkjenp8UlNVZB3aOCbtRpXa+3+4NdnSmpk69ZOgClgfoAX9beOKoAbaDlJOdkbIfrgluBsn70iLBUYWbNBklKvq7zbjZtKphpMUxQADNloIrDR/+n0a0G/a9Yg9jZiWnUEESvrGIL7xsdQtYGgbs21wl5iBW8PnCZcKtlVR7hBvjmQlybI9O7tzT3x6rcHZiqEWHMrg2iOiqufrguPFe6qYOnnDg0JNrgn1iana8j0c1VUUUV21Ez06/zG7mof0Nxm+Gf3lQATzFF/N', 'smithi177.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV9HN4RP8xt43fd1193v7nr3U1BKwbZalDDz2rHylogjDJF1i7HwRkIiA3+qlgk1J3ZLt5vXF2Cu+pblnxitk4eI/70mwibcTmSE7vgBy4I5Dz5Ttu0ElVyIwiIX7T+32F2vaHT2+izWPvsBpQvXj529V0JUbd5HNtXycizW+Igy/GePuwM9YJtK5MHMYhIx/kjpdnoDMwhyU/9eOuYu/PssnWbgnvUsSSJ6Vl+LAcysYHDl3dkUtbXU1gzny0+0CEFspT++vUaknpbvt06em9ZHnziQRIHMS7YkKhV9yAe+l1ksB2Dtml3dNm194LPYEPnST1S/2bxn90SNE+nfMv'}, 'job_id': '4609548', 'tube': 'smithi', 'suite_branch': 'wip-sage3-testing-2019-12-16-1157', 'priority': 49, 'os_version': '18.04', 'first_in_suite': False, 'branch': 'wip-sage3-testing-2019-12-16-1157', 'suite': 'rbd', 'email': None, 'archive_path': '/home/teuthworker/archive/sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi/4609548', 'description': 'rbd/mirror-thrash/{base/install.yaml clients/mirror.yaml cluster/{2-node.yaml openstack.yaml} msgr-failures/few.yaml objectstore/bluestore-stupid.yaml policy/none.yaml rbd-mirror/four-per-cluster.yaml supported-random-distro$/{ubuntu_latest.yaml} workloads/rbd-mirror-fsx-workunit.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455', 'name': 'sage-2019-12-16_22:14:24-rbd-wip-sage3-testing-2019-12-16-1157-distro-basic-smithi', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'conf': {'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'ms inject socket failures': 5000, 'mon client directed command retry': 5}, 'client': {'debug rbd': 20, 'rbd mirror image policy type': 'none', 'rbd default features': 125, 'debug rbd_mirror': 15, 'log to stderr': False}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'debug rocksdb': 10, 'debug journal': 20, 'bluestore allocator': 'stupid', 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'bdev async discard': True, 'bluestore block size': 96636764160, 'debug filestore': 20, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95}}, 'fs': 'xfs', 'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}, 'ceph-deploy': {'fs': 'xfs', 'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'mon osd full ratio': 0.9, 'mon osd backfillfull_ratio': 0.85, 'bluestore fsck on mount': True, 'mon osd nearfull ratio': 0.8, 'debug bluestore': 20, 'debug bluefs': 20, 'osd objectstore': 'bluestore', 'bluestore block size': 96636764160, 'debug rocksdb': 10, 'bdev enable discard': True, 'osd failsafe full ratio': 0.95, 'bdev async discard': True}}}, 'install': {'ceph': {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'}}, 'admin_socket': {'branch': 'wip-sage3-testing-2019-12-16-1157'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'workunit': {'sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455', 'branch': 'wip-sage3-testing-2019-12-16-1157'}}, 'os_type': 'ubuntu', 'suite_sha1': '8a58d0694cce968d9a21937d52c2e48cfe306455'} 2019-12-16T22:43:13.990 INFO:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2019-12-16T22:43:13.992 INFO:teuthology.orchestra.run.smithi177:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2019-12-16T22:43:14.000 INFO:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2019-12-16T22:43:14.041 INFO:teuthology.orchestra.run.smithi177:> sudo install -d -m0777 -- /var/run/ceph 2019-12-16T22:43:14.106 DEBUG:teuthology.orchestra.remote:smithi177:/scratch_devs is 72B 2019-12-16T22:43:14.125 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-16T22:43:14.125 INFO:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-16T22:43:14.133 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2019-12-16T22:43:14.134 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:43:14.134 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 452 Links: 1 2019-12-16T22:43:14.134 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:43:14.134 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2019-12-16 22:40:22.483420502 +0000 2019-12-16T22:43:14.134 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2019-12-16 22:40:22.479418503 +0000 2019-12-16T22:43:14.134 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2019-12-16 22:40:22.479418503 +0000 2019-12-16T22:43:14.135 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2019-12-16T22:43:14.143 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2019-12-16T22:43:14.143 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2019-12-16T22:43:14.143 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000314291 s, 1.6 MB/s 2019-12-16T22:43:14.148 INFO:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-16T22:43:14.222 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2019-12-16T22:43:14.222 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:43:14.222 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 458 Links: 1 2019-12-16T22:43:14.223 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:43:14.223 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2019-12-16 22:40:22.887622494 +0000 2019-12-16T22:43:14.224 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2019-12-16 22:40:22.759558496 +0000 2019-12-16T22:43:14.224 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2019-12-16 22:40:22.759558496 +0000 2019-12-16T22:43:14.225 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2019-12-16T22:43:14.227 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2019-12-16T22:43:14.228 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2019-12-16T22:43:14.228 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.00035913 s, 1.4 MB/s 2019-12-16T22:43:14.230 INFO:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-16T22:43:14.509 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2019-12-16T22:43:14.509 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:43:14.509 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 464 Links: 1 2019-12-16T22:43:14.509 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:43:14.509 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2019-12-16 22:40:23.147752488 +0000 2019-12-16T22:43:14.509 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2019-12-16 22:40:23.035696490 +0000 2019-12-16T22:43:14.510 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2019-12-16 22:40:23.035696490 +0000 2019-12-16T22:43:14.510 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2019-12-16T22:43:14.518 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2019-12-16T22:43:14.518 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2019-12-16T22:43:14.518 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000325876 s, 1.6 MB/s 2019-12-16T22:43:14.522 INFO:teuthology.orchestra.run.smithi177:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-16T22:43:14.580 INFO:teuthology.orchestra.run.smithi177.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2019-12-16T22:43:14.580 INFO:teuthology.orchestra.run.smithi177.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-16T22:43:14.581 INFO:teuthology.orchestra.run.smithi177.stdout:Device: 6h/6d Inode: 470 Links: 1 2019-12-16T22:43:14.581 INFO:teuthology.orchestra.run.smithi177.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-16T22:43:14.581 INFO:teuthology.orchestra.run.smithi177.stdout:Access: 2019-12-16 22:42:30.464450576 +0000 2019-12-16T22:43:14.581 INFO:teuthology.orchestra.run.smithi177.stdout:Modify: 2019-12-16 22:40:23.307832485 +0000 2019-12-16T22:43:14.581 INFO:teuthology.orchestra.run.smithi177.stdout:Change: 2019-12-16 22:40:23.307832485 +0000 2019-12-16T22:43:14.581 INFO:teuthology.orchestra.run.smithi177.stdout: Birth: - 2019-12-16T22:43:14.590 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records in 2019-12-16T22:43:14.590 INFO:teuthology.orchestra.run.smithi177.stderr:1+0 records out 2019-12-16T22:43:14.590 INFO:teuthology.orchestra.run.smithi177.stderr:512 bytes copied, 0.000406091 s, 1.3 MB/s 2019-12-16T22:43:14.594 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-16T22:43:14.594 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-16T22:43:14.594 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-16T22:43:14.594 INFO:tasks.ceph:dev map: {'cluster2.osd.0': '/dev/vg_nvme/lv_4', 'cluster2.osd.1': '/dev/vg_nvme/lv_1', 'cluster2.osd.2': '/dev/vg_nvme/lv_2'} 2019-12-16T22:43:14.594 INFO:tasks.ceph:Generating config... 2019-12-16T22:43:14.596 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.596 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.596 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.596 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.597 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.597 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.597 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.597 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.597 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-12-16T22:43:14.597 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-12-16T22:43:14.598 INFO:tasks.ceph:[client] debug rbd = 20 2019-12-16T22:43:14.598 INFO:tasks.ceph:[client] rbd mirror image policy type = none 2019-12-16T22:43:14.598 INFO:tasks.ceph:[client] rbd default features = 125 2019-12-16T22:43:14.598 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2019-12-16T22:43:14.598 INFO:tasks.ceph:[client] log to stderr = False 2019-12-16T22:43:14.598 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-16T22:43:14.598 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-16T22:43:14.598 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] debug bluestore = 20 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] debug bluefs = 20 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2019-12-16T22:43:14.599 INFO:tasks.ceph:[osd] debug rocksdb = 10 2019-12-16T22:43:14.600 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-16T22:43:14.600 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2019-12-16T22:43:14.600 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2019-12-16T22:43:14.600 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2019-12-16T22:43:14.600 INFO:tasks.ceph:[osd] bdev async discard = True 2019-12-16T22:43:14.600 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2019-12-16T22:43:14.600 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-16T22:43:14.601 INFO:tasks.ceph:[osd] bdev enable discard = True 2019-12-16T22:43:14.601 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2019-12-16T22:43:14.601 INFO:tasks.ceph:Setting up cluster2.mon.a... 2019-12-16T22:43:14.602 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster2.keyring 2019-12-16T22:43:14.673 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.keyring 2019-12-16T22:43:14.675 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster2.keyring 2019-12-16T22:43:14.755 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2019-12-16T22:43:14.814 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster2.mon.a', '172.21.15.177')] 2019-12-16T22:43:14.814 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.177 --print /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:14.888 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:14.888 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: generated fsid d324a855-8f0b-4b8a-87f5-c61523c13839 2019-12-16T22:43:14.888 INFO:teuthology.orchestra.run.smithi177.stdout:epoch 0 2019-12-16T22:43:14.889 INFO:teuthology.orchestra.run.smithi177.stdout:fsid d324a855-8f0b-4b8a-87f5-c61523c13839 2019-12-16T22:43:14.889 INFO:teuthology.orchestra.run.smithi177.stdout:last_changed 2019-12-16T22:43:14.891155+0000 2019-12-16T22:43:14.889 INFO:teuthology.orchestra.run.smithi177.stdout:created 2019-12-16T22:43:14.891155+0000 2019-12-16T22:43:14.889 INFO:teuthology.orchestra.run.smithi177.stdout:min_mon_release 0 (unknown) 2019-12-16T22:43:14.889 INFO:teuthology.orchestra.run.smithi177.stdout:0: [v2:172.21.15.177:3300/0,v1:172.21.15.177:6789/0] mon.a 2019-12-16T22:43:14.889 INFO:teuthology.orchestra.run.smithi177.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster2.monmap (1 monitors) 2019-12-16T22:43:14.890 INFO:tasks.ceph:Writing /etc/ceph/cluster2.conf for FSID d324a855-8f0b-4b8a-87f5-c61523c13839... 2019-12-16T22:43:14.891 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2019-12-16T22:43:14.894 INFO:teuthology.orchestra.run.smithi177:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2019-12-16T22:43:14.937 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2019-12-16T22:43:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2019-12-16T22:43:14.937 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2019-12-16T22:43:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2019-12-16T22:43:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2019-12-16T22:43:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2019-12-16T22:43:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.938 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2019-12-16T22:43:14.939 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2019-12-16T22:43:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2019-12-16T22:43:14.940 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2019-12-16T22:43:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.941 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2019-12-16T22:43:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2019-12-16T22:43:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2019-12-16T22:43:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2019-12-16T22:43:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2019-12-16T22:43:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2019-12-16T22:43:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2019-12-16T22:43:14.942 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2019-12-16T22:43:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2019-12-16T22:43:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2019-12-16T22:43:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2019-12-16T22:43:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.943 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2019-12-16T22:43:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2019-12-16T22:43:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2019-12-16T22:43:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = 172.21.15.177 2019-12-16T22:43:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 5000 2019-12-16T22:43:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2019-12-16T22:43:14.944 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = d324a855-8f0b-4b8a-87f5-c61523c13839 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.945 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2019-12-16T22:43:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2019-12-16T22:43:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2019-12-16T22:43:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2019-12-16T22:43:14.946 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2019-12-16T22:43:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2019-12-16T22:43:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2019-12-16T22:43:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2019-12-16T22:43:14.947 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2019-12-16T22:43:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2019-12-16T22:43:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2019-12-16T22:43:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2019-12-16T22:43:14.948 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2019-12-16T22:43:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2019-12-16T22:43:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2019-12-16T22:43:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2019-12-16T22:43:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2019-12-16T22:43:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 25 2019-12-16T22:43:14.949 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2019-12-16T22:43:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2019-12-16T22:43:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2019-12-16T22:43:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2019-12-16T22:43:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: debug journal = 20 2019-12-16T22:43:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore allocator = stupid 2019-12-16T22:43:14.950 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2019-12-16T22:43:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2019-12-16T22:43:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: bdev async discard = True 2019-12-16T22:43:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2019-12-16T22:43:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: debug filestore = 20 2019-12-16T22:43:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: bdev enable discard = True 2019-12-16T22:43:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2019-12-16T22:43:14.951 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.952 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2019-12-16T22:43:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2019-12-16T22:43:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2019-12-16T22:43:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2019-12-16T22:43:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2019-12-16T22:43:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:43:14.952 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:43:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2019-12-16T22:43:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.953 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2019-12-16T22:43:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2019-12-16T22:43:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2019-12-16T22:43:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2019-12-16T22:43:14.953 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2019-12-16T22:43:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2019-12-16T22:43:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2019-12-16T22:43:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:43:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2019-12-16T22:43:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2019-12-16T22:43:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:43:14.954 INFO:teuthology.orchestra.run.smithi106.stdout: 2019-12-16T22:43:14.955 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2019-12-16T22:43:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2019-12-16T22:43:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2019-12-16T22:43:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2019-12-16T22:43:14.955 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2019-12-16T22:43:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2019-12-16T22:43:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug rbd = 20 2019-12-16T22:43:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: rbd mirror image policy type = none 2019-12-16T22:43:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: rbd default features = 125 2019-12-16T22:43:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: debug rbd_mirror = 15 2019-12-16T22:43:14.956 INFO:teuthology.orchestra.run.smithi106.stdout: log to stderr = False 2019-12-16T22:43:14.957 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2019-12-16T22:43:14.957 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.1] 2019-12-16T22:43:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.957 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.957 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.0] 2019-12-16T22:43:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.958 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.3] 2019-12-16T22:43:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.958 INFO:teuthology.orchestra.run.smithi106.stdout:[client.mirror.2] 2019-12-16T22:43:14.958 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:14.959 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:14.983 INFO:teuthology.orchestra.run.smithi177.stdout:[global] 2019-12-16T22:43:14.983 INFO:teuthology.orchestra.run.smithi177.stdout: chdir = "" 2019-12-16T22:43:14.984 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2019-12-16T22:43:14.984 INFO:teuthology.orchestra.run.smithi177.stdout: auth supported = cephx 2019-12-16T22:43:14.984 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.984 INFO:teuthology.orchestra.run.smithi177.stdout: filestore xattr use omap = true 2019-12-16T22:43:14.984 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.985 INFO:teuthology.orchestra.run.smithi177.stdout: mon clock drift allowed = 1.000 2019-12-16T22:43:14.985 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.986 INFO:teuthology.orchestra.run.smithi177.stdout: osd crush chooseleaf type = 0 2019-12-16T22:43:14.986 INFO:teuthology.orchestra.run.smithi177.stdout: auth debug = true 2019-12-16T22:43:14.986 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.987 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on old message = true 2019-12-16T22:43:14.987 INFO:teuthology.orchestra.run.smithi177.stdout: ms die on bug = true 2019-12-16T22:43:14.987 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.988 INFO:teuthology.orchestra.run.smithi177.stdout: mon max pg per osd = 10000 # >= luminous 2019-12-16T22:43:14.988 INFO:teuthology.orchestra.run.smithi177.stdout: mon pg warn max object skew = 0 2019-12-16T22:43:14.988 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.988 INFO:teuthology.orchestra.run.smithi177.stdout: # disable pg_autoscaler by default for new pools 2019-12-16T22:43:14.988 INFO:teuthology.orchestra.run.smithi177.stdout: osd_pool_default_pg_autoscale_mode = off 2019-12-16T22:43:14.988 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.989 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default size = 2 2019-12-16T22:43:14.989 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.989 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow primary affinity = true 2019-12-16T22:43:14.989 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd allow pg remap = true 2019-12-16T22:43:14.989 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on legacy crush tunables = false 2019-12-16T22:43:14.989 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on crush straw calc version zero = false 2019-12-16T22:43:14.989 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on no sortbitwise = false 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on osd down out interval zero = false 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: mon warn on too few osds = false 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: mon_warn_on_pool_no_redundancy = false 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.990 INFO:teuthology.orchestra.run.smithi177.stdout: osd default data pool replay window = 5 2019-12-16T22:43:14.991 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.991 INFO:teuthology.orchestra.run.smithi177.stdout: mon allow pool delete = true 2019-12-16T22:43:14.991 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.991 INFO:teuthology.orchestra.run.smithi177.stdout: mon cluster log file level = debug 2019-12-16T22:43:14.991 INFO:teuthology.orchestra.run.smithi177.stdout: debug asserts on shutdown = true 2019-12-16T22:43:14.991 INFO:teuthology.orchestra.run.smithi177.stdout: mon host = 172.21.15.177 2019-12-16T22:43:14.992 INFO:teuthology.orchestra.run.smithi177.stdout: ms inject socket failures = 5000 2019-12-16T22:43:14.992 INFO:teuthology.orchestra.run.smithi177.stdout: mon client directed command retry = 5 2019-12-16T22:43:14.992 INFO:teuthology.orchestra.run.smithi177.stdout: fsid = d324a855-8f0b-4b8a-87f5-c61523c13839 2019-12-16T22:43:14.993 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.993 INFO:teuthology.orchestra.run.smithi177.stdout:[osd] 2019-12-16T22:43:14.993 INFO:teuthology.orchestra.run.smithi177.stdout: osd journal size = 100 2019-12-16T22:43:14.993 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.993 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub load threshold = 5.0 2019-12-16T22:43:14.993 INFO:teuthology.orchestra.run.smithi177.stdout: osd scrub max interval = 600 2019-12-16T22:43:14.994 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.994 INFO:teuthology.orchestra.run.smithi177.stdout: osd recover clone overlap = true 2019-12-16T22:43:14.994 INFO:teuthology.orchestra.run.smithi177.stdout: osd recovery max chunk = 1048576 2019-12-16T22:43:14.994 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.994 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug shutdown = true 2019-12-16T22:43:14.994 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug op order = true 2019-12-16T22:43:14.994 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug verify stray on activate = true 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: osd open classes on start = true 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug pg log writeout = true 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: osd deep scrub update digest min age = 30 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: osd map max advance = 10 2019-12-16T22:43:14.995 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.996 INFO:teuthology.orchestra.run.smithi177.stdout: journal zero on create = true 2019-12-16T22:43:14.996 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.996 INFO:teuthology.orchestra.run.smithi177.stdout: filestore ondisk finisher threads = 3 2019-12-16T22:43:14.996 INFO:teuthology.orchestra.run.smithi177.stdout: filestore apply finisher threads = 3 2019-12-16T22:43:14.996 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:14.996 INFO:teuthology.orchestra.run.smithi177.stdout: bdev debug aio = true 2019-12-16T22:43:14.997 INFO:teuthology.orchestra.run.smithi177.stdout: osd debug misdirected ops = true 2019-12-16T22:43:14.997 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd full ratio = 0.9 2019-12-16T22:43:14.997 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2019-12-16T22:43:14.997 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore fsck on mount = True 2019-12-16T22:43:14.997 INFO:teuthology.orchestra.run.smithi177.stdout: debug osd = 25 2019-12-16T22:43:14.998 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluestore = 20 2019-12-16T22:43:14.998 INFO:teuthology.orchestra.run.smithi177.stdout: debug bluefs = 20 2019-12-16T22:43:14.998 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd backfillfull_ratio = 0.85 2019-12-16T22:43:14.998 INFO:teuthology.orchestra.run.smithi177.stdout: debug rocksdb = 10 2019-12-16T22:43:14.998 INFO:teuthology.orchestra.run.smithi177.stdout: debug journal = 20 2019-12-16T22:43:14.998 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore allocator = stupid 2019-12-16T22:43:14.999 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd nearfull ratio = 0.8 2019-12-16T22:43:14.999 INFO:teuthology.orchestra.run.smithi177.stdout: osd objectstore = bluestore 2019-12-16T22:43:14.999 INFO:teuthology.orchestra.run.smithi177.stdout: bdev async discard = True 2019-12-16T22:43:14.999 INFO:teuthology.orchestra.run.smithi177.stdout: bluestore block size = 96636764160 2019-12-16T22:43:14.999 INFO:teuthology.orchestra.run.smithi177.stdout: debug filestore = 20 2019-12-16T22:43:14.999 INFO:teuthology.orchestra.run.smithi177.stdout: bdev enable discard = True 2019-12-16T22:43:14.999 INFO:teuthology.orchestra.run.smithi177.stdout: osd failsafe full ratio = 0.95 2019-12-16T22:43:15.000 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:15.000 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr] 2019-12-16T22:43:15.000 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2019-12-16T22:43:15.000 INFO:teuthology.orchestra.run.smithi177.stdout: debug mgr = 20 2019-12-16T22:43:15.000 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2019-12-16T22:43:15.000 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2019-12-16T22:43:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:43:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:43:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: mgr/telemetry/nag = false 2019-12-16T22:43:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:15.001 INFO:teuthology.orchestra.run.smithi177.stdout:[mon] 2019-12-16T22:43:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: debug ms = 1 2019-12-16T22:43:15.001 INFO:teuthology.orchestra.run.smithi177.stdout: debug mon = 20 2019-12-16T22:43:15.002 INFO:teuthology.orchestra.run.smithi177.stdout: debug paxos = 20 2019-12-16T22:43:15.002 INFO:teuthology.orchestra.run.smithi177.stdout: debug auth = 20 2019-12-16T22:43:15.002 INFO:teuthology.orchestra.run.smithi177.stdout: mon data avail warn = 5 2019-12-16T22:43:15.002 INFO:teuthology.orchestra.run.smithi177.stdout: mon mgr mkfs grace = 240 2019-12-16T22:43:15.002 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min pgs per osd = 4 2019-12-16T22:43:15.003 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd reporter subtree level = osd 2019-12-16T22:43:15.003 INFO:teuthology.orchestra.run.smithi177.stdout: mon osd prime pg temp = true 2019-12-16T22:43:15.003 INFO:teuthology.orchestra.run.smithi177.stdout: mon reweight min bytes per osd = 10 2019-12-16T22:43:15.003 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:15.003 INFO:teuthology.orchestra.run.smithi177.stdout:[client] 2019-12-16T22:43:15.003 INFO:teuthology.orchestra.run.smithi177.stdout: rgw cache enabled = true 2019-12-16T22:43:15.003 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable ops log = true 2019-12-16T22:43:15.004 INFO:teuthology.orchestra.run.smithi177.stdout: rgw enable usage log = true 2019-12-16T22:43:15.004 INFO:teuthology.orchestra.run.smithi177.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2019-12-16T22:43:15.004 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2019-12-16T22:43:15.004 INFO:teuthology.orchestra.run.smithi177.stdout: debug rbd = 20 2019-12-16T22:43:15.004 INFO:teuthology.orchestra.run.smithi177.stdout: rbd mirror image policy type = none 2019-12-16T22:43:15.004 INFO:teuthology.orchestra.run.smithi177.stdout: rbd default features = 125 2019-12-16T22:43:15.004 INFO:teuthology.orchestra.run.smithi177.stdout: debug rbd_mirror = 15 2019-12-16T22:43:15.005 INFO:teuthology.orchestra.run.smithi177.stdout: log to stderr = False 2019-12-16T22:43:15.005 INFO:teuthology.orchestra.run.smithi177.stdout:[mon.a] 2019-12-16T22:43:15.005 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.1] 2019-12-16T22:43:15.005 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:15.005 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:15.005 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.0] 2019-12-16T22:43:15.005 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:15.006 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:15.006 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.3] 2019-12-16T22:43:15.006 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:15.006 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:15.007 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.2] 2019-12-16T22:43:15.007 INFO:teuthology.orchestra.run.smithi177.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2019-12-16T22:43:15.007 INFO:teuthology.orchestra.run.smithi177.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2019-12-16T22:43:15.007 INFO:tasks.ceph:Creating admin key on cluster2.mon.a... 2019-12-16T22:43:15.008 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster2.keyring 2019-12-16T22:43:15.070 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-16T22:43:15.122 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.keyring is 206B 2019-12-16T22:43:15.181 DEBUG:teuthology.orchestra.remote:smithi177:/home/ubuntu/cephtest/cluster2.monmap is 179B 2019-12-16T22:43:15.234 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2019-12-16T22:43:15.234 INFO:teuthology.orchestra.run.smithi106:> sudo sh -c 'cat > /etc/ceph/cluster2.keyring' && sudo chmod 0644 /etc/ceph/cluster2.keyring 2019-12-16T22:43:15.291 INFO:teuthology.orchestra.run.smithi106:> cat > /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:15.377 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi177.front.sepia.ceph.com 2019-12-16T22:43:15.377 INFO:teuthology.orchestra.run.smithi177:> sudo sh -c 'cat > /etc/ceph/cluster2.keyring' && sudo chmod 0644 /etc/ceph/cluster2.keyring 2019-12-16T22:43:15.435 INFO:teuthology.orchestra.run.smithi177:> cat > /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:15.535 INFO:tasks.ceph:Setting up mon nodes... 2019-12-16T22:43:15.536 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-16T22:43:15.536 INFO:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mgr/cluster2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster2-x/keyring 2019-12-16T22:43:15.579 INFO:teuthology.orchestra.run.smithi106.stdout:creating /var/lib/ceph/mgr/cluster2-x/keyring 2019-12-16T22:43:15.581 INFO:tasks.ceph:Setting up mds nodes... 2019-12-16T22:43:15.581 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-16T22:43:15.581 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster2.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.0.keyring 2019-12-16T22:43:15.660 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/cluster2.client.0.keyring 2019-12-16T22:43:15.671 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster2.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.keyring 2019-12-16T22:43:15.702 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.keyring 2019-12-16T22:43:15.721 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster2.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.0.keyring 2019-12-16T22:43:15.795 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.0.keyring 2019-12-16T22:43:15.806 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster2.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.1.keyring 2019-12-16T22:43:15.894 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.1.keyring 2019-12-16T22:43:15.904 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster2.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.2.keyring 2019-12-16T22:43:15.978 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.2.keyring 2019-12-16T22:43:15.991 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster2.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.3.keyring 2019-12-16T22:43:16.069 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.3.keyring 2019-12-16T22:43:16.081 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster2.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.4.keyring 2019-12-16T22:43:16.155 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.4.keyring 2019-12-16T22:43:16.166 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster2.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.5.keyring 2019-12-16T22:43:16.242 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.5.keyring 2019-12-16T22:43:16.254 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster2.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.6.keyring 2019-12-16T22:43:16.330 INFO:teuthology.orchestra.run.smithi177.stdout:creating /etc/ceph/cluster2.client.mirror.6.keyring 2019-12-16T22:43:16.342 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-16T22:43:16.342 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'cluster1.osd.2': '/dev/vg_nvme/lv_2', 'cluster1.osd.1': '/dev/vg_nvme/lv_1', 'cluster1.osd.0': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi177.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_4', 'cluster2.osd.1': '/dev/vg_nvme/lv_1', 'cluster2.osd.2': '/dev/vg_nvme/lv_2'}} 2019-12-16T22:43:16.342 INFO:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/cluster2-0 2019-12-16T22:43:16.398 INFO:tasks.ceph:{'cluster2.osd.0': '/dev/vg_nvme/lv_4', 'cluster2.osd.1': '/dev/vg_nvme/lv_1', 'cluster2.osd.2': '/dev/vg_nvme/lv_2'} 2019-12-16T22:43:16.398 INFO:tasks.ceph:{} 2019-12-16T22:43:16.398 INFO:tasks.ceph:cluster2.osd.0 2019-12-16T22:43:16.398 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com 2019-12-16T22:43:16.398 INFO:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-16T22:43:16.921 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-16T22:43:16.921 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-16T22:43:16.921 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-16T22:43:16.922 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-16T22:43:16.922 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2019-12-16T22:43:16.922 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-16T22:43:16.922 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-16T22:43:16.922 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-16T22:43:16.922 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-16T22:43:16.923 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2019-12-16T22:43:16.923 INFO:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/cluster2-0 2019-12-16T22:43:16.989 INFO:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-0 2019-12-16T22:43:17.000 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2019-12-16T22:43:17.001 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:43:17.001 INFO:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/cluster2-1 2019-12-16T22:43:17.057 INFO:tasks.ceph:{'cluster2.osd.0': '/dev/vg_nvme/lv_4', 'cluster2.osd.1': '/dev/vg_nvme/lv_1', 'cluster2.osd.2': '/dev/vg_nvme/lv_2'} 2019-12-16T22:43:17.057 INFO:tasks.ceph:{} 2019-12-16T22:43:17.057 INFO:tasks.ceph:cluster2.osd.1 2019-12-16T22:43:17.057 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com 2019-12-16T22:43:17.058 INFO:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-16T22:43:17.570 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-16T22:43:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-16T22:43:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-16T22:43:17.571 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-16T22:43:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2019-12-16T22:43:17.571 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-16T22:43:17.571 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-16T22:43:17.571 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-16T22:43:17.572 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-16T22:43:17.573 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2019-12-16T22:43:17.573 INFO:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster2-1 2019-12-16T22:43:17.644 INFO:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-1 2019-12-16T22:43:17.656 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2019-12-16T22:43:17.656 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:43:17.657 INFO:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/osd/cluster2-2 2019-12-16T22:43:17.713 INFO:tasks.ceph:{'cluster2.osd.0': '/dev/vg_nvme/lv_4', 'cluster2.osd.1': '/dev/vg_nvme/lv_1', 'cluster2.osd.2': '/dev/vg_nvme/lv_2'} 2019-12-16T22:43:17.713 INFO:tasks.ceph:{} 2019-12-16T22:43:17.713 INFO:tasks.ceph:cluster2.osd.2 2019-12-16T22:43:17.714 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com 2019-12-16T22:43:17.714 INFO:teuthology.orchestra.run.smithi177:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-16T22:43:18.231 INFO:teuthology.orchestra.run.smithi177.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-16T22:43:18.231 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-16T22:43:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: = crc=1 finobt=1, sparse=0, rmapbt=0, reflink=0 2019-12-16T22:43:18.232 INFO:teuthology.orchestra.run.smithi177.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-16T22:43:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: = sunit=0 swidth=0 blks 2019-12-16T22:43:18.232 INFO:teuthology.orchestra.run.smithi177.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-16T22:43:18.232 INFO:teuthology.orchestra.run.smithi177.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-16T22:43:18.232 INFO:teuthology.orchestra.run.smithi177.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-16T22:43:18.232 INFO:teuthology.orchestra.run.smithi177.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-16T22:43:18.233 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi177.front.sepia.ceph.com -o noatime 2019-12-16T22:43:18.234 INFO:teuthology.orchestra.run.smithi177:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster2-2 2019-12-16T22:43:18.278 INFO:teuthology.orchestra.run.smithi177:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-2 2019-12-16T22:43:18.333 INFO:teuthology.orchestra.run.smithi177.stderr:sudo: /sbin/restorecon: command not found 2019-12-16T22:43:18.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:43:18.336 INFO:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:18.492 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:18.492+0000 7f3e0ce22d80 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-0/keyring: can't open /var/lib/ceph/osd/cluster2-0/keyring: (2) No such file or directory 2019-12-16T22:43:18.496 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:18.492+0000 7f3e0ce22d80 -1 created new key in keyring /var/lib/ceph/osd/cluster2-0/keyring 2019-12-16T22:43:18.497 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:18.492+0000 7f3e0ce22d80 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2019-12-16T22:43:18.497 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:18.492+0000 7f3e0ce22d80 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2019-12-16T22:43:18.497 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:18.492+0000 7f3e0ce22d80 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2019-12-16T22:43:18.497 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:18.496+0000 7f3e0ce22d80 -1 bluestore(/var/lib/ceph/osd/cluster2-0) _read_fsid unparsable uuid 2019-12-16T22:43:20.957 INFO:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-0 2019-12-16T22:43:20.974 INFO:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:21.052+0000 7fd843aeed80 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-1/keyring: can't open /var/lib/ceph/osd/cluster2-1/keyring: (2) No such file or directory 2019-12-16T22:43:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:21.052+0000 7fd843aeed80 -1 created new key in keyring /var/lib/ceph/osd/cluster2-1/keyring 2019-12-16T22:43:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:21.052+0000 7fd843aeed80 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2019-12-16T22:43:21.051 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:21.052+0000 7fd843aeed80 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2019-12-16T22:43:21.052 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:21.052+0000 7fd843aeed80 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2019-12-16T22:43:21.052 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:21.052+0000 7fd843aeed80 -1 bluestore(/var/lib/ceph/osd/cluster2-1) _read_fsid unparsable uuid 2019-12-16T22:43:23.497 INFO:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-1 2019-12-16T22:43:23.561 INFO:teuthology.orchestra.run.smithi177:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:23.644 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:23.640+0000 7f2b0605dd80 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-2/keyring: can't open /var/lib/ceph/osd/cluster2-2/keyring: (2) No such file or directory 2019-12-16T22:43:23.644 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:23.640+0000 7f2b0605dd80 -1 created new key in keyring /var/lib/ceph/osd/cluster2-2/keyring 2019-12-16T22:43:23.644 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:23.640+0000 7f2b0605dd80 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2019-12-16T22:43:23.644 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:23.640+0000 7f2b0605dd80 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2019-12-16T22:43:23.645 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:23.640+0000 7f2b0605dd80 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2019-12-16T22:43:23.645 INFO:teuthology.orchestra.run.smithi177.stderr:2019-12-16T22:43:23.640+0000 7f2b0605dd80 -1 bluestore(/var/lib/ceph/osd/cluster2-2) _read_fsid unparsable uuid 2019-12-16T22:43:26.076 INFO:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-2 2019-12-16T22:43:26.133 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-16T22:43:26.133 INFO:teuthology.orchestra.run.smithi106:> mktemp 2019-12-16T22:43:26.140 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.Zcj2IxXgfO 2019-12-16T22:43:26.140 INFO:teuthology.orchestra.run.smithi106:> sudo cp /var/lib/ceph/mgr/cluster2-x/keyring /tmp/tmp.Zcj2IxXgfO 2019-12-16T22:43:26.208 INFO:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.Zcj2IxXgfO 2019-12-16T22:43:26.315 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.Zcj2IxXgfO is 56B 2019-12-16T22:43:26.326 INFO:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.Zcj2IxXgfO 2019-12-16T22:43:26.336 INFO:teuthology.orchestra.run.smithi177:> mktemp 2019-12-16T22:43:26.344 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.FCU6IZogD4 2019-12-16T22:43:26.344 INFO:teuthology.orchestra.run.smithi177:> sudo cp /var/lib/ceph/osd/cluster2-0/keyring /tmp/tmp.FCU6IZogD4 2019-12-16T22:43:26.401 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.FCU6IZogD4 2019-12-16T22:43:26.512 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.FCU6IZogD4 is 56B 2019-12-16T22:43:26.528 INFO:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.FCU6IZogD4 2019-12-16T22:43:26.534 INFO:teuthology.orchestra.run.smithi177:> mktemp 2019-12-16T22:43:26.584 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.NYKYJwWU94 2019-12-16T22:43:26.585 INFO:teuthology.orchestra.run.smithi177:> sudo cp /var/lib/ceph/osd/cluster2-1/keyring /tmp/tmp.NYKYJwWU94 2019-12-16T22:43:26.641 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.NYKYJwWU94 2019-12-16T22:43:26.751 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.NYKYJwWU94 is 56B 2019-12-16T22:43:26.765 INFO:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.NYKYJwWU94 2019-12-16T22:43:26.771 INFO:teuthology.orchestra.run.smithi177:> mktemp 2019-12-16T22:43:26.820 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.FERZ4aulap 2019-12-16T22:43:26.821 INFO:teuthology.orchestra.run.smithi177:> sudo cp /var/lib/ceph/osd/cluster2-2/keyring /tmp/tmp.FERZ4aulap 2019-12-16T22:43:26.878 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.FERZ4aulap 2019-12-16T22:43:27.000 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.FERZ4aulap is 56B 2019-12-16T22:43:27.051 INFO:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.FERZ4aulap 2019-12-16T22:43:27.066 DEBUG:teuthology.orchestra.remote:smithi106:/etc/ceph/cluster2.client.0.keyring is 59B 2019-12-16T22:43:27.144 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.keyring is 64B 2019-12-16T22:43:27.164 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.0.keyring is 66B 2019-12-16T22:43:27.189 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.1.keyring is 66B 2019-12-16T22:43:27.206 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.2.keyring is 66B 2019-12-16T22:43:27.264 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.3.keyring is 66B 2019-12-16T22:43:27.284 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.4.keyring is 66B 2019-12-16T22:43:27.345 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.5.keyring is 66B 2019-12-16T22:43:27.409 DEBUG:teuthology.orchestra.remote:smithi177:/etc/ceph/cluster2.client.mirror.6.keyring is 66B 2019-12-16T22:43:27.419 INFO:tasks.ceph:Adding keys to all mons... 2019-12-16T22:43:27.420 INFO:teuthology.orchestra.run.smithi177:> sudo tee -a /etc/ceph/cluster2.keyring 2019-12-16T22:43:27.466 INFO:teuthology.orchestra.run.smithi177.stdout:[mgr.x] 2019-12-16T22:43:27.466 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCDCPhd49arIhAA/B1QyABN/dOyH83BKiwEnA== 2019-12-16T22:43:27.467 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.0] 2019-12-16T22:43:27.467 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCGCPhdqNB/HRAA+IeShlMG85D1Stax/oRlPg== 2019-12-16T22:43:27.467 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.1] 2019-12-16T22:43:27.467 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCJCPhdsc0zAxAAkY4Q6veKbYnaQz3v6hXmWA== 2019-12-16T22:43:27.467 INFO:teuthology.orchestra.run.smithi177.stdout:[osd.2] 2019-12-16T22:43:27.467 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCLCPhdA3RLJhAAWDoRMHrZWJfyTaDLU31rvw== 2019-12-16T22:43:27.467 INFO:teuthology.orchestra.run.smithi177.stdout:[client.0] 2019-12-16T22:43:27.468 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCDCPhd9YJ8JxAAcfWKM3M+yR7VWRmAYdzvww== 2019-12-16T22:43:27.468 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror] 2019-12-16T22:43:27.468 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCDCPhdfBgSKhAA9k+UzHnNMOiMZWzLv3knHA== 2019-12-16T22:43:27.468 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.0] 2019-12-16T22:43:27.468 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCDCPhduoGPLxAAAevYSm84cF0iBaryl+pFLA== 2019-12-16T22:43:27.468 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.1] 2019-12-16T22:43:27.468 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCDCPhd7lN4NRAAwgA+WcOJxd1gBsmsCJ8PCA== 2019-12-16T22:43:27.469 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.2] 2019-12-16T22:43:27.469 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCDCPhdjCuFOhAADbEC3md5ENaD10wVv1AGvw== 2019-12-16T22:43:27.469 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.3] 2019-12-16T22:43:27.469 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCECPhdN4NTBBAAXESHSHq2kVDAEy09UhfdZw== 2019-12-16T22:43:27.469 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.4] 2019-12-16T22:43:27.469 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCECPhd84pqCRAAQPSyIRlvcUZEaULO9/WGGA== 2019-12-16T22:43:27.469 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.5] 2019-12-16T22:43:27.470 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCECPhdvJOhDhAAS8FNp9Nal52AVTA39wNjjQ== 2019-12-16T22:43:27.470 INFO:teuthology.orchestra.run.smithi177.stdout:[client.mirror.6] 2019-12-16T22:43:27.470 INFO:teuthology.orchestra.run.smithi177.stdout: key = AQCECPhdPs3gExAAuhIZd9xM0djjl0MMILt4Ig== 2019-12-16T22:43:27.471 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-16T22:43:27.557 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-16T22:43:27.638 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-16T22:43:27.717 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-16T22:43:27.792 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:27.876 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:27.960 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:28.045 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:28.142 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.2 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:28.230 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.3 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:28.317 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.4 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:28.405 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.5 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:28.490 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.6 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-16T22:43:28.577 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-16T22:43:28.577 INFO:teuthology.orchestra.run.smithi177:> sudo mkdir -p /var/lib/ceph/mon/cluster2-a 2019-12-16T22:43:28.633 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster2 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster2.monmap --keyring /etc/ceph/cluster2.keyring 2019-12-16T22:43:28.738 INFO:teuthology.orchestra.run.smithi177:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster2-a 2019-12-16T22:43:28.752 INFO:teuthology.orchestra.run.smithi177:> rm -- /home/ubuntu/cephtest/cluster2.monmap 2019-12-16T22:43:28.799 INFO:tasks.ceph:Starting mon daemons in cluster cluster2... 2019-12-16T22:43:28.800 INFO:tasks.ceph.cluster2.mon.a:Restarting daemon 2019-12-16T22:43:28.800 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster2 -i a 2019-12-16T22:43:28.844 INFO:tasks.ceph.cluster2.mon.a:Started 2019-12-16T22:43:28.844 INFO:tasks.ceph:Starting mgr daemons in cluster cluster2... 2019-12-16T22:43:28.844 INFO:tasks.ceph.cluster2.mgr.x:Restarting daemon 2019-12-16T22:43:28.844 INFO:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster2 -i x 2019-12-16T22:43:28.847 INFO:tasks.ceph.cluster2.mgr.x:Started 2019-12-16T22:43:28.847 INFO:tasks.ceph:Setting crush tunables to default 2019-12-16T22:43:28.847 INFO:teuthology.orchestra.run.smithi177:> sudo ceph --cluster cluster2 osd crush tunables default 2019-12-16T22:43:29.126 INFO:teuthology.orchestra.run.smithi177.stderr:adjusted tunables profile to default 2019-12-16T22:43:29.138 INFO:tasks.ceph:Starting osd daemons in cluster cluster2... 2019-12-16T22:43:29.139 INFO:teuthology.orchestra.run.smithi177:> mktemp 2019-12-16T22:43:29.145 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.KAkTdx92YX 2019-12-16T22:43:29.146 INFO:teuthology.orchestra.run.smithi177:> sudo cp /var/lib/ceph/osd/cluster2-0/fsid /tmp/tmp.KAkTdx92YX 2019-12-16T22:43:29.202 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.KAkTdx92YX 2019-12-16T22:43:29.332 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.KAkTdx92YX is 37B 2019-12-16T22:43:29.343 INFO:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.KAkTdx92YX 2019-12-16T22:43:29.349 INFO:teuthology.orchestra.run.smithi177:> mktemp 2019-12-16T22:43:29.399 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.VKUFFKOVnE 2019-12-16T22:43:29.400 INFO:teuthology.orchestra.run.smithi177:> sudo cp /var/lib/ceph/osd/cluster2-1/fsid /tmp/tmp.VKUFFKOVnE 2019-12-16T22:43:29.459 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.VKUFFKOVnE 2019-12-16T22:43:29.570 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.VKUFFKOVnE is 37B 2019-12-16T22:43:29.620 INFO:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.VKUFFKOVnE 2019-12-16T22:43:29.635 INFO:teuthology.orchestra.run.smithi177:> mktemp 2019-12-16T22:43:29.683 INFO:teuthology.orchestra.run.smithi177.stdout:/tmp/tmp.AVQmtYJKAa 2019-12-16T22:43:29.684 INFO:teuthology.orchestra.run.smithi177:> sudo cp /var/lib/ceph/osd/cluster2-2/fsid /tmp/tmp.AVQmtYJKAa 2019-12-16T22:43:29.743 INFO:teuthology.orchestra.run.smithi177:> sudo chmod 0666 /tmp/tmp.AVQmtYJKAa 2019-12-16T22:43:29.852 DEBUG:teuthology.orchestra.remote:smithi177:/tmp/tmp.AVQmtYJKAa is 37B 2019-12-16T22:43:29.903 INFO:teuthology.orchestra.run.smithi177:> rm -fr /tmp/tmp.AVQmtYJKAa 2019-12-16T22:43:29.910 INFO:teuthology.orchestra.run.smithi177:> sudo ceph --cluster cluster2 osd new b7f80c4f-101a-4808-840e-08d0b3fc0788 0 2019-12-16T22:43:30.169 INFO:teuthology.orchestra.run.smithi177.stdout:0 2019-12-16T22:43:30.189 INFO:teuthology.orchestra.run.smithi177:> sudo ceph --cluster cluster2 osd new d5bf7674-a0be-4c1d-bfdb-0a77a28c0074 1 2019-12-16T22:43:30.406 INFO:teuthology.orchestra.run.smithi177.stdout:1 2019-12-16T22:43:30.427 INFO:teuthology.orchestra.run.smithi177:> sudo ceph --cluster cluster2 osd new 60a2d47c-b571-4b56-8429-c86d704679f8 2 2019-12-16T22:43:30.642 INFO:teuthology.orchestra.run.smithi177.stdout:2 2019-12-16T22:43:30.658 INFO:tasks.ceph.cluster2.osd.0:Restarting daemon 2019-12-16T22:43:30.658 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 0 2019-12-16T22:43:30.672 INFO:tasks.ceph.cluster2.osd.0:Started 2019-12-16T22:43:30.672 INFO:tasks.ceph.cluster2.osd.1:Restarting daemon 2019-12-16T22:43:30.673 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 1 2019-12-16T22:43:30.680 INFO:tasks.ceph.cluster2.osd.1:Started 2019-12-16T22:43:30.681 INFO:tasks.ceph.cluster2.osd.2:Restarting daemon 2019-12-16T22:43:30.681 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 2 2019-12-16T22:43:30.687 INFO:tasks.ceph.cluster2.osd.2:Started 2019-12-16T22:43:30.687 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-16T22:43:30.992 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2019-12-16T22:43:31.182 INFO:teuthology.misc.health.smithi177.stdout: 2019-12-16T22:43:31.182 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":5,"fsid":"d324a855-8f0b-4b8a-87f5-c61523c13839","created":"2019-12-16T22:43:28.969481+0000","modified":"2019-12-16T22:43:30.642603+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"b7f80c4f-101a-4808-840e-08d0b3fc0788","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d5bf7674-a0be-4c1d-bfdb-0a77a28c0074","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"60a2d47c-b571-4b56-8429-c86d704679f8","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:31.194 DEBUG:teuthology.misc:0 of 3 OSDs are up 2019-12-16T22:43:31.284 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:43:31.280+0000 7fe70ccb5d80 -1 Falling back to public interface 2019-12-16T22:43:31.285 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:43:31.284+0000 7fb6740f9d80 -1 Falling back to public interface 2019-12-16T22:43:31.308 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:43:31.308+0000 7fa7cf77fd80 -1 Falling back to public interface 2019-12-16T22:43:32.410 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:43:32.412+0000 7fe70ccb5d80 -1 osd.1 0 log_to_monitors {default=true} 2019-12-16T22:43:32.477 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:43:32.476+0000 7fb6740f9d80 -1 osd.0 0 log_to_monitors {default=true} 2019-12-16T22:43:32.497 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:43:32.496+0000 7fa7cf77fd80 -1 osd.2 0 log_to_monitors {default=true} 2019-12-16T22:43:34.051 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:43:34.052+0000 7fb65d32c700 -1 osd.0 0 waiting for initial osdmap 2019-12-16T22:43:34.052 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:43:34.052+0000 7fe6f5ee8700 -1 osd.1 0 waiting for initial osdmap 2019-12-16T22:43:34.052 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:43:34.052+0000 7fa7b89b2700 -1 osd.2 0 waiting for initial osdmap 2019-12-16T22:43:37.498 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2019-12-16T22:43:37.745 INFO:teuthology.misc.health.smithi177.stdout: 2019-12-16T22:43:37.745 INFO:teuthology.misc.health.smithi177.stdout:{"epoch":9,"fsid":"d324a855-8f0b-4b8a-87f5-c61523c13839","created":"2019-12-16T22:43:28.969481+0000","modified":"2019-12-16T22:43:36.077731+0000","last_up_change":"2019-12-16T22:43:35.045526+0000","last_in_change":"2019-12-16T22:43:35.045526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"b7f80c4f-101a-4808-840e-08d0b3fc0788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":12957},{"type":"v1","addr":"172.21.15.177:6809","nonce":12957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":12957},{"type":"v1","addr":"172.21.15.177:6811","nonce":12957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":12957},{"type":"v1","addr":"172.21.15.177:6815","nonce":12957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":12957},{"type":"v1","addr":"172.21.15.177:6813","nonce":12957}]},"public_addr":"172.21.15.177:6809/12957","cluster_addr":"172.21.15.177:6811/12957","heartbeat_back_addr":"172.21.15.177:6815/12957","heartbeat_front_addr":"172.21.15.177:6813/12957","state":["exists","up"]},{"osd":1,"uuid":"d5bf7674-a0be-4c1d-bfdb-0a77a28c0074","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":12958},{"type":"v1","addr":"172.21.15.177:6801","nonce":12958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":12958},{"type":"v1","addr":"172.21.15.177:6803","nonce":12958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":12958},{"type":"v1","addr":"172.21.15.177:6807","nonce":12958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":12958},{"type":"v1","addr":"172.21.15.177:6805","nonce":12958}]},"public_addr":"172.21.15.177:6801/12958","cluster_addr":"172.21.15.177:6803/12958","heartbeat_back_addr":"172.21.15.177:6807/12958","heartbeat_front_addr":"172.21.15.177:6805/12958","state":["exists","up"]},{"osd":2,"uuid":"60a2d47c-b571-4b56-8429-c86d704679f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":12959},{"type":"v1","addr":"172.21.15.177:6817","nonce":12959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":12959},{"type":"v1","addr":"172.21.15.177:6819","nonce":12959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":12959},{"type":"v1","addr":"172.21.15.177:6823","nonce":12959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":12959},{"type":"v1","addr":"172.21.15.177:6821","nonce":12959}]},"public_addr":"172.21.15.177:6817/12959","cluster_addr":"172.21.15.177:6819/12959","heartbeat_back_addr":"172.21.15.177:6823/12959","heartbeat_front_addr":"172.21.15.177:6821/12959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.478566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.415760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.480457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:37.757 DEBUG:teuthology.misc:3 of 3 OSDs are up 2019-12-16T22:43:37.757 INFO:tasks.ceph:Creating RBD pool 2019-12-16T22:43:37.757 INFO:teuthology.orchestra.run.smithi177:> sudo ceph --cluster cluster2 osd pool create rbd 8 2019-12-16T22:43:38.097 INFO:teuthology.orchestra.run.smithi177.stderr:pool 'rbd' created 2019-12-16T22:43:38.108 INFO:teuthology.orchestra.run.smithi177:> sudo ceph --cluster cluster2 osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-16T22:43:39.105 INFO:teuthology.orchestra.run.smithi177.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-16T22:43:39.116 INFO:tasks.ceph:Starting mds daemons in cluster cluster2... 2019-12-16T22:43:39.117 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2019-12-16T22:43:39.117 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-16T22:43:39.357 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:39.357 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":11,"fsid":"d324a855-8f0b-4b8a-87f5-c61523c13839","created":"2019-12-16T22:43:28.969481+0000","modified":"2019-12-16T22:43:39.093455+0000","last_up_change":"2019-12-16T22:43:35.045526+0000","last_in_change":"2019-12-16T22:43:35.045526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-16T22:43:38.042731+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b7f80c4f-101a-4808-840e-08d0b3fc0788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":12957},{"type":"v1","addr":"172.21.15.177:6809","nonce":12957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":12957},{"type":"v1","addr":"172.21.15.177:6811","nonce":12957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":12957},{"type":"v1","addr":"172.21.15.177:6815","nonce":12957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":12957},{"type":"v1","addr":"172.21.15.177:6813","nonce":12957}]},"public_addr":"172.21.15.177:6809/12957","cluster_addr":"172.21.15.177:6811/12957","heartbeat_back_addr":"172.21.15.177:6815/12957","heartbeat_front_addr":"172.21.15.177:6813/12957","state":["exists","up"]},{"osd":1,"uuid":"d5bf7674-a0be-4c1d-bfdb-0a77a28c0074","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":12958},{"type":"v1","addr":"172.21.15.177:6801","nonce":12958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":12958},{"type":"v1","addr":"172.21.15.177:6803","nonce":12958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":12958},{"type":"v1","addr":"172.21.15.177:6807","nonce":12958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":12958},{"type":"v1","addr":"172.21.15.177:6805","nonce":12958}]},"public_addr":"172.21.15.177:6801/12958","cluster_addr":"172.21.15.177:6803/12958","heartbeat_back_addr":"172.21.15.177:6807/12958","heartbeat_front_addr":"172.21.15.177:6805/12958","state":["exists","up"]},{"osd":2,"uuid":"60a2d47c-b571-4b56-8429-c86d704679f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":12959},{"type":"v1","addr":"172.21.15.177:6817","nonce":12959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":12959},{"type":"v1","addr":"172.21.15.177:6819","nonce":12959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":12959},{"type":"v1","addr":"172.21.15.177:6823","nonce":12959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":12959},{"type":"v1","addr":"172.21.15.177:6821","nonce":12959}]},"public_addr":"172.21.15.177:6817/12959","cluster_addr":"172.21.15.177:6819/12959","heartbeat_back_addr":"172.21.15.177:6823/12959","heartbeat_front_addr":"172.21.15.177:6821/12959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.478566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.415760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.480457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:39.368 INFO:tasks.ceph.ceph_manager.cluster2:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-16T22:43:38.042731+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'11', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-16T22:43:39.368 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd pool get rbd pg_num 2019-12-16T22:43:39.615 INFO:teuthology.orchestra.run.smithi177.stdout:pg_num: 8 2019-12-16T22:43:39.628 INFO:tasks.ceph:Waiting until cluster2 daemons up and pgs clean... 2019-12-16T22:43:39.628 INFO:tasks.ceph.ceph_manager.cluster2:waiting for mgr available 2019-12-16T22:43:39.628 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 mgr dump --format=json 2019-12-16T22:43:39.904 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:39.917 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":3,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.106:6826","nonce":13967},{"type":"v1","addr":"172.21.15.106:6827","nonce":13967}]},"active_addr":"172.21.15.106:6827/13967","active_change":"2019-12-16T22:43:31.999182+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading remoto library:No module named 'remoto'","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"str","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"str","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["ansible","cephadm","deepsea","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[]}} 2019-12-16T22:43:39.921 INFO:tasks.ceph.ceph_manager.cluster2:mgr available! 2019-12-16T22:43:39.921 INFO:tasks.ceph.ceph_manager.cluster2:waiting for all up 2019-12-16T22:43:39.922 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2019-12-16T22:43:40.165 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:40.166 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"fsid":"d324a855-8f0b-4b8a-87f5-c61523c13839","created":"2019-12-16T22:43:28.969481+0000","modified":"2019-12-16T22:43:40.100352+0000","last_up_change":"2019-12-16T22:43:35.045526+0000","last_in_change":"2019-12-16T22:43:35.045526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-16T22:43:38.042731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b7f80c4f-101a-4808-840e-08d0b3fc0788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":12957},{"type":"v1","addr":"172.21.15.177:6809","nonce":12957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":12957},{"type":"v1","addr":"172.21.15.177:6811","nonce":12957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":12957},{"type":"v1","addr":"172.21.15.177:6815","nonce":12957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":12957},{"type":"v1","addr":"172.21.15.177:6813","nonce":12957}]},"public_addr":"172.21.15.177:6809/12957","cluster_addr":"172.21.15.177:6811/12957","heartbeat_back_addr":"172.21.15.177:6815/12957","heartbeat_front_addr":"172.21.15.177:6813/12957","state":["exists","up"]},{"osd":1,"uuid":"d5bf7674-a0be-4c1d-bfdb-0a77a28c0074","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":12958},{"type":"v1","addr":"172.21.15.177:6801","nonce":12958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":12958},{"type":"v1","addr":"172.21.15.177:6803","nonce":12958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":12958},{"type":"v1","addr":"172.21.15.177:6807","nonce":12958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":12958},{"type":"v1","addr":"172.21.15.177:6805","nonce":12958}]},"public_addr":"172.21.15.177:6801/12958","cluster_addr":"172.21.15.177:6803/12958","heartbeat_back_addr":"172.21.15.177:6807/12958","heartbeat_front_addr":"172.21.15.177:6805/12958","state":["exists","up"]},{"osd":2,"uuid":"60a2d47c-b571-4b56-8429-c86d704679f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":12959},{"type":"v1","addr":"172.21.15.177:6817","nonce":12959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":12959},{"type":"v1","addr":"172.21.15.177:6819","nonce":12959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":12959},{"type":"v1","addr":"172.21.15.177:6823","nonce":12959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":12959},{"type":"v1","addr":"172.21.15.177:6821","nonce":12959}]},"public_addr":"172.21.15.177:6817/12959","cluster_addr":"172.21.15.177:6819/12959","heartbeat_back_addr":"172.21.15.177:6823/12959","heartbeat_front_addr":"172.21.15.177:6821/12959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.478566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.415760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.480457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:40.178 INFO:tasks.ceph.ceph_manager.cluster2:all up! 2019-12-16T22:43:40.179 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2019-12-16T22:43:40.420 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:40.420 INFO:teuthology.orchestra.run.smithi177.stdout:{"epoch":12,"fsid":"d324a855-8f0b-4b8a-87f5-c61523c13839","created":"2019-12-16T22:43:28.969481+0000","modified":"2019-12-16T22:43:40.100352+0000","last_up_change":"2019-12-16T22:43:35.045526+0000","last_in_change":"2019-12-16T22:43:35.045526+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-16T22:43:38.042731+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"b7f80c4f-101a-4808-840e-08d0b3fc0788","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6808","nonce":12957},{"type":"v1","addr":"172.21.15.177:6809","nonce":12957}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6810","nonce":12957},{"type":"v1","addr":"172.21.15.177:6811","nonce":12957}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6814","nonce":12957},{"type":"v1","addr":"172.21.15.177:6815","nonce":12957}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6812","nonce":12957},{"type":"v1","addr":"172.21.15.177:6813","nonce":12957}]},"public_addr":"172.21.15.177:6809/12957","cluster_addr":"172.21.15.177:6811/12957","heartbeat_back_addr":"172.21.15.177:6815/12957","heartbeat_front_addr":"172.21.15.177:6813/12957","state":["exists","up"]},{"osd":1,"uuid":"d5bf7674-a0be-4c1d-bfdb-0a77a28c0074","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6800","nonce":12958},{"type":"v1","addr":"172.21.15.177:6801","nonce":12958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6802","nonce":12958},{"type":"v1","addr":"172.21.15.177:6803","nonce":12958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6806","nonce":12958},{"type":"v1","addr":"172.21.15.177:6807","nonce":12958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6804","nonce":12958},{"type":"v1","addr":"172.21.15.177:6805","nonce":12958}]},"public_addr":"172.21.15.177:6801/12958","cluster_addr":"172.21.15.177:6803/12958","heartbeat_back_addr":"172.21.15.177:6807/12958","heartbeat_front_addr":"172.21.15.177:6805/12958","state":["exists","up"]},{"osd":2,"uuid":"60a2d47c-b571-4b56-8429-c86d704679f8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6816","nonce":12959},{"type":"v1","addr":"172.21.15.177:6817","nonce":12959}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6818","nonce":12959},{"type":"v1","addr":"172.21.15.177:6819","nonce":12959}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6822","nonce":12959},{"type":"v1","addr":"172.21.15.177:6823","nonce":12959}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.177:6820","nonce":12959},{"type":"v1","addr":"172.21.15.177:6821","nonce":12959}]},"public_addr":"172.21.15.177:6817/12959","cluster_addr":"172.21.15.177:6819/12959","heartbeat_back_addr":"172.21.15.177:6823/12959","heartbeat_front_addr":"172.21.15.177:6821/12959","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.478566+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.415760+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-16T22:43:33.480457+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-16T22:43:40.432 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.0 flush_pg_stats 2019-12-16T22:43:40.588 INFO:teuthology.orchestra.run.smithi177.stdout:34359738372 2019-12-16T22:43:40.588 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.1 flush_pg_stats 2019-12-16T22:43:40.745 INFO:teuthology.orchestra.run.smithi177.stdout:34359738372 2019-12-16T22:43:40.745 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.2 flush_pg_stats 2019-12-16T22:43:40.901 INFO:teuthology.orchestra.run.smithi177.stdout:34359738372 2019-12-16T22:43:40.902 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2019-12-16T22:43:41.150 INFO:teuthology.orchestra.run.smithi177.stdout:34359738370 2019-12-16T22:43:41.160 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738370 for osd.0 2019-12-16T22:43:42.161 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2019-12-16T22:43:42.412 INFO:teuthology.orchestra.run.smithi177.stdout:34359738372 2019-12-16T22:43:42.425 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738372 for osd.0 2019-12-16T22:43:42.426 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2019-12-16T22:43:42.670 INFO:teuthology.orchestra.run.smithi177.stdout:34359738372 2019-12-16T22:43:42.682 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738372 for osd.1 2019-12-16T22:43:42.683 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2019-12-16T22:43:42.917 INFO:teuthology.orchestra.run.smithi177.stdout:34359738372 2019-12-16T22:43:42.930 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738372 for osd.2 2019-12-16T22:43:42.931 INFO:tasks.ceph.ceph_manager.cluster2:waiting for clean 2019-12-16T22:43:42.931 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2019-12-16T22:43:43.174 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:43.178 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2019-12-16T22:43:43.187 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2019-12-16T22:43:42.009962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146048,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969472,"statfs":{"total":289910292480,"available":286688739328,"internally_reserved":3221225472,"allocated":303104,"data_stored":74174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106384+0000","last_change":"2019-12-16T22:43:39.106384+0000","last_active":"2019-12-16T22:43:39.106384+0000","last_peered":"2019-12-16T22:43:39.106384+0000","last_clean":"2019-12-16T22:43:39.106384+0000","last_became_active":"2019-12-16T22:43:39.106045+0000","last_became_peered":"2019-12-16T22:43:39.106045+0000","last_unstale":"2019-12-16T22:43:39.106384+0000","last_undegraded":"2019-12-16T22:43:39.106384+0000","last_fullsized":"2019-12-16T22:43:39.106384+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.104992+0000","last_change":"2019-12-16T22:43:39.104992+0000","last_active":"2019-12-16T22:43:39.104992+0000","last_peered":"2019-12-16T22:43:39.104992+0000","last_clean":"2019-12-16T22:43:39.104992+0000","last_became_active":"2019-12-16T22:43:39.104663+0000","last_became_peered":"2019-12-16T22:43:39.104663+0000","last_unstale":"2019-12-16T22:43:39.104992+0000","last_undegraded":"2019-12-16T22:43:39.104992+0000","last_fullsized":"2019-12-16T22:43:39.104992+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106376+0000","last_change":"2019-12-16T22:43:39.105959+0000","last_active":"2019-12-16T22:43:39.106376+0000","last_peered":"2019-12-16T22:43:39.106376+0000","last_clean":"2019-12-16T22:43:39.106376+0000","last_became_active":"2019-12-16T22:43:39.105569+0000","last_became_peered":"2019-12-16T22:43:39.105569+0000","last_unstale":"2019-12-16T22:43:39.106376+0000","last_undegraded":"2019-12-16T22:43:39.106376+0000","last_fullsized":"2019-12-16T22:43:39.106376+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106622+0000","last_change":"2019-12-16T22:43:39.106622+0000","last_active":"2019-12-16T22:43:39.106622+0000","last_peered":"2019-12-16T22:43:39.106622+0000","last_clean":"2019-12-16T22:43:39.106622+0000","last_became_active":"2019-12-16T22:43:39.106157+0000","last_became_peered":"2019-12-16T22:43:39.106157+0000","last_unstale":"2019-12-16T22:43:39.106622+0000","last_undegraded":"2019-12-16T22:43:39.106622+0000","last_fullsized":"2019-12-16T22:43:39.106622+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106725+0000","last_change":"2019-12-16T22:43:39.106725+0000","last_active":"2019-12-16T22:43:39.106725+0000","last_peered":"2019-12-16T22:43:39.106725+0000","last_clean":"2019-12-16T22:43:39.106725+0000","last_became_active":"2019-12-16T22:43:39.105526+0000","last_became_peered":"2019-12-16T22:43:39.105526+0000","last_unstale":"2019-12-16T22:43:39.106725+0000","last_undegraded":"2019-12-16T22:43:39.106725+0000","last_fullsized":"2019-12-16T22:43:39.106725+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.105682+0000","last_change":"2019-12-16T22:43:39.105682+0000","last_active":"2019-12-16T22:43:39.105682+0000","last_peered":"2019-12-16T22:43:39.105682+0000","last_clean":"2019-12-16T22:43:39.105682+0000","last_became_active":"2019-12-16T22:43:39.105373+0000","last_became_peered":"2019-12-16T22:43:39.105373+0000","last_unstale":"2019-12-16T22:43:39.105682+0000","last_undegraded":"2019-12-16T22:43:39.105682+0000","last_fullsized":"2019-12-16T22:43:39.105682+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.104642+0000","last_change":"2019-12-16T22:43:39.104642+0000","last_active":"2019-12-16T22:43:39.104642+0000","last_peered":"2019-12-16T22:43:39.104642+0000","last_clean":"2019-12-16T22:43:39.104642+0000","last_became_active":"2019-12-16T22:43:39.104251+0000","last_became_peered":"2019-12-16T22:43:39.104251+0000","last_unstale":"2019-12-16T22:43:39.104642+0000","last_undegraded":"2019-12-16T22:43:39.104642+0000","last_fullsized":"2019-12-16T22:43:39.104642+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106422+0000","last_change":"2019-12-16T22:43:39.105923+0000","last_active":"2019-12-16T22:43:39.106422+0000","last_peered":"2019-12-16T22:43:39.106422+0000","last_clean":"2019-12-16T22:43:39.106422+0000","last_became_active":"2019-12-16T22:43:39.105484+0000","last_became_peered":"2019-12-16T22:43:39.105484+0000","last_unstale":"2019-12-16T22:43:39.106422+0000","last_undegraded":"2019-12-16T22:43:39.106422+0000","last_fullsized":"2019-12-16T22:43:39.106422+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":26800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.550}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":23687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.694}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.492}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":23687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.642}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.482}]}]}]}} 2019-12-16T22:43:43.189 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2019-12-16T22:43:43.433 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:43.435 INFO:teuthology.orchestra.run.smithi177.stderr:dumped all 2019-12-16T22:43:43.446 INFO:teuthology.orchestra.run.smithi177.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2019-12-16T22:43:42.009962+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":10,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":3146048,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":279969472,"statfs":{"total":289910292480,"available":286688739328,"internally_reserved":3221225472,"allocated":303104,"data_stored":74174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106384+0000","last_change":"2019-12-16T22:43:39.106384+0000","last_active":"2019-12-16T22:43:39.106384+0000","last_peered":"2019-12-16T22:43:39.106384+0000","last_clean":"2019-12-16T22:43:39.106384+0000","last_became_active":"2019-12-16T22:43:39.106045+0000","last_became_peered":"2019-12-16T22:43:39.106045+0000","last_unstale":"2019-12-16T22:43:39.106384+0000","last_undegraded":"2019-12-16T22:43:39.106384+0000","last_fullsized":"2019-12-16T22:43:39.106384+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.104992+0000","last_change":"2019-12-16T22:43:39.104992+0000","last_active":"2019-12-16T22:43:39.104992+0000","last_peered":"2019-12-16T22:43:39.104992+0000","last_clean":"2019-12-16T22:43:39.104992+0000","last_became_active":"2019-12-16T22:43:39.104663+0000","last_became_peered":"2019-12-16T22:43:39.104663+0000","last_unstale":"2019-12-16T22:43:39.104992+0000","last_undegraded":"2019-12-16T22:43:39.104992+0000","last_fullsized":"2019-12-16T22:43:39.104992+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106376+0000","last_change":"2019-12-16T22:43:39.105959+0000","last_active":"2019-12-16T22:43:39.106376+0000","last_peered":"2019-12-16T22:43:39.106376+0000","last_clean":"2019-12-16T22:43:39.106376+0000","last_became_active":"2019-12-16T22:43:39.105569+0000","last_became_peered":"2019-12-16T22:43:39.105569+0000","last_unstale":"2019-12-16T22:43:39.106376+0000","last_undegraded":"2019-12-16T22:43:39.106376+0000","last_fullsized":"2019-12-16T22:43:39.106376+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106622+0000","last_change":"2019-12-16T22:43:39.106622+0000","last_active":"2019-12-16T22:43:39.106622+0000","last_peered":"2019-12-16T22:43:39.106622+0000","last_clean":"2019-12-16T22:43:39.106622+0000","last_became_active":"2019-12-16T22:43:39.106157+0000","last_became_peered":"2019-12-16T22:43:39.106157+0000","last_unstale":"2019-12-16T22:43:39.106622+0000","last_undegraded":"2019-12-16T22:43:39.106622+0000","last_fullsized":"2019-12-16T22:43:39.106622+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106725+0000","last_change":"2019-12-16T22:43:39.106725+0000","last_active":"2019-12-16T22:43:39.106725+0000","last_peered":"2019-12-16T22:43:39.106725+0000","last_clean":"2019-12-16T22:43:39.106725+0000","last_became_active":"2019-12-16T22:43:39.105526+0000","last_became_peered":"2019-12-16T22:43:39.105526+0000","last_unstale":"2019-12-16T22:43:39.106725+0000","last_undegraded":"2019-12-16T22:43:39.106725+0000","last_fullsized":"2019-12-16T22:43:39.106725+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.105682+0000","last_change":"2019-12-16T22:43:39.105682+0000","last_active":"2019-12-16T22:43:39.105682+0000","last_peered":"2019-12-16T22:43:39.105682+0000","last_clean":"2019-12-16T22:43:39.105682+0000","last_became_active":"2019-12-16T22:43:39.105373+0000","last_became_peered":"2019-12-16T22:43:39.105373+0000","last_unstale":"2019-12-16T22:43:39.105682+0000","last_undegraded":"2019-12-16T22:43:39.105682+0000","last_fullsized":"2019-12-16T22:43:39.105682+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"8","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.104642+0000","last_change":"2019-12-16T22:43:39.104642+0000","last_active":"2019-12-16T22:43:39.104642+0000","last_peered":"2019-12-16T22:43:39.104642+0000","last_clean":"2019-12-16T22:43:39.104642+0000","last_became_active":"2019-12-16T22:43:39.104251+0000","last_became_peered":"2019-12-16T22:43:39.104251+0000","last_unstale":"2019-12-16T22:43:39.104642+0000","last_undegraded":"2019-12-16T22:43:39.104642+0000","last_fullsized":"2019-12-16T22:43:39.104642+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"9","reported_epoch":"11","state":"active+clean","last_fresh":"2019-12-16T22:43:39.106422+0000","last_change":"2019-12-16T22:43:39.105923+0000","last_active":"2019-12-16T22:43:39.106422+0000","last_peered":"2019-12-16T22:43:39.106422+0000","last_clean":"2019-12-16T22:43:39.106422+0000","last_became_active":"2019-12-16T22:43:39.105484+0000","last_became_peered":"2019-12-16T22:43:39.105484+0000","last_unstale":"2019-12-16T22:43:39.106422+0000","last_undegraded":"2019-12-16T22:43:39.106422+0000","last_fullsized":"2019-12-16T22:43:39.106422+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-16T22:43:38.088265+0000","last_clean_scrub_stamp":"2019-12-16T22:43:38.088265+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048688,"kb_used_data":104,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323152,"statfs":{"total":96636764160,"available":95562907648,"internally_reserved":1073741824,"allocated":106496,"data_stored":26800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.373}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.550}]}]},{"osd":0,"up_from":8,"seq":34359738372,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":23687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.694}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.492}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048680,"kb_used_data":96,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323160,"statfs":{"total":96636764160,"available":95562915840,"internally_reserved":1073741824,"allocated":98304,"data_stored":23687,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.642}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":0.482}]}]}]}} 2019-12-16T22:43:43.458 INFO:tasks.ceph.ceph_manager.cluster2:clean! 2019-12-16T22:43:43.459 INFO:tasks.ceph:Waiting until ceph cluster cluster2 is healthy... 2019-12-16T22:43:43.460 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy 2019-12-16T22:43:43.460 INFO:teuthology.orchestra.run.smithi177:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 health --format=json 2019-12-16T22:43:43.740 INFO:teuthology.orchestra.run.smithi177.stdout: 2019-12-16T22:43:43.751 INFO:teuthology.orchestra.run.smithi177.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-16T22:43:43.751 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy done 2019-12-16T22:43:43.752 INFO:teuthology.run_tasks:Running task exec... 2019-12-16T22:43:43.772 INFO:teuthology.task.exec:Executing custom commands... 2019-12-16T22:43:43.772 INFO:teuthology.task.exec:Running commands on role cluster1.client.mirror.0 host ubuntu@smithi177.front.sepia.ceph.com 2019-12-16T22:43:43.772 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:44.074 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror 2019-12-16T22:43:44.086 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:44.386 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.0 2019-12-16T22:43:44.399 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:44.698 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.1 2019-12-16T22:43:44.710 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:45.013 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.2 2019-12-16T22:43:45.025 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:45.327 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.3 2019-12-16T22:43:45.340 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:45.636 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror 2019-12-16T22:43:45.705 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:46.009 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.0 2019-12-16T22:43:46.022 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:46.323 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.1 2019-12-16T22:43:46.335 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:46.634 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.2 2019-12-16T22:43:46.647 INFO:teuthology.orchestra.run.smithi177:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2019-12-16T22:43:46.941 INFO:teuthology.orchestra.run.smithi177.stderr:updated caps for client.mirror.3 2019-12-16T22:43:46.954 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:46.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2019-12-16T22:43:46.995 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2019-12-16T22:43:47.023 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2019-12-16T22:43:47.023 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:47.291 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2019-12-16T22:43:47.292 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2019-12-16T22:43:47.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2019-12-16T22:43:47.309 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:48.065 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2019-12-16T22:43:48.065 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2019-12-16T22:43:48.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2019-12-16T22:43:48.081 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:48.190 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2019-12-16T22:43:48.190 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2019-12-16T22:43:48.193 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2019-12-16T22:43:48.193 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:48.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2019-12-16T22:43:48.252 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2019-12-16T22:43:48.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2019-12-16T22:43:48.255 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:48.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2019-12-16T22:43:48.294 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2019-12-16T22:43:48.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2019-12-16T22:43:48.296 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:48.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2019-12-16T22:43:48.311 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2019-12-16T22:43:48.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2019-12-16T22:43:48.315 INFO:teuthology.run_tasks:Running task rbd-mirror... 2019-12-16T22:43:48.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Restarting daemon 2019-12-16T22:43:48.344 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 2019-12-16T22:43:48.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Started 2019-12-16T22:43:48.347 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2019-12-16T22:43:48.385 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1576536228 2019-12-16T22:43:48.385 DEBUG:tasks.rbd_mirror_thrash:Yielding 2019-12-16T22:43:48.385 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2019-12-16T22:43:48.398 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1576536228 2019-12-16T22:43:48.399 DEBUG:tasks.rbd_mirror_thrash:Yielding 2019-12-16T22:43:48.399 INFO:teuthology.run_tasks:Running task workunit... 2019-12-16T22:43:48.492 INFO:tasks.workunit:Pulling workunits from ref 8a58d0694cce968d9a21937d52c2e48cfe306455 2019-12-16T22:43:48.493 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-12-16T22:43:48.493 INFO:teuthology.orchestra.run.smithi177:> stat -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2019-12-16T22:43:48.494 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster1 2019-12-16T22:43:48.494 INFO:tasks.rbd_mirror_thrash:waiting for 79 secs before thrashing 2019-12-16T22:43:48.494 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster2 2019-12-16T22:43:48.494 INFO:tasks.rbd_mirror_thrash:waiting for 95 secs before thrashing 2019-12-16T22:43:48.501 INFO:teuthology.orchestra.run.smithi177.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.cluster1.mirror': No such file or directory 2019-12-16T22:43:48.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:43:48.501 INFO:teuthology.orchestra.run.smithi177:> mkdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2019-12-16T22:43:48.557 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.cluster1.mirror 2019-12-16T22:43:48.557 INFO:teuthology.orchestra.run.smithi177:> cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror && mkdir -- client.mirror 2019-12-16T22:43:48.603 INFO:tasks.workunit:timeout=3h 2019-12-16T22:43:48.603 INFO:tasks.workunit:cleanup=True 2019-12-16T22:43:48.604 INFO:teuthology.orchestra.run.smithi177:> rm -rf /home/ubuntu/cephtest/clone.cluster1.client.mirror && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.cluster1.client.mirror && cd /home/ubuntu/cephtest/clone.cluster1.client.mirror && git checkout 8a58d0694cce968d9a21937d52c2e48cfe306455 2019-12-16T22:43:48.778 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:Cloning into '/home/ubuntu/cephtest/clone.cluster1.client.mirror'... 2019-12-16T22:44:52.951 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:Note: checking out '8a58d0694cce968d9a21937d52c2e48cfe306455'. 2019-12-16T22:44:52.952 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr: 2019-12-16T22:44:52.952 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-12-16T22:44:52.952 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:changes and commit them, and you can discard any commits you make in this 2019-12-16T22:44:52.952 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:state without impacting any branches by performing another checkout. 2019-12-16T22:44:52.953 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr: 2019-12-16T22:44:52.953 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:If you want to create a new branch to retain commits you create, you may 2019-12-16T22:44:52.953 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-12-16T22:44:52.953 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr: 2019-12-16T22:44:52.953 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr: git checkout -b 2019-12-16T22:44:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr: 2019-12-16T22:44:52.954 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:HEAD is now at 8a58d0694c Merge branch 'wip-ubuntu-ftw' of https://github.com/liewegas/ceph into wip-sage3-testing-2019-12-16-1157 2019-12-16T22:44:52.956 INFO:teuthology.orchestra.run.smithi177:> cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror 2019-12-16T22:44:52.964 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-12-16T22:44:52.967 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2019-12-16T22:44:52.967 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-12-16T22:44:53.680 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-12-16T22:44:53.788 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-12-16T22:44:53.851 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2019-12-16T22:44:53.853 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2019-12-16T22:44:53.853 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-12-16T22:44:53.906 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2019-12-16T22:44:53.961 DEBUG:teuthology.orchestra.remote:smithi177:/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror is 4KB 2019-12-16T22:44:53.971 INFO:tasks.workunit:Running workunits matching rbd/rbd_mirror_fsx_prepare.sh on cluster1.client.mirror... 2019-12-16T22:44:53.971 INFO:tasks.workunit:Running workunit rbd/rbd_mirror_fsx_prepare.sh... 2019-12-16T22:44:53.972 INFO:teuthology.orchestra.run.smithi177:workunit test rbd/rbd_mirror_fsx_prepare.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=8a58d0694cce968d9a21937d52c2e48cfe306455 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ARGS='' RBD_MIRROR_USE_RBD_MIRROR=1 RBD_MIRROR_NOCLEANUP=1 RBD_MIRROR_USE_EXISTING_CLUSTER=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_prepare.sh 2019-12-16T22:44:53.982 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_prepare.sh 2019-12-16T22:44:53.984 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ . /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_helpers.sh 2019-12-16T22:44:53.984 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ type xmlstarlet 2019-12-16T22:44:53.984 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ XMLSTARLET=xmlstarlet 2019-12-16T22:44:53.984 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ RBD_MIRROR_INSTANCES=2 2019-12-16T22:44:53.984 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CLUSTER1=cluster1 2019-12-16T22:44:53.985 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CLUSTER2=cluster2 2019-12-16T22:44:53.985 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ PEER_CLUSTER_SUFFIX= 2019-12-16T22:44:53.985 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ POOL=mirror 2019-12-16T22:44:53.985 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ PARENT_POOL=mirror_parent 2019-12-16T22:44:53.985 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ NS1=ns1 2019-12-16T22:44:53.985 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ NS2=ns2 2019-12-16T22:44:53.985 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ TEMPDIR= 2019-12-16T22:44:53.986 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ID=mirror 2019-12-16T22:44:53.986 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ MIRROR_USER_ID_PREFIX=mirror. 2019-12-16T22:44:53.986 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ export CEPH_ARGS=--id mirror 2019-12-16T22:44:53.986 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ LAST_MIRROR_INSTANCE=1 2019-12-16T22:44:53.987 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_fsx_prepare.sh 2019-12-16T22:44:53.987 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ readlink -f /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/../../../src 2019-12-16T22:44:53.987 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror/src 2019-12-16T22:44:53.987 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_BIN=. 2019-12-16T22:44:53.987 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_SRC=. 2019-12-16T22:44:53.987 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -e CMakeCache.txt ] 2019-12-16T22:44:53.988 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ 0 -gt 0 ] 2019-12-16T22:44:53.988 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ setup 2019-12-16T22:44:53.989 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local c 2019-12-16T22:44:53.989 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ trap cleanup $? INT TERM EXIT 2019-12-16T22:44:53.989 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ setup_tempdir 2019-12-16T22:44:53.989 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -n ] 2019-12-16T22:44:53.989 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ mktemp -d 2019-12-16T22:44:53.990 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ TEMPDIR=/tmp/tmp.WIpC9bNYkD 2019-12-16T22:44:53.991 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -z 1 ] 2019-12-16T22:44:53.991 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ setup_pools cluster1 cluster2 2019-12-16T22:44:53.991 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local cluster=cluster1 2019-12-16T22:44:53.991 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local remote_cluster=cluster2 2019-12-16T22:44:53.991 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local mon_map_file 2019-12-16T22:44:53.991 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local mon_addr 2019-12-16T22:44:53.991 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local admin_key_file 2019-12-16T22:44:53.992 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local uuid 2019-12-16T22:44:53.992 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= ceph --cluster cluster1 osd pool create mirror 64 64 2019-12-16T22:44:55.047 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:pool 'mirror' already exists 2019-12-16T22:44:55.056 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= ceph --cluster cluster1 osd pool create mirror_parent 64 64 2019-12-16T22:44:56.073 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:pool 'mirror_parent' already exists 2019-12-16T22:44:56.086 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= rbd --cluster cluster1 pool init mirror 2019-12-16T22:44:59.006 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= rbd --cluster cluster1 pool init mirror_parent 2019-12-16T22:45:02.028 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -n ] 2019-12-16T22:45:02.028 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 mirror pool enable --site-name cluster1 mirror pool 2019-12-16T22:45:02.078 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 mirror pool enable mirror_parent image 2019-12-16T22:45:02.119 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 namespace create mirror/ns1 2019-12-16T22:45:02.158 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 namespace create mirror/ns2 2019-12-16T22:45:02.201 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns1 pool 2019-12-16T22:45:02.252 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns2 image 2019-12-16T22:45:02.299 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -z ] 2019-12-16T22:45:02.299 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -z ] 2019-12-16T22:45:02.299 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 mirror pool peer add mirror cluster2 2019-12-16T22:45:02.341 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:e17e363e-c42e-4064-b730-eea6911ce41f 2019-12-16T22:45:02.344 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster1 mirror pool peer add mirror_parent cluster2 2019-12-16T22:45:02.385 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:8cff133d-408b-48ec-9727-4666b1936419 2019-12-16T22:45:02.388 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ setup_pools cluster2 cluster1 2019-12-16T22:45:02.388 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local cluster=cluster2 2019-12-16T22:45:02.388 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local remote_cluster=cluster1 2019-12-16T22:45:02.388 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local mon_map_file 2019-12-16T22:45:02.388 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local mon_addr 2019-12-16T22:45:02.389 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local admin_key_file 2019-12-16T22:45:02.389 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local uuid 2019-12-16T22:45:02.389 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= ceph --cluster cluster2 osd pool create mirror 64 64 2019-12-16T22:45:03.188 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:pool 'mirror' already exists 2019-12-16T22:45:03.196 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= ceph --cluster cluster2 osd pool create mirror_parent 64 64 2019-12-16T22:45:04.214 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:pool 'mirror_parent' already exists 2019-12-16T22:45:04.223 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= rbd --cluster cluster2 pool init mirror 2019-12-16T22:45:07.138 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ CEPH_ARGS= rbd --cluster cluster2 pool init mirror_parent 2019-12-16T22:45:07.495 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.917628033059) > weight (0.25) 2019-12-16T22:45:07.495 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.2 2019-12-16T22:45:07.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Sent signal 15 2019-12-16T22:45:07.498 INFO:tasks.rbd_mirror_thrash:waiting for 7 secs before reviving daemons 2019-12-16T22:45:07.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi177.stderr:2019-12-16T22:45:07.494+0000 7fa318d52700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 (PID: 14237) UID: 1000 2019-12-16T22:45:07.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi177.stderr:daemon-helper: command failed with exit status 1 2019-12-16T22:45:10.157 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -n ] 2019-12-16T22:45:10.158 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 mirror pool enable --site-name cluster2 mirror pool 2019-12-16T22:45:10.200 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 mirror pool enable mirror_parent image 2019-12-16T22:45:10.241 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 namespace create mirror/ns1 2019-12-16T22:45:10.280 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 namespace create mirror/ns2 2019-12-16T22:45:10.314 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns1 pool 2019-12-16T22:45:10.355 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns2 image 2019-12-16T22:45:10.395 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -z ] 2019-12-16T22:45:10.395 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -z ] 2019-12-16T22:45:10.395 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 mirror pool peer add mirror cluster1 2019-12-16T22:45:10.428 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:533a2201-91b2-4ca5-8fdf-a8991e71a0f6 2019-12-16T22:45:10.431 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ rbd --cluster cluster2 mirror pool peer add mirror_parent cluster1 2019-12-16T22:45:10.466 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:dce4eb89-aecc-4909-b7fd-f1a19cc831cb 2019-12-16T22:45:10.469 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -n ] 2019-12-16T22:45:10.469 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ cleanup 0 2019-12-16T22:45:10.469 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ local error_code=0 2019-12-16T22:45:10.470 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ set +e 2019-12-16T22:45:10.470 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ 0 -ne 0 ] 2019-12-16T22:45:10.470 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ -z 1 ] 2019-12-16T22:45:10.470 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ [ 0 -eq 0 ] 2019-12-16T22:45:10.470 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ echo OK 2019-12-16T22:45:10.470 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stderr:+ exit 0 2019-12-16T22:45:10.470 INFO:tasks.workunit.cluster1.client.mirror.smithi177.stdout:OK 2019-12-16T22:45:10.471 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-16T22:45:10.471 INFO:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp 2019-12-16T22:45:10.491 INFO:tasks.workunit:Stopping ['rbd/rbd_mirror_fsx_prepare.sh'] on cluster1.client.mirror... 2019-12-16T22:45:10.491 INFO:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.cluster1.client.mirror /home/ubuntu/cephtest/clone.cluster1.client.mirror 2019-12-16T22:45:10.695 DEBUG:teuthology.parallel:result is None 2019-12-16T22:45:10.696 INFO:teuthology.orchestra.run.smithi177:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2019-12-16T22:45:10.709 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2019-12-16T22:45:10.709 INFO:teuthology.orchestra.run.smithi177:> rmdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2019-12-16T22:45:10.799 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror 2019-12-16T22:45:10.800 INFO:teuthology.run_tasks:Running task rbd_fsx... 2019-12-16T22:45:10.815 INFO:tasks.rbd_fsx:starting rbd_fsx... 2019-12-16T22:45:10.815 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.0 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.0 2019-12-16T22:45:10.816 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.1 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.1 2019-12-16T22:45:10.817 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.2 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.2 2019-12-16T22:45:10.817 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.3 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.3 2019-12-16T22:45:10.818 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.4 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.4 2019-12-16T22:45:10.818 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_librbd_fsx --cluster cluster1 --id mirror.5 -d -W -R -p 100 -P /home/ubuntu/cephtest/archive -r 1 -w 1 -t 1 -h 1 -l 250000000 -S 0 -N 6000 -k mirror image_cluster1.client.mirror.5 2019-12-16T22:45:10.842 INFO:teuthology.orchestra.run.smithi177.stdout:mapped writes DISABLED 2019-12-16T22:45:10.842 INFO:teuthology.orchestra.run.smithi177.stdout:mapped reads DISABLED 2019-12-16T22:45:10.842 INFO:teuthology.orchestra.run.smithi177.stdout:Seed set to 5317 2019-12-16T22:45:10.843 INFO:teuthology.orchestra.run.smithi177.stdout:mapped writes DISABLED 2019-12-16T22:45:10.843 INFO:teuthology.orchestra.run.smithi177.stdout:mapped reads DISABLED 2019-12-16T22:45:10.843 INFO:teuthology.orchestra.run.smithi177.stdout:Seed set to 5899 2019-12-16T22:45:10.843 INFO:teuthology.orchestra.run.smithi177.stdout:mapped writes DISABLED 2019-12-16T22:45:10.843 INFO:teuthology.orchestra.run.smithi177.stdout:mapped reads DISABLED 2019-12-16T22:45:10.843 INFO:teuthology.orchestra.run.smithi177.stdout:Seed set to 3323 2019-12-16T22:45:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:mapped writes DISABLED 2019-12-16T22:45:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:mapped reads DISABLED 2019-12-16T22:45:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:Seed set to 3555 2019-12-16T22:45:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:mapped writes DISABLED 2019-12-16T22:45:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:mapped reads DISABLED 2019-12-16T22:45:10.844 INFO:teuthology.orchestra.run.smithi177.stdout:Seed set to 6053 2019-12-16T22:45:10.845 INFO:teuthology.orchestra.run.smithi177.stdout:mapped writes DISABLED 2019-12-16T22:45:10.845 INFO:teuthology.orchestra.run.smithi177.stdout:mapped reads DISABLED 2019-12-16T22:45:10.845 INFO:teuthology.orchestra.run.smithi177.stdout:Seed set to 9789 2019-12-16T22:45:12.831 INFO:teuthology.orchestra.run.smithi177.stdout:skipping zero size read 2019-12-16T22:45:12.831 INFO:teuthology.orchestra.run.smithi177.stdout:skipping zero size read 2019-12-16T22:45:12.831 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xeb40cd7 2019-12-16T22:45:12.845 INFO:teuthology.orchestra.run.smithi177.stdout:2 write 0x4017b68 thru 0x401ca6d (0x4f06 bytes) 2019-12-16T22:45:12.852 INFO:teuthology.orchestra.run.smithi177.stdout:3 writesame 0x1e5d722 thru 0x1e65063 data_size 0x2(0x7942 bytes) 2019-12-16T22:45:12.854 INFO:teuthology.orchestra.run.smithi177.stdout:4 trunc from 0x0 to 0xeb40cd7 2019-12-16T22:45:12.870 INFO:teuthology.orchestra.run.smithi177.stdout:5 read 0x1044f1b thru 0x1053034 (0xe11a bytes) 2019-12-16T22:45:12.870 INFO:teuthology.orchestra.run.smithi177.stdout:6 punch from 0x3a0b0 to 0x484ff, (0xe44f bytes) 2019-12-16T22:45:12.870 INFO:teuthology.orchestra.run.smithi177.stdout:7 punch from 0x29cf147 to 0x29d043e, (0x12f7 bytes) 2019-12-16T22:45:12.870 INFO:teuthology.orchestra.run.smithi177.stdout:8 read 0x2089a3d thru 0x208e131 (0x46f5 bytes) 2019-12-16T22:45:12.870 INFO:teuthology.orchestra.run.smithi177.stdout:10 writesame 0x383abc5 thru 0x38400cc data_size 0xc(0x5508 bytes) 2019-12-16T22:45:12.876 INFO:teuthology.orchestra.run.smithi177.stdout:11 punch from 0x2356d58 to 0x235c5d1, (0x5879 bytes) 2019-12-16T22:45:12.876 INFO:teuthology.orchestra.run.smithi177.stdout:12 read 0x121085 thru 0x123f7c (0x2ef8 bytes) 2019-12-16T22:45:12.876 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0x40fb998 2019-12-16T22:45:12.876 INFO:teuthology.orchestra.run.smithi177.stdout:13 trunc from 0x401ca6e to 0x40fb998 2019-12-16T22:45:12.876 INFO:teuthology.orchestra.run.smithi177.stdout:5 punch from 0x4ce6123 to 0x4cf467d, (0xe55a bytes) 2019-12-16T22:45:12.876 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:12.877 INFO:teuthology.orchestra.run.smithi177.stdout:8 read 0xbf9a36 thru 0xc086d2 (0xec9d bytes) 2019-12-16T22:45:12.877 INFO:teuthology.orchestra.run.smithi177.stdout:9 writesame 0x41753da thru 0x417c1ba data_size 0x1(0x6de1 bytes) 2019-12-16T22:45:12.902 INFO:teuthology.orchestra.run.smithi177.stdout:10 write 0x131928 thru 0x1320ae (0x787 bytes) 2019-12-16T22:45:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:12.903 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:12.908 INFO:teuthology.orchestra.run.smithi177.stdout:11 punch from 0xc96eb36 to 0xc97bfb4, (0xd47e bytes) 2019-12-16T22:45:12.908 INFO:teuthology.orchestra.run.smithi177.stdout:12 read 0x46c4d13 thru 0x46c6c1f (0x1f0d bytes) 2019-12-16T22:45:12.908 INFO:teuthology.orchestra.run.smithi177.stdout:13 writesame 0xbbbadad thru 0xbbc5bee data_size 0xf(0xae42 bytes) 2019-12-16T22:45:12.912 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:12.912 INFO:teuthology.orchestra.run.smithi177.stdout:16 read 0x9126643 thru 0x9128be8 (0x25a6 bytes) 2019-12-16T22:45:12.912 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:12.920 INFO:teuthology.orchestra.run.smithi177.stdout:16 write 0x715f060 thru 0x716371c (0x46bd bytes) 2019-12-16T22:45:12.925 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:12.927 INFO:teuthology.orchestra.run.smithi177.stdout:18 writesame 0xec41c89 thru 0xec42100 data_size 0x2(0x478 bytes) 2019-12-16T22:45:12.947 INFO:teuthology.orchestra.run.smithi177.stdout:19 write 0xc1e0b19 thru 0xc1e151d (0xa05 bytes) 2019-12-16T22:45:12.948 INFO:teuthology.orchestra.run.smithi177.stdout:19 trunc from 0xec42101 to 0xa691e3 2019-12-16T22:45:12.953 INFO:teuthology.orchestra.run.smithi177.stdout:21 writesame 0xe1fe60 thru 0xe23c56 data_size 0x1(0x3df7 bytes) 2019-12-16T22:45:12.970 INFO:teuthology.orchestra.run.smithi177.stdout:22 writesame 0x98c5a5c thru 0x98d2484 data_size 0xd(0xca29 bytes) 2019-12-16T22:45:12.992 INFO:teuthology.orchestra.run.smithi177.stdout:24 trunc from 0xc1e151e to 0x5e1cba 2019-12-16T22:45:12.998 INFO:teuthology.orchestra.run.smithi177.stdout:20 writesame 0x6b03d75 thru 0x6b0b48c data_size 0x67(0x7718 bytes) 2019-12-16T22:45:13.002 INFO:teuthology.orchestra.run.smithi177.stdout:22 trunc from 0x6b0b48d to 0x457c4e7 2019-12-16T22:45:13.028 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xbc2a0c1 2019-12-16T22:45:13.028 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.028 INFO:teuthology.orchestra.run.smithi177.stdout:24 write 0x71e575 thru 0x728e43 (0xa8cf bytes) 2019-12-16T22:45:13.028 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.029 INFO:teuthology.orchestra.run.smithi177.stdout:27 read 0x2a2c5f thru 0x2ab401 (0x87a3 bytes) 2019-12-16T22:45:13.031 INFO:teuthology.orchestra.run.smithi177.stdout:26 trunc from 0x5e1cba to 0xbc2a0c1 2019-12-16T22:45:13.050 INFO:teuthology.orchestra.run.smithi177.stdout:28 writesame 0xcf57df9 thru 0xcf60c6e data_size 0x23(0x8e76 bytes) 2019-12-16T22:45:13.051 INFO:teuthology.orchestra.run.smithi177.stdout:30 punch from 0x7f9129 to 0x7fcf20, (0x3df7 bytes) 2019-12-16T22:45:13.052 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.052 INFO:teuthology.orchestra.run.smithi177.stdout:32 punch from 0x64c701a to 0x64c8cac, (0x1c92 bytes) 2019-12-16T22:45:13.053 INFO:teuthology.orchestra.run.smithi177.stdout:27 trunc from 0xbc2a0c1 to 0x4de629a 2019-12-16T22:45:13.059 INFO:teuthology.orchestra.run.smithi177.stdout:33 trunc from 0xcf60c6f to 0x74630c1 2019-12-16T22:45:13.065 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.075 INFO:teuthology.orchestra.run.smithi177.stdout:34 write 0x28fe50d thru 0x290ce63 (0xe957 bytes) 2019-12-16T22:45:13.086 INFO:teuthology.orchestra.run.smithi177.stdout:36 trunc from 0x74630c1 to 0x70ecb3d 2019-12-16T22:45:13.091 INFO:teuthology.orchestra.run.smithi177.stdout:31 write 0xa69be8a thru 0xa6a5daf (0x9f26 bytes) 2019-12-16T22:45:13.099 INFO:teuthology.orchestra.run.smithi177.stdout:32 read 0xde25e4 thru 0xdf18e3 (0xf300 bytes) 2019-12-16T22:45:13.099 INFO:teuthology.orchestra.run.smithi177.stdout:33 write 0x7a5fe09 thru 0x7a6a599 (0xa791 bytes) 2019-12-16T22:45:13.110 INFO:teuthology.orchestra.run.smithi177.stdout:34 writesame 0x2d5013b thru 0x2d521e4 data_size 0x25(0x20aa bytes) 2019-12-16T22:45:13.112 INFO:teuthology.orchestra.run.smithi177.stdout:36 punch from 0x1296dd to 0x13433b, (0xac5e bytes) 2019-12-16T22:45:13.112 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xc947049 2019-12-16T22:45:13.116 INFO:teuthology.orchestra.run.smithi177.stdout:39 trunc from 0xa6a5db0 to 0xc947049 2019-12-16T22:45:13.117 INFO:teuthology.orchestra.run.smithi177.stdout:37 writesame 0x7343e6b thru 0x7347ccb data_size 0x1(0x3e61 bytes) 2019-12-16T22:45:13.119 INFO:teuthology.orchestra.run.smithi177.stdout:38 read 0x1b98f5a thru 0x1ba14bf (0x8566 bytes) 2019-12-16T22:45:13.120 INFO:teuthology.orchestra.run.smithi177.stdout:39 punch from 0x70bcef0 to 0x70caef1, (0xe001 bytes) 2019-12-16T22:45:13.120 INFO:teuthology.orchestra.run.smithi177.stdout:42 write 0x90a119 thru 0x911e9f (0x7d87 bytes) 2019-12-16T22:45:13.125 INFO:teuthology.orchestra.run.smithi177.stdout:43 read 0x3c93f9a thru 0x3c941e8 (0x24f bytes) 2019-12-16T22:45:13.146 INFO:teuthology.orchestra.run.smithi177.stdout:41 write 0xce54209 thru 0xce5c5fe (0x83f6 bytes) 2019-12-16T22:45:13.150 INFO:teuthology.orchestra.run.smithi177.stdout:45 write 0xd75961e thru 0xd7623df (0x8dc2 bytes) 2019-12-16T22:45:13.152 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.152 INFO:teuthology.orchestra.run.smithi177.stdout:43 punch from 0x8206c2a to 0x8216abb, (0xfe91 bytes) 2019-12-16T22:45:13.152 INFO:teuthology.orchestra.run.smithi177.stdout:44 read 0x88bfb16 thru 0x88c2184 (0x266f bytes) 2019-12-16T22:45:13.153 INFO:teuthology.orchestra.run.smithi177.stdout:45 writesame 0xb1015da thru 0xb105524 data_size 0xb(0x3f4b bytes) 2019-12-16T22:45:13.157 INFO:teuthology.orchestra.run.smithi177.stdout:46 read 0xc235825 thru 0xc2371cb (0x19a7 bytes) 2019-12-16T22:45:13.157 INFO:teuthology.orchestra.run.smithi177.stdout:47 read 0xc048223 thru 0xc056102 (0xdee0 bytes) 2019-12-16T22:45:13.157 INFO:teuthology.orchestra.run.smithi177.stdout:48 write 0x8a7c673 thru 0x8a7f338 (0x2cc6 bytes) 2019-12-16T22:45:13.158 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.158 INFO:teuthology.orchestra.run.smithi177.stdout:47 writesame 0x487daa9 thru 0x48856ed data_size 0x1(0x7c45 bytes) 2019-12-16T22:45:13.163 INFO:teuthology.orchestra.run.smithi177.stdout:50 trunc from 0xd7623e0 to 0xccfa68a 2019-12-16T22:45:13.184 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.184 INFO:teuthology.orchestra.run.smithi177.stdout:53 write 0x1f8cf32 thru 0x1f94bbd (0x7c8c bytes) 2019-12-16T22:45:13.192 INFO:teuthology.orchestra.run.smithi177.stdout:54 writesame 0x7f10566 thru 0x7f1643b data_size 0x3d(0x5ed6 bytes) 2019-12-16T22:45:13.196 INFO:teuthology.orchestra.run.smithi177.stdout:51 write 0x7a8084a thru 0x7a83cca (0x3481 bytes) 2019-12-16T22:45:13.197 INFO:teuthology.orchestra.run.smithi177.stdout:56 write 0x55421b5 thru 0x554e6cc (0xc518 bytes) 2019-12-16T22:45:13.204 INFO:teuthology.orchestra.run.smithi177.stdout:53 read 0x4f62812 thru 0x4f6cb0c (0xa2fb bytes) 2019-12-16T22:45:13.205 INFO:teuthology.orchestra.run.smithi177.stdout:57 read 0x7bcfc29 thru 0x7bd554f (0x5927 bytes) 2019-12-16T22:45:13.206 INFO:teuthology.orchestra.run.smithi177.stdout:54 trunc from 0xccfa68a to 0xc1427fb 2019-12-16T22:45:13.206 INFO:teuthology.orchestra.run.smithi177.stdout:58 writesame 0x7d9d5ab thru 0x7da45b8 data_size 0x15(0x700e bytes) 2019-12-16T22:45:13.212 INFO:teuthology.orchestra.run.smithi177.stdout:59 trunc from 0xce5c5ff to 0xbcf0876 2019-12-16T22:45:13.221 INFO:teuthology.orchestra.run.smithi177.stdout:56 read 0x7800527 thru 0x780b839 (0xb313 bytes) 2019-12-16T22:45:13.222 INFO:teuthology.orchestra.run.smithi177.stdout:57 clone 1 order 19 su 2048 sc 3 2019-12-16T22:45:13.243 INFO:teuthology.orchestra.run.smithi177.stdout:61 trunc from 0xbcf0876 to 0x190f2ba 2019-12-16T22:45:13.263 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.264 INFO:teuthology.orchestra.run.smithi177.stdout:64 trunc from 0x190f2ba to 0x269c97a 2019-12-16T22:45:13.299 INFO:teuthology.orchestra.run.smithi177.stdout:65 write 0xa9c95a3 thru 0xa9c989c (0x2fa bytes) 2019-12-16T22:45:13.324 INFO:teuthology.orchestra.run.smithi177.stdout:66 write 0xe27629d thru 0xe2763f9 (0x15d bytes) 2019-12-16T22:45:13.328 INFO:teuthology.orchestra.run.smithi177.stdout:67 writesame 0x8af04b0 thru 0x8af671e data_size 0x1(0x626f bytes) 2019-12-16T22:45:13.350 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.350 INFO:teuthology.orchestra.run.smithi177.stdout:69 read 0xc509b1b thru 0xc515efe (0xc3e4 bytes) 2019-12-16T22:45:13.351 INFO:teuthology.orchestra.run.smithi177.stdout:71 write 0x3789d76 thru 0x37915dd (0x7868 bytes) 2019-12-16T22:45:13.356 INFO:teuthology.orchestra.run.smithi177.stdout:72 write 0x9decf7e thru 0x9dee3d0 (0x1453 bytes) 2019-12-16T22:45:13.377 INFO:teuthology.orchestra.run.smithi177.stdout:73 trunc from 0xe2763fa to 0x61bd994 2019-12-16T22:45:13.401 INFO:teuthology.orchestra.run.smithi177.stdout:76 write 0xe6d75 thru 0xf49c5 (0xdc51 bytes) 2019-12-16T22:45:13.411 INFO:teuthology.orchestra.run.smithi177.stdout:77 writesame 0x4f9d365 thru 0x4facd2e data_size 0x1(0xf9ca bytes) 2019-12-16T22:45:13.459 INFO:teuthology.orchestra.run.smithi177.stdout:78 punch from 0x3b9f7a0 to 0x3ba4078, (0x48d8 bytes) 2019-12-16T22:45:13.460 INFO:teuthology.orchestra.run.smithi177.stdout:79 read 0x38a9a64 thru 0x38b5b36 (0xc0d3 bytes) 2019-12-16T22:45:13.460 INFO:teuthology.orchestra.run.smithi177.stdout:80 read 0x24e260 thru 0x25d91c (0xf6bd bytes) 2019-12-16T22:45:13.462 INFO:teuthology.orchestra.run.smithi177.stdout:81 trunc from 0x61bd994 to 0x77be0f7 2019-12-16T22:45:13.478 INFO:teuthology.orchestra.run.smithi177.stdout:82 read 0x22319dc thru 0x2240066 (0xe68b bytes) 2019-12-16T22:45:13.484 INFO:teuthology.orchestra.run.smithi177.stdout:83 trunc from 0x77be0f7 to 0x35380fb 2019-12-16T22:45:13.540 INFO:teuthology.orchestra.run.smithi177.stdout:84 write 0xbc22e73 thru 0xbc2e59c (0xb72a bytes) 2019-12-16T22:45:13.543 INFO:teuthology.orchestra.run.smithi177.stdout:1 write 0x246e2ef thru 0x2470035 (0x1d47 bytes) 2019-12-16T22:45:13.547 INFO:teuthology.orchestra.run.smithi177.stdout:85 write 0x415f27c thru 0x416bffd (0xcd82 bytes) 2019-12-16T22:45:13.555 INFO:teuthology.orchestra.run.smithi177.stdout:86 write 0x8b6a71 thru 0x8b8738 (0x1cc8 bytes) 2019-12-16T22:45:13.563 INFO:teuthology.orchestra.run.smithi177.stdout:88 read 0x29a52d8 thru 0x29add70 (0x8a99 bytes) 2019-12-16T22:45:13.563 INFO:teuthology.orchestra.run.smithi177.stdout:89 read 0x10f86ee thru 0x1104567 (0xbe7a bytes) 2019-12-16T22:45:13.563 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.579 INFO:teuthology.orchestra.run.smithi177.stdout:91 trunc from 0xbc2e59d to 0x124c798 2019-12-16T22:45:13.582 INFO:teuthology.orchestra.run.smithi177.stdout:2 write 0x8411f60 thru 0x8413dde (0x1e7f bytes) 2019-12-16T22:45:13.585 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xeda2071 2019-12-16T22:45:13.606 INFO:teuthology.orchestra.run.smithi177.stdout:skipping zero size read 2019-12-16T22:45:13.607 INFO:teuthology.orchestra.run.smithi177.stdout:skipping zero length punch hole 2019-12-16T22:45:13.607 INFO:teuthology.orchestra.run.smithi177.stdout:3 trunc from 0x0 to 0xeda2071 2019-12-16T22:45:13.607 INFO:teuthology.orchestra.run.smithi177.stdout:92 read 0x49e3f1 thru 0x4ad557 (0xf167 bytes) 2019-12-16T22:45:13.610 INFO:teuthology.orchestra.run.smithi177.stdout:3 write 0x880cb77 thru 0x88139f1 (0x6e7b bytes) 2019-12-16T22:45:13.618 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.622 INFO:teuthology.orchestra.run.smithi177.stdout:4 write 0x3927360 thru 0x39362d2 (0xef73 bytes) 2019-12-16T22:45:13.629 INFO:teuthology.orchestra.run.smithi177.stdout:4 write 0x52d350c thru 0x52d38e8 (0x3dd bytes) 2019-12-16T22:45:13.635 INFO:teuthology.orchestra.run.smithi177.stdout:5 write 0x2dcdb74 thru 0x2dcf743 (0x1bd0 bytes) 2019-12-16T22:45:13.640 INFO:teuthology.orchestra.run.smithi177.stdout:93 write 0x9499bc6 thru 0x949a662 (0xa9d bytes) 2019-12-16T22:45:13.646 INFO:teuthology.orchestra.run.smithi177.stdout:94 write 0x2fe4d16 thru 0x2ff2219 (0xd504 bytes) 2019-12-16T22:45:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:6 trunc from 0xeda2071 to 0xb5a763b 2019-12-16T22:45:13.651 INFO:teuthology.orchestra.run.smithi177.stdout:5 write 0xbd7bff0 thru 0xbd7f04b (0x305c bytes) 2019-12-16T22:45:13.655 INFO:teuthology.orchestra.run.smithi177.stdout:95 read 0x5c037f3 thru 0x5c105f2 (0xce00 bytes) 2019-12-16T22:45:13.657 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0x2a3e5e7 2019-12-16T22:45:13.664 INFO:teuthology.orchestra.run.smithi177.stdout:96 trunc from 0x949a663 to 0xb97fb46 2019-12-16T22:45:13.669 INFO:teuthology.orchestra.run.smithi177.stdout:7 read 0x3fcbcef thru 0x3fdb5d5 (0xf8e7 bytes) 2019-12-16T22:45:13.671 INFO:teuthology.orchestra.run.smithi177.stdout:6 writesame 0xce6409f thru 0xce6faec data_size 0x3(0xba4e bytes) 2019-12-16T22:45:13.673 INFO:teuthology.orchestra.run.smithi177.stdout:7 trunc from 0xbd7f04c to 0x2a3e5e7 2019-12-16T22:45:13.673 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.673 INFO:teuthology.orchestra.run.smithi177.stdout:11 clone 1 order 22 su 1048576 sc 11 2019-12-16T22:45:13.679 INFO:teuthology.orchestra.run.smithi177.stdout:11 trunc from 0xb5a763b to 0x49541c2 2019-12-16T22:45:13.681 INFO:teuthology.orchestra.run.smithi177.stdout:98 read 0x89dc8c2 thru 0x89e3599 (0x6cd8 bytes) 2019-12-16T22:45:13.681 INFO:teuthology.orchestra.run.smithi177.stdout:99 write 0x468b67c thru 0x46966b5 (0xb03a bytes) 2019-12-16T22:45:13.681 INFO:teuthology.orchestra.run.smithi177.stdout:1 write 0xbdbb232 thru 0xbdc5843 (0xa612 bytes) 2019-12-16T22:45:13.696 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.698 INFO:teuthology.orchestra.run.smithi177.stdout:2 writesame 0x75a484d thru 0x75b34c4 data_size 0x5e(0xec78 bytes) 2019-12-16T22:45:13.702 INFO:teuthology.orchestra.run.smithi177.stdout:101 trunc from 0xb97fb46 to 0x73735d5 2019-12-16T22:45:13.711 INFO:teuthology.orchestra.run.smithi177.stdout:3 read 0x9a29e3c thru 0x9a3254d (0x8712 bytes) 2019-12-16T22:45:13.711 INFO:teuthology.orchestra.run.smithi177.stdout:4 read 0x7e57564 thru 0x7e63c9d (0xc73a bytes) 2019-12-16T22:45:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:5 punch from 0x88ffa91 to 0x8909376, (0x98e5 bytes) 2019-12-16T22:45:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xce71022 2019-12-16T22:45:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:8 trunc from 0xbdc5844 to 0xce71022 2019-12-16T22:45:13.712 INFO:teuthology.orchestra.run.smithi177.stdout:8 write 0x13ef908 thru 0x13fee83 (0xf57c bytes) 2019-12-16T22:45:13.721 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0x9129c68 2019-12-16T22:45:13.722 INFO:teuthology.orchestra.run.smithi177.stdout:13 trunc from 0x49541c2 to 0xaf5c18 2019-12-16T22:45:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:9 clone 1 order 20 su 4096 sc 6 2019-12-16T22:45:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.731 INFO:teuthology.orchestra.run.smithi177.stdout:106 write 0x25be1b7 thru 0x25cc4e4 (0xe32e bytes) 2019-12-16T22:45:13.733 INFO:teuthology.orchestra.run.smithi177.stdout:15 trunc from 0x2a3e5e7 to 0x9129c68 2019-12-16T22:45:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:107 punch from 0x2455aa6 to 0x2455ed2, (0x42c bytes) 2019-12-16T22:45:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:109 read 0x70e5944 thru 0x70eef1b (0x95d8 bytes) 2019-12-16T22:45:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:110 punch from 0x4f4ca2d to 0x4f52571, (0x5b44 bytes) 2019-12-16T22:45:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.738 INFO:teuthology.orchestra.run.smithi177.stdout:114 write 0x190859c thru 0x190da71 (0x54d6 bytes) 2019-12-16T22:45:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.745 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.747 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xdf0f6a0 2019-12-16T22:45:13.752 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.752 INFO:teuthology.orchestra.run.smithi177.stdout:17 writesame 0x4e5f5da thru 0x4e6a55e data_size 0x31(0xaf85 bytes) 2019-12-16T22:45:13.758 INFO:teuthology.orchestra.run.smithi177.stdout:117 trunc from 0x73735d5 to 0xdf0f6a0 2019-12-16T22:45:13.758 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.758 INFO:teuthology.orchestra.run.smithi177.stdout:20 clone 1 order 25 su 8388608 sc 4 2019-12-16T22:45:13.774 INFO:teuthology.orchestra.run.smithi177.stdout:14 write 0x9994dd7 thru 0x99a04d3 (0xb6fd bytes) 2019-12-16T22:45:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:118 read 0x52f8fc9 thru 0x52f9413 (0x44b bytes) 2019-12-16T22:45:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:119 read 0x89da18d thru 0x89e6b71 (0xc9e5 bytes) 2019-12-16T22:45:13.775 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:123 punch from 0x2f089c7 to 0x2f140fb, (0xb734 bytes) 2019-12-16T22:45:13.776 INFO:teuthology.orchestra.run.smithi177.stdout:124 write 0x27439f8 thru 0x274bd9f (0x83a8 bytes) 2019-12-16T22:45:13.783 INFO:teuthology.orchestra.run.smithi177.stdout:125 read 0x2f08a48 thru 0x2f09b0e (0x10c7 bytes) 2019-12-16T22:45:13.783 INFO:teuthology.orchestra.run.smithi177.stdout:126 writesame 0x88f9a74 thru 0x890263e data_size 0x3(0x8bcb bytes) 2019-12-16T22:45:13.785 INFO:teuthology.orchestra.run.smithi177.stdout:15 punch from 0x16c89bc to 0x16d378d, (0xadd1 bytes) 2019-12-16T22:45:13.797 INFO:teuthology.orchestra.run.smithi177.stdout:128 write 0xcfb4ff1 thru 0xcfbfe58 (0xae68 bytes) 2019-12-16T22:45:13.802 INFO:teuthology.orchestra.run.smithi177.stdout:129 write 0x42145d thru 0x4216ee (0x292 bytes) 2019-12-16T22:45:13.816 INFO:teuthology.orchestra.run.smithi177.stdout:16 writesame 0xe7582eb thru 0xe762990 data_size 0x2(0xa6a6 bytes) 2019-12-16T22:45:13.817 INFO:teuthology.orchestra.run.smithi177.stdout:19 write 0x19c8b0c thru 0x19d578b (0xcc80 bytes) 2019-12-16T22:45:13.818 INFO:teuthology.orchestra.run.smithi177.stdout:131 trunc from 0xdf0f6a0 to 0x796cfa7 2019-12-16T22:45:13.826 INFO:teuthology.orchestra.run.smithi177.stdout:20 read 0x4dabe64 thru 0x4dad997 (0x1b34 bytes) 2019-12-16T22:45:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:21 punch from 0x6b6b663 to 0x6b73e1d, (0x87ba bytes) 2019-12-16T22:45:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:23 read 0x7410fdd thru 0x741261c (0x1640 bytes) 2019-12-16T22:45:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:24 punch from 0x2dc6e85 to 0x2dca0f9, (0x3274 bytes) 2019-12-16T22:45:13.827 INFO:teuthology.orchestra.run.smithi177.stdout:25 write 0x5dd2878 thru 0x5dd3afb (0x1284 bytes) 2019-12-16T22:45:13.834 INFO:teuthology.orchestra.run.smithi177.stdout:26 write 0x2900ef9 thru 0x29081fa (0x7302 bytes) 2019-12-16T22:45:13.844 INFO:teuthology.orchestra.run.smithi177.stdout:28 write 0xdf839e7 thru 0xdf85a18 (0x2032 bytes) 2019-12-16T22:45:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:29 read 0x69e1e2f thru 0x69e5239 (0x340b bytes) 2019-12-16T22:45:13.852 INFO:teuthology.orchestra.run.smithi177.stdout:31 write 0x8e6edd5 thru 0x8e6f0ab (0x2d7 bytes) 2019-12-16T22:45:13.853 INFO:teuthology.orchestra.run.smithi177.stdout:132 write 0x5f773ed thru 0x5f7adb8 (0x39cc bytes) 2019-12-16T22:45:13.861 INFO:teuthology.orchestra.run.smithi177.stdout:133 read 0x26025e3 thru 0x260b121 (0x8b3f bytes) 2019-12-16T22:45:13.862 INFO:teuthology.orchestra.run.smithi177.stdout:136 read 0x39c4faa thru 0x39d03da (0xb431 bytes) 2019-12-16T22:45:13.871 INFO:teuthology.orchestra.run.smithi177.stdout:33 trunc from 0xe762991 to 0xa048ae7 2019-12-16T22:45:13.885 INFO:teuthology.orchestra.run.smithi177.stdout:137 write 0x827d37e thru 0x827e865 (0x14e8 bytes) 2019-12-16T22:45:13.890 INFO:teuthology.orchestra.run.smithi177.stdout:138 read 0x22fa84e thru 0x23026e8 (0x7e9b bytes) 2019-12-16T22:45:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.891 INFO:teuthology.orchestra.run.smithi177.stdout:140 write 0x5ed8f56 thru 0x5ee75d7 (0xe682 bytes) 2019-12-16T22:45:13.896 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe197943 2019-12-16T22:45:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:36 read 0x95754ea thru 0x9578cf4 (0x380b bytes) 2019-12-16T22:45:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:13.897 INFO:teuthology.orchestra.run.smithi177.stdout:40 write 0x4d59e9c thru 0x4d5e229 (0x438e bytes) 2019-12-16T22:45:13.903 INFO:teuthology.orchestra.run.smithi177.stdout:41 punch from 0x90ce12e to 0x90d98e2, (0xb7b4 bytes) 2019-12-16T22:45:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:141 trunc from 0x827e866 to 0xe197943 2019-12-16T22:45:13.915 INFO:teuthology.orchestra.run.smithi177.stdout:42 trunc from 0xa048ae7 to 0xd21bdc0 2019-12-16T22:45:13.935 INFO:teuthology.orchestra.run.smithi177.stdout:43 read 0xc87ca61 thru 0xc888014 (0xb5b4 bytes) 2019-12-16T22:45:13.935 INFO:teuthology.orchestra.run.smithi177.stdout:46 writesame 0xd1b16c8 thru 0xd1ba3e2 data_size 0x1(0x8d1b bytes) 2019-12-16T22:45:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:142 trunc from 0xe197943 to 0xc09e370 2019-12-16T22:45:13.966 INFO:teuthology.orchestra.run.smithi177.stdout:144 writesame 0x20be1b1 thru 0x20c428e data_size 0x3(0x60de bytes) 2019-12-16T22:45:13.966 INFO:teuthology.orchestra.run.smithi177.stdout:47 writesame 0x9e07f06 thru 0x9e13244 data_size 0x1(0xb33f bytes) 2019-12-16T22:45:13.988 INFO:teuthology.orchestra.run.smithi177.stdout:146 write 0x88dab95 thru 0x88e4436 (0x98a2 bytes) 2019-12-16T22:45:14.014 INFO:teuthology.orchestra.run.smithi177.stdout:48 write 0x11fe595 thru 0x12047c9 (0x6235 bytes) 2019-12-16T22:45:14.021 INFO:teuthology.orchestra.run.smithi177.stdout:148 punch from 0x2ae08ec to 0x2aeb458, (0xab6c bytes) 2019-12-16T22:45:14.021 INFO:teuthology.orchestra.run.smithi177.stdout:149 read 0x655ed91 thru 0x656957a (0xa7ea bytes) 2019-12-16T22:45:14.021 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.021 INFO:teuthology.orchestra.run.smithi177.stdout:152 read 0x55889b8 thru 0x5590924 (0x7f6d bytes) 2019-12-16T22:45:14.021 INFO:teuthology.orchestra.run.smithi177.stdout:153 write 0x50ae71a thru 0x50b6ebd (0x87a4 bytes) 2019-12-16T22:45:14.022 INFO:teuthology.orchestra.run.smithi177.stdout:49 write 0x4781020 thru 0x4789f52 (0x8f33 bytes) 2019-12-16T22:45:14.032 INFO:teuthology.orchestra.run.smithi177.stdout:154 writesame 0x46b241b thru 0x46bd7de data_size 0xb1(0xb3c4 bytes) 2019-12-16T22:45:14.038 INFO:teuthology.orchestra.run.smithi177.stdout:155 write 0x8644fa9 thru 0x864a52d (0x5585 bytes) 2019-12-16T22:45:14.053 INFO:teuthology.orchestra.run.smithi177.stdout:156 trunc from 0xc09e370 to 0x793aae4 2019-12-16T22:45:14.058 INFO:teuthology.orchestra.run.smithi177.stdout:50 trunc from 0xd21bdc0 to 0x10243df 2019-12-16T22:45:14.093 INFO:teuthology.orchestra.run.smithi177.stdout:51 read 0xd1a0b thru 0xd6f17 (0x550d bytes) 2019-12-16T22:45:14.099 INFO:teuthology.orchestra.run.smithi177.stdout:158 trunc from 0x793aae4 to 0x217e8e5 2019-12-16T22:45:14.125 INFO:teuthology.orchestra.run.smithi177.stdout:52 write 0x9cf2105 thru 0x9cfa274 (0x8170 bytes) 2019-12-16T22:45:14.131 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.132 INFO:teuthology.orchestra.run.smithi177.stdout:55 read 0xe783a3 thru 0xe82e8c (0xaaea bytes) 2019-12-16T22:45:14.132 INFO:teuthology.orchestra.run.smithi177.stdout:56 read 0x4a5c119 thru 0x4a5fbf2 (0x3ada bytes) 2019-12-16T22:45:14.154 INFO:teuthology.orchestra.run.smithi177.stdout:159 writesame 0x91481bd thru 0x914ba82 data_size 0x2b(0x38c6 bytes) 2019-12-16T22:45:14.155 INFO:teuthology.orchestra.run.smithi177.stdout:57 write 0xd213bb8 thru 0xd21d8cc (0x9d15 bytes) 2019-12-16T22:45:14.177 INFO:teuthology.orchestra.run.smithi177.stdout:162 writesame 0xad43007 thru 0xad50c1d data_size 0x7(0xdc17 bytes) 2019-12-16T22:45:14.178 INFO:teuthology.orchestra.run.smithi177.stdout:59 writesame 0xd8dfb82 thru 0xd8e1dbf data_size 0x9(0x223e bytes) 2019-12-16T22:45:14.202 INFO:teuthology.orchestra.run.smithi177.stdout:164 trunc from 0xad50c1e to 0x43d3ff1 2019-12-16T22:45:14.205 INFO:teuthology.orchestra.run.smithi177.stdout:61 trunc from 0xd8e1dc0 to 0x58809e4 2019-12-16T22:45:14.227 INFO:teuthology.orchestra.run.smithi177.stdout:62 write 0x9f6885 thru 0x9fce61 (0x65dd bytes) 2019-12-16T22:45:14.241 INFO:teuthology.orchestra.run.smithi177.stdout:63 punch from 0x35bedc5 to 0x35c5ee8, (0x7123 bytes) 2019-12-16T22:45:14.243 INFO:teuthology.orchestra.run.smithi177.stdout:166 write 0x4e1e6e0 thru 0x4e233ff (0x4d20 bytes) 2019-12-16T22:45:14.252 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.252 INFO:teuthology.orchestra.run.smithi177.stdout:169 read 0xb3089 thru 0xbc32b (0x92a3 bytes) 2019-12-16T22:45:14.253 INFO:teuthology.orchestra.run.smithi177.stdout:170 read 0x18333ff thru 0x1839789 (0x638b bytes) 2019-12-16T22:45:14.253 INFO:teuthology.orchestra.run.smithi177.stdout:172 punch from 0x3b758be to 0x3b7d266, (0x79a8 bytes) 2019-12-16T22:45:14.253 INFO:teuthology.orchestra.run.smithi177.stdout:173 read 0x55d3a9 thru 0x55eb4a (0x17a2 bytes) 2019-12-16T22:45:14.254 INFO:teuthology.orchestra.run.smithi177.stdout:174 punch from 0x3939114 to 0x3946da5, (0xdc91 bytes) 2019-12-16T22:45:14.271 INFO:teuthology.orchestra.run.smithi177.stdout:23 read 0x35f5052 thru 0x35f93c2 (0x4371 bytes) 2019-12-16T22:45:14.271 INFO:teuthology.orchestra.run.smithi177.stdout:60 writesame 0x58541b2 thru 0x5856ea0 data_size 0x1(0x2cef bytes) 2019-12-16T22:45:14.271 INFO:teuthology.orchestra.run.smithi177.stdout:65 write 0xb05e843 thru 0xb05f99f (0x115d bytes) 2019-12-16T22:45:14.273 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.274 INFO:teuthology.orchestra.run.smithi177.stdout:68 read 0x4468cd thru 0x44d938 (0x706c bytes) 2019-12-16T22:45:14.274 INFO:teuthology.orchestra.run.smithi177.stdout:69 read 0x325f0c0 thru 0x32627a6 (0x36e7 bytes) 2019-12-16T22:45:14.274 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.274 INFO:teuthology.orchestra.run.smithi177.stdout:71 punch from 0x5eef67c to 0x5ef5799, (0x611d bytes) 2019-12-16T22:45:14.275 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.275 INFO:teuthology.orchestra.run.smithi177.stdout:73 read 0x1e4d27d thru 0x1e4e518 (0x129c bytes) 2019-12-16T22:45:14.275 INFO:teuthology.orchestra.run.smithi177.stdout:75 writesame 0x216e763 thru 0x2172928 data_size 0x1(0x41c6 bytes) 2019-12-16T22:45:14.279 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.280 INFO:teuthology.orchestra.run.smithi177.stdout:27 read 0x6fed442 thru 0x6ff422a (0x6de9 bytes) 2019-12-16T22:45:14.282 INFO:teuthology.orchestra.run.smithi177.stdout:175 write 0x84f75b3 thru 0x850120e (0x9c5c bytes) 2019-12-16T22:45:14.291 INFO:teuthology.orchestra.run.smithi177.stdout:76 write 0x33d7121 thru 0x33deb86 (0x7a66 bytes) 2019-12-16T22:45:14.298 INFO:teuthology.orchestra.run.smithi177.stdout:176 write 0x66c9312 thru 0x66cf4c4 (0x61b3 bytes) 2019-12-16T22:45:14.301 INFO:teuthology.orchestra.run.smithi177.stdout:78 punch from 0x2c51c27 to 0x2c54380, (0x2759 bytes) 2019-12-16T22:45:14.301 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.301 INFO:teuthology.orchestra.run.smithi177.stdout:80 write 0xc7cf4c thru 0xc8ab97 (0xdc4c bytes) 2019-12-16T22:45:14.312 INFO:teuthology.orchestra.run.smithi177.stdout:28 writesame 0xbe8188c thru 0xbe9094d data_size 0x1(0xf0c2 bytes) 2019-12-16T22:45:14.312 INFO:teuthology.orchestra.run.smithi177.stdout:29 read 0x454a22f thru 0x454c9ef (0x27c1 bytes) 2019-12-16T22:45:14.313 INFO:teuthology.orchestra.run.smithi177.stdout:30 read 0x1d23d9e thru 0x1d2bc95 (0x7ef8 bytes) 2019-12-16T22:45:14.313 INFO:teuthology.orchestra.run.smithi177.stdout:31 read 0x85926fa thru 0x859d11d (0xaa24 bytes) 2019-12-16T22:45:14.313 INFO:teuthology.orchestra.run.smithi177.stdout:32 read 0x3978368 thru 0x397c8de (0x4577 bytes) 2019-12-16T22:45:14.313 INFO:teuthology.orchestra.run.smithi177.stdout:34 punch from 0x3b0944b to 0x3b0e5a7, (0x515c bytes) 2019-12-16T22:45:14.313 INFO:teuthology.orchestra.run.smithi177.stdout:177 write 0x7f156c thru 0x7f7051 (0x5ae6 bytes) 2019-12-16T22:45:14.313 INFO:teuthology.orchestra.run.smithi177.stdout:81 punch from 0x1f225de to 0x1f32353, (0xfd75 bytes) 2019-12-16T22:45:14.314 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.322 INFO:teuthology.orchestra.run.smithi177.stdout:35 trunc from 0xbe9094e to 0x353e163 2019-12-16T22:45:14.324 INFO:teuthology.orchestra.run.smithi177.stdout:83 trunc from 0xb05f9a0 to 0x309a84e 2019-12-16T22:45:14.324 INFO:teuthology.orchestra.run.smithi177.stdout:61 write 0x7e0f076 thru 0x7e1cd93 (0xdd1e bytes) 2019-12-16T22:45:14.333 INFO:teuthology.orchestra.run.smithi177.stdout:12 punch from 0x4fb5373 to 0x4fb8015, (0x2ca2 bytes) 2019-12-16T22:45:14.335 INFO:teuthology.orchestra.run.smithi177.stdout:10 write 0x1b9dbec thru 0x1ba73f5 (0x980a bytes) 2019-12-16T22:45:14.351 INFO:teuthology.orchestra.run.smithi177.stdout:64 write 0x442d8b9 thru 0x443ca8b (0xf1d3 bytes) 2019-12-16T22:45:14.351 INFO:teuthology.orchestra.run.smithi177.stdout:178 write 0xb7bffb5 thru 0xb7c06bd (0x709 bytes) 2019-12-16T22:45:14.352 INFO:teuthology.orchestra.run.smithi177.stdout:14 write 0xbe968cc thru 0xbea4cca (0xe3ff bytes) 2019-12-16T22:45:14.359 INFO:teuthology.orchestra.run.smithi177.stdout:179 write 0x838f940 thru 0x838fc29 (0x2ea bytes) 2019-12-16T22:45:14.364 INFO:teuthology.orchestra.run.smithi177.stdout:15 read 0x1737001 thru 0x17441e0 (0xd1e0 bytes) 2019-12-16T22:45:14.364 INFO:teuthology.orchestra.run.smithi177.stdout:17 write 0x4fb9959 thru 0x4fc3179 (0x9821 bytes) 2019-12-16T22:45:14.364 INFO:teuthology.orchestra.run.smithi177.stdout:84 punch from 0x1491568 to 0x1493a5b, (0x24f3 bytes) 2019-12-16T22:45:14.367 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.368 INFO:teuthology.orchestra.run.smithi177.stdout:182 write 0x57b61c6 thru 0x57c3a46 (0xd881 bytes) 2019-12-16T22:45:14.369 INFO:teuthology.orchestra.run.smithi177.stdout:36 read 0x6e6fd1 thru 0x6edb71 (0x6ba1 bytes) 2019-12-16T22:45:14.372 INFO:teuthology.orchestra.run.smithi177.stdout:37 punch from 0x2381786 to 0x238b05a, (0x98d4 bytes) 2019-12-16T22:45:14.372 INFO:teuthology.orchestra.run.smithi177.stdout:38 punch from 0x1c7694f to 0x1c85f2c, (0xf5dd bytes) 2019-12-16T22:45:14.372 INFO:teuthology.orchestra.run.smithi177.stdout:39 write 0x2a87711 thru 0x2a89289 (0x1b79 bytes) 2019-12-16T22:45:14.373 INFO:teuthology.orchestra.run.smithi177.stdout:21 punch from 0xe10548 to 0xe10e14, (0x8cc bytes) 2019-12-16T22:45:14.374 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xbf04612 2019-12-16T22:45:14.375 INFO:teuthology.orchestra.run.smithi177.stdout:22 trunc from 0xce6faed to 0xbf04612 2019-12-16T22:45:14.376 INFO:teuthology.orchestra.run.smithi177.stdout:40 punch from 0x2a5c015 to 0x2a65c6c, (0x9c57 bytes) 2019-12-16T22:45:14.376 INFO:teuthology.orchestra.run.smithi177.stdout:41 write 0x673dc2 thru 0x676920 (0x2b5f bytes) 2019-12-16T22:45:14.378 INFO:teuthology.orchestra.run.smithi177.stdout:184 write 0x4c552e8 thru 0x4c5a139 (0x4e52 bytes) 2019-12-16T22:45:14.379 INFO:teuthology.orchestra.run.smithi177.stdout:65 writesame 0xbe3faf6 thru 0xbe4cc30 data_size 0x1(0xd13b bytes) 2019-12-16T22:45:14.388 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.388 INFO:teuthology.orchestra.run.smithi177.stdout:44 read 0x1471347 thru 0x147f509 (0xe1c3 bytes) 2019-12-16T22:45:14.392 INFO:teuthology.orchestra.run.smithi177.stdout:46 trunc from 0x353e163 to 0x2203692 2019-12-16T22:45:14.393 INFO:teuthology.orchestra.run.smithi177.stdout:185 write 0x42377e3 thru 0x42387f3 (0x1011 bytes) 2019-12-16T22:45:14.414 INFO:teuthology.orchestra.run.smithi177.stdout:85 writesame 0xc5b3447 thru 0xc5b5c51 data_size 0x33(0x280b bytes) 2019-12-16T22:45:14.427 INFO:teuthology.orchestra.run.smithi177.stdout:11 write 0xccb582d thru 0xccc10bc (0xb890 bytes) 2019-12-16T22:45:14.428 INFO:teuthology.orchestra.run.smithi177.stdout:86 writesame 0xb8d4047 thru 0xb8d6a34 data_size 0x3(0x29ee bytes) 2019-12-16T22:45:14.436 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.436 INFO:teuthology.orchestra.run.smithi177.stdout:188 clone 1 order 19 su 32768 sc 9 2019-12-16T22:45:14.439 INFO:teuthology.orchestra.run.smithi177.stdout:88 read 0x94dcc21 thru 0x94dfb30 (0x2f10 bytes) 2019-12-16T22:45:14.439 INFO:teuthology.orchestra.run.smithi177.stdout:90 punch from 0xc26a73a to 0xc277f2b, (0xd7f1 bytes) 2019-12-16T22:45:14.446 INFO:teuthology.orchestra.run.smithi177.stdout:68 trunc from 0xc1427fb to 0x3f9fbec 2019-12-16T22:45:14.449 INFO:teuthology.orchestra.run.smithi177.stdout:23 punch from 0xa6de7cc to 0xa6e7647, (0x8e7b bytes) 2019-12-16T22:45:14.449 INFO:teuthology.orchestra.run.smithi177.stdout:24 punch from 0xb2aa90 to 0xb2cb48, (0x20b8 bytes) 2019-12-16T22:45:14.450 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.467 INFO:teuthology.orchestra.run.smithi177.stdout:26 trunc from 0xbf04612 to 0x780aa31 2019-12-16T22:45:14.468 INFO:teuthology.orchestra.run.smithi177.stdout:94 trunc from 0xc5b5c52 to 0x20d5b15 2019-12-16T22:45:14.468 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe238d14 2019-12-16T22:45:14.468 INFO:teuthology.orchestra.run.smithi177.stdout:12 trunc from 0xce71022 to 0xe238d14 2019-12-16T22:45:14.489 INFO:teuthology.orchestra.run.smithi177.stdout:47 write 0xd22d606 thru 0xd236684 (0x907f bytes) 2019-12-16T22:45:14.498 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.2 2019-12-16T22:45:14.498 INFO:teuthology.orchestra.run:waiting for 600 2019-12-16T22:45:14.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:45:14.499 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.2 2019-12-16T22:45:14.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2019-12-16T22:45:14.500 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2019-12-16T22:45:14.500 INFO:teuthology.orchestra.run.smithi177.stdout:14 trunc from 0xe238d14 to 0xb7c1e8c 2019-12-16T22:45:14.501 INFO:teuthology.orchestra.run.smithi177.stdout:50 punch from 0x82bf5f3 to 0x82c162f, (0x203c bytes) 2019-12-16T22:45:14.502 INFO:teuthology.orchestra.run.smithi177.stdout:51 read 0xbdcb533 thru 0xbdcce35 (0x1903 bytes) 2019-12-16T22:45:14.502 INFO:teuthology.orchestra.run.smithi177.stdout:52 read 0x742749f thru 0x74331f2 (0xbd54 bytes) 2019-12-16T22:45:14.502 INFO:teuthology.orchestra.run.smithi177.stdout:54 punch from 0x4a5adc7 to 0x4a5d9b6, (0x2bef bytes) 2019-12-16T22:45:14.502 INFO:teuthology.orchestra.run.smithi177.stdout:96 trunc from 0x20d5b15 to 0x2ba21ae 2019-12-16T22:45:14.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2019-12-16T22:45:14.504 INFO:tasks.rbd_mirror_thrash:waiting for 90 secs before thrashing 2019-12-16T22:45:14.514 INFO:teuthology.orchestra.run.smithi177.stdout:55 trunc from 0xd236685 to 0x4ec20bb 2019-12-16T22:45:14.528 INFO:teuthology.orchestra.run.smithi177.stdout:97 punch from 0xeb0303 to 0xebcc66, (0xc963 bytes) 2019-12-16T22:45:14.528 INFO:teuthology.orchestra.run.smithi177.stdout:98 punch from 0x1039399 to 0x1043c54, (0xa8bb bytes) 2019-12-16T22:45:14.528 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.532 INFO:teuthology.orchestra.run.smithi177.stdout:27 trunc from 0x780aa31 to 0xcc9148 2019-12-16T22:45:14.532 INFO:teuthology.orchestra.run.smithi177.stdout:70 writesame 0x99ccdcb thru 0x99cf7cc data_size 0x13(0x2a02 bytes) 2019-12-16T22:45:14.534 INFO:teuthology.orchestra.run.smithi177.stdout:71 punch from 0x676c497 to 0x6770bab, (0x4714 bytes) 2019-12-16T22:45:14.535 INFO:teuthology.orchestra.run.smithi177.stdout:72 read 0x1095e93 thru 0x109a3a7 (0x4515 bytes) 2019-12-16T22:45:14.535 INFO:teuthology.orchestra.run.smithi177.stdout:73 punch from 0x920813f to 0x921218f, (0xa050 bytes) 2019-12-16T22:45:14.535 INFO:teuthology.orchestra.run.smithi177.stdout:76 writesame 0x4df7c10 thru 0x4e07689 data_size 0x3(0xfa7a bytes) 2019-12-16T22:45:14.538 INFO:teuthology.orchestra.run.smithi177.stdout:56 read 0x207ad13 thru 0x2080bc7 (0x5eb5 bytes) 2019-12-16T22:45:14.539 INFO:teuthology.orchestra.run.smithi177.stdout:57 writesame 0x4e64540 thru 0x4e6e507 data_size 0x4(0x9fc8 bytes) 2019-12-16T22:45:14.539 INFO:teuthology.orchestra.run.smithi177.stdout:100 trunc from 0x2ba21ae to 0xafc75c7 2019-12-16T22:45:14.552 INFO:teuthology.orchestra.run.smithi177.stdout:60 write 0x144d780 thru 0x1454854 (0x70d5 bytes) 2019-12-16T22:45:14.560 INFO:teuthology.orchestra.run.smithi177.stdout:62 read 0x2fd176c thru 0x2fe1681 (0xff16 bytes) 2019-12-16T22:45:14.561 INFO:teuthology.orchestra.run.smithi177.stdout:63 writesame 0x35bf00 thru 0x3605dd data_size 0x2f(0x46de bytes) 2019-12-16T22:45:14.562 INFO:teuthology.orchestra.run.smithi177.stdout:101 writesame 0x549d500 thru 0x549ff7f data_size 0x28(0x2a80 bytes) 2019-12-16T22:45:14.565 INFO:teuthology.orchestra.run.smithi177.stdout:77 read 0x5204509 thru 0x52072e2 (0x2dda bytes) 2019-12-16T22:45:14.565 INFO:teuthology.orchestra.run.smithi177.stdout:78 read 0x5656cf9 thru 0x565709a (0x3a2 bytes) 2019-12-16T22:45:14.566 INFO:teuthology.orchestra.run.smithi177.stdout:80 read 0x5a4f95 thru 0x5aafc0 (0x602c bytes) 2019-12-16T22:45:14.568 INFO:teuthology.orchestra.run.smithi177.stdout:64 write 0x4a3b9c6 thru 0x4a3c315 (0x950 bytes) 2019-12-16T22:45:14.569 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.569 INFO:teuthology.orchestra.run.smithi177.stdout:82 write 0x41d1b56 thru 0x41d6627 (0x4ad2 bytes) 2019-12-16T22:45:14.570 INFO:teuthology.orchestra.run.smithi177.stdout:102 write 0x90cf4ba thru 0x90d284c (0x3393 bytes) 2019-12-16T22:45:14.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.smithi177.stderr:2019-12-16T22:45:14.570+0000 7f3aee77c200 -1 asok(0x557b69964000) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: failed to bind the UNIX domain socket to '/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok': (17) File exists 2019-12-16T22:45:14.583 INFO:teuthology.orchestra.run.smithi177.stdout:103 write 0x4edc3a3 thru 0x4ee66be (0xa31c bytes) 2019-12-16T22:45:14.587 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.588 INFO:teuthology.orchestra.run.smithi177.stdout:85 read 0x75ab0fa thru 0x75b0fca (0x5ed1 bytes) 2019-12-16T22:45:14.588 INFO:teuthology.orchestra.run.smithi177.stdout:86 read 0x330755d thru 0x330c748 (0x51ec bytes) 2019-12-16T22:45:14.588 INFO:teuthology.orchestra.run.smithi177.stdout:88 punch from 0x8c5d156 to 0x8c648f9, (0x77a3 bytes) 2019-12-16T22:45:14.589 INFO:teuthology.orchestra.run.smithi177.stdout:90 trunc from 0x99cf7cd to 0xa7992f1 2019-12-16T22:45:14.589 INFO:teuthology.orchestra.run.smithi177.stdout:15 write 0xbf6fca0 thru 0xbf728d6 (0x2c37 bytes) 2019-12-16T22:45:14.592 INFO:teuthology.orchestra.run.smithi177.stdout:109 write 0x3d3d20d thru 0x3d49e8f (0xcc83 bytes) 2019-12-16T22:45:14.604 INFO:teuthology.orchestra.run.smithi177.stdout:16 writesame 0x342d348 thru 0x3432094 data_size 0xb(0x4d4d bytes) 2019-12-16T22:45:14.605 INFO:teuthology.orchestra.run.smithi177.stdout:65 write 0xa06d021 thru 0xa074232 (0x7212 bytes) 2019-12-16T22:45:14.611 INFO:teuthology.orchestra.run.smithi177.stdout:66 read 0x38a6394 thru 0x38b4742 (0xe3af bytes) 2019-12-16T22:45:14.611 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.612 INFO:teuthology.orchestra.run.smithi177.stdout:68 write 0x8f4b753 thru 0x8f59c2f (0xe4dd bytes) 2019-12-16T22:45:14.621 INFO:teuthology.orchestra.run.smithi177.stdout:28 trunc from 0xcc9148 to 0x853fd96 2019-12-16T22:45:14.621 INFO:teuthology.orchestra.run.smithi177.stdout:69 read 0x6888be0 thru 0x6894027 (0xb448 bytes) 2019-12-16T22:45:14.627 INFO:teuthology.orchestra.run.smithi177.stdout:110 write 0xd4bada7 thru 0xd4ca828 (0xfa82 bytes) 2019-12-16T22:45:14.633 INFO:teuthology.orchestra.run.smithi177.stdout:92 writesame 0xca718d2 thru 0xca72d2f data_size 0x16(0x145e bytes) 2019-12-16T22:45:14.636 INFO:teuthology.orchestra.run.smithi177.stdout:93 read 0x14578d8 thru 0x146430d (0xca36 bytes) 2019-12-16T22:45:14.636 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.636 INFO:teuthology.orchestra.run.smithi177.stdout:97 write 0x51fa8c9 thru 0x51ffce7 (0x541f bytes) 2019-12-16T22:45:14.638 INFO:teuthology.orchestra.run.smithi177.stdout:112 writesame 0x8a3c576 thru 0x8a4b05e data_size 0xb(0xeae9 bytes) 2019-12-16T22:45:14.641 INFO:teuthology.orchestra.run.smithi177.stdout:29 trunc from 0x853fd96 to 0x9ade36f 2019-12-16T22:45:14.648 INFO:teuthology.orchestra.run.smithi177.stdout:114 write 0xa86a721 thru 0xa878861 (0xe141 bytes) 2019-12-16T22:45:14.653 INFO:teuthology.orchestra.run.smithi177.stdout:98 write 0x35f6df1 thru 0x35f85df (0x17ef bytes) 2019-12-16T22:45:14.654 INFO:teuthology.orchestra.run.smithi177.stdout:70 write 0xed2809e thru 0xed2d6ec (0x564f bytes) 2019-12-16T22:45:14.663 INFO:teuthology.orchestra.run.smithi177.stdout:115 writesame 0x528371a thru 0x5293063 data_size 0x11(0xf94a bytes) 2019-12-16T22:45:14.664 INFO:teuthology.orchestra.run.smithi177.stdout:72 writesame 0xcbff5ef thru 0xcc0de33 data_size 0x1(0xe845 bytes) 2019-12-16T22:45:14.665 INFO:teuthology.orchestra.run.smithi177.stdout:17 writesame 0xd5a9d4c thru 0xd5b4b43 data_size 0x4c(0xadf8 bytes) 2019-12-16T22:45:14.668 INFO:teuthology.orchestra.run.smithi177.stdout:30 trunc from 0x9ade36f to 0x9551e09 2019-12-16T22:45:14.669 INFO:teuthology.orchestra.run.smithi177.stdout:19 write 0x37cc3ab thru 0x37d11a5 (0x4dfb bytes) 2019-12-16T22:45:14.676 INFO:teuthology.orchestra.run.smithi177.stdout:99 read 0xa1c5001 thru 0xa1cc143 (0x7143 bytes) 2019-12-16T22:45:14.676 INFO:teuthology.orchestra.run.smithi177.stdout:100 writesame 0x9ef4822 thru 0x9f047bc data_size 0x17(0xff9b bytes) 2019-12-16T22:45:14.677 INFO:teuthology.orchestra.run.smithi177.stdout:116 trunc from 0xd4ca829 to 0xcb8f33d 2019-12-16T22:45:14.717 INFO:teuthology.orchestra.run.smithi177.stdout:101 writesame 0x410606c thru 0x4112fc4 data_size 0x1(0xcf59 bytes) 2019-12-16T22:45:14.717 INFO:teuthology.orchestra.run.smithi177.stdout:21 read 0x2968b15 thru 0x2977919 (0xee05 bytes) 2019-12-16T22:45:14.717 INFO:teuthology.orchestra.run.smithi177.stdout:22 write 0x6e89eb2 thru 0x6e8cb15 (0x2c64 bytes) 2019-12-16T22:45:14.732 INFO:teuthology.orchestra.run.smithi177.stdout:74 trunc from 0xed2d6ed to 0x3727256 2019-12-16T22:45:14.733 INFO:teuthology.orchestra.run.smithi177.stdout:36 writesame 0x1942303 thru 0x194ec8b data_size 0x1(0xc989 bytes) 2019-12-16T22:45:14.740 INFO:teuthology.orchestra.run.smithi177.stdout:102 trunc from 0xca72d30 to 0xb13e4bf 2019-12-16T22:45:14.784 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xd243af9 2019-12-16T22:45:14.784 INFO:teuthology.orchestra.run.smithi177.stdout:37 trunc from 0x9551e09 to 0xd243af9 2019-12-16T22:45:14.785 INFO:teuthology.orchestra.run.smithi177.stdout:103 writesame 0x1720466 thru 0x172a435 data_size 0x8(0x9fd0 bytes) 2019-12-16T22:45:14.790 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.790 INFO:teuthology.orchestra.run.smithi177.stdout:119 trunc from 0xcb8f33d to 0xba271a4 2019-12-16T22:45:14.791 INFO:teuthology.orchestra.run.smithi177.stdout:23 trunc from 0xd5b4b44 to 0x239806b 2019-12-16T22:45:14.814 INFO:teuthology.orchestra.run.smithi177.stdout:105 writesame 0x4ef4888 thru 0x4efd31d data_size 0x9(0x8a96 bytes) 2019-12-16T22:45:14.821 INFO:teuthology.orchestra.run.smithi177.stdout:75 write 0x8beda61 thru 0x8bf9aa6 (0xc046 bytes) 2019-12-16T22:45:14.825 INFO:teuthology.orchestra.run.smithi177.stdout:38 write 0x21cb646 thru 0x21d73c7 (0xbd82 bytes) 2019-12-16T22:45:14.825 INFO:teuthology.orchestra.run.smithi177.stdout:106 trunc from 0xb13e4bf to 0xde8c84a 2019-12-16T22:45:14.825 INFO:teuthology.orchestra.run.smithi177.stdout:120 writesame 0xce0add6 thru 0xce0b89d data_size 0x14(0xac8 bytes) 2019-12-16T22:45:14.829 INFO:teuthology.orchestra.run.smithi177.stdout:121 punch from 0x2fd312e to 0x2fe1906, (0xe7d8 bytes) 2019-12-16T22:45:14.829 INFO:teuthology.orchestra.run.smithi177.stdout:122 write 0x77bbfdc thru 0x77c1e73 (0x5e98 bytes) 2019-12-16T22:45:14.831 INFO:teuthology.orchestra.run.smithi177.stdout:40 read 0x3c09fda thru 0x3c14e51 (0xae78 bytes) 2019-12-16T22:45:14.831 INFO:teuthology.orchestra.run.smithi177.stdout:42 punch from 0xc979bed to 0xc97b998, (0x1dab bytes) 2019-12-16T22:45:14.831 INFO:teuthology.orchestra.run.smithi177.stdout:43 punch from 0x75dfdcf to 0x75e73ad, (0x75de bytes) 2019-12-16T22:45:14.832 INFO:teuthology.orchestra.run.smithi177.stdout:44 writesame 0x1e2559e thru 0x1e286fd data_size 0x10(0x3160 bytes) 2019-12-16T22:45:14.838 INFO:teuthology.orchestra.run.smithi177.stdout:45 read 0x5fc7231 thru 0x5fd1964 (0xa734 bytes) 2019-12-16T22:45:14.838 INFO:teuthology.orchestra.run.smithi177.stdout:46 punch from 0xa90abb1 to 0xa916242, (0xb691 bytes) 2019-12-16T22:45:14.838 INFO:teuthology.orchestra.run.smithi177.stdout:47 write 0x5a06b0c thru 0x5a0d81b (0x6d10 bytes) 2019-12-16T22:45:14.839 INFO:teuthology.orchestra.run.smithi177.stdout:123 writesame 0xadc14a4 thru 0xadc9249 data_size 0x9(0x7da6 bytes) 2019-12-16T22:45:14.849 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.849 INFO:teuthology.orchestra.run.smithi177.stdout:50 punch from 0x3d0d36a to 0x3d0ecaf, (0x1945 bytes) 2019-12-16T22:45:14.849 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.849 INFO:teuthology.orchestra.run.smithi177.stdout:125 writesame 0xc295776 thru 0xc29d588 data_size 0x5(0x7e13 bytes) 2019-12-16T22:45:14.850 INFO:teuthology.orchestra.run.smithi177.stdout:107 write 0x6af19d4 thru 0x6afadb4 (0x93e1 bytes) 2019-12-16T22:45:14.858 INFO:teuthology.orchestra.run.smithi177.stdout:77 writesame 0xa7e65cb thru 0xa7f5ec7 data_size 0x1(0xf8fd bytes) 2019-12-16T22:45:14.865 INFO:teuthology.orchestra.run.smithi177.stdout:126 read 0x37de29b thru 0x37eb840 (0xd5a6 bytes) 2019-12-16T22:45:14.865 INFO:teuthology.orchestra.run.smithi177.stdout:127 punch from 0x95fc1ec to 0x96024bb, (0x62cf bytes) 2019-12-16T22:45:14.874 INFO:teuthology.orchestra.run.smithi177.stdout:79 read 0x2f0682a thru 0x2f0e2b9 (0x7a90 bytes) 2019-12-16T22:45:14.874 INFO:teuthology.orchestra.run.smithi177.stdout:80 punch from 0x9a89d1c to 0x9a97995, (0xdc79 bytes) 2019-12-16T22:45:14.874 INFO:teuthology.orchestra.run.smithi177.stdout:86 read 0x77ac858 thru 0x77bb926 (0xf0cf bytes) 2019-12-16T22:45:14.874 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xcf4ed0a 2019-12-16T22:45:14.875 INFO:teuthology.orchestra.run.smithi177.stdout:128 trunc from 0xce0b89e to 0x9ad3f35 2019-12-16T22:45:14.875 INFO:teuthology.orchestra.run.smithi177.stdout:108 trunc from 0xde8c84a to 0xcded85e 2019-12-16T22:45:14.876 INFO:teuthology.orchestra.run.smithi177.stdout:87 trunc from 0xa7f5ec8 to 0xcf4ed0a 2019-12-16T22:45:14.876 INFO:teuthology.orchestra.run.smithi177.stdout:51 writesame 0xe455224 thru 0xe45b5dc data_size 0x7(0x63b9 bytes) 2019-12-16T22:45:14.878 INFO:teuthology.orchestra.run.smithi177.stdout:52 write 0x1075345 thru 0x107b248 (0x5f04 bytes) 2019-12-16T22:45:14.884 INFO:teuthology.orchestra.run.smithi177.stdout:53 writesame 0xd613eba thru 0xd6220bc data_size 0x1(0xe203 bytes) 2019-12-16T22:45:14.891 INFO:teuthology.orchestra.run.smithi177.stdout:110 write 0xb53fa5c thru 0xb5400b9 (0x65e bytes) 2019-12-16T22:45:14.893 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:14.915 INFO:teuthology.orchestra.run.smithi177.stdout:89 trunc from 0xcf4ed0a to 0x2720a5 2019-12-16T22:45:14.927 INFO:teuthology.orchestra.run.smithi177.stdout:24 writesame 0xe1bca0c thru 0xe1c0537 data_size 0xe(0x3b2c bytes) 2019-12-16T22:45:14.930 INFO:teuthology.orchestra.run.smithi177.stdout:25 punch from 0x6038a9d to 0x603bcac, (0x320f bytes) 2019-12-16T22:45:14.930 INFO:teuthology.orchestra.run.smithi177.stdout:26 read 0x38d892e thru 0x38e2107 (0x97da bytes) 2019-12-16T22:45:14.930 INFO:teuthology.orchestra.run.smithi177.stdout:27 punch from 0x6f37488 to 0x6f46830, (0xf3a8 bytes) 2019-12-16T22:45:14.930 INFO:teuthology.orchestra.run.smithi177.stdout:29 read 0xb13e5c6 thru 0xb146372 (0x7dad bytes) 2019-12-16T22:45:14.930 INFO:teuthology.orchestra.run.smithi177.stdout:30 punch from 0xa93486a to 0xa93a24b, (0x59e1 bytes) 2019-12-16T22:45:14.931 INFO:teuthology.orchestra.run.smithi177.stdout:31 punch from 0xcec09b4 to 0xcec1fae, (0x15fa bytes) 2019-12-16T22:45:14.931 INFO:teuthology.orchestra.run.smithi177.stdout:54 read 0x29c0c23 thru 0x29ced6c (0xe14a bytes) 2019-12-16T22:45:14.940 INFO:teuthology.orchestra.run.smithi177.stdout:111 writesame 0xc281da5 thru 0xc28e818 data_size 0x2a(0xca74 bytes) 2019-12-16T22:45:14.953 INFO:teuthology.orchestra.run.smithi177.stdout:129 read 0x15e4e9b thru 0x15e68d0 (0x1a36 bytes) 2019-12-16T22:45:14.953 INFO:teuthology.orchestra.run.smithi177.stdout:130 write 0x35e4501 thru 0x35e542f (0xf2f bytes) 2019-12-16T22:45:14.953 INFO:teuthology.orchestra.run.smithi177.stdout:131 read 0x887f25 thru 0x894777 (0xc853 bytes) 2019-12-16T22:45:14.953 INFO:teuthology.orchestra.run.smithi177.stdout:132 read 0x132df04 thru 0x1334d0b (0x6e08 bytes) 2019-12-16T22:45:14.954 INFO:teuthology.orchestra.run.smithi177.stdout:133 writesame 0x9134489 thru 0x913686f data_size 0xd(0x23e7 bytes) 2019-12-16T22:45:14.955 INFO:teuthology.orchestra.run.smithi177.stdout:55 trunc from 0xe45b5dd to 0x42fbd60 2019-12-16T22:45:14.958 INFO:teuthology.orchestra.run.smithi177.stdout:32 write 0xea7d845 thru 0xea8c96b (0xf127 bytes) 2019-12-16T22:45:14.964 INFO:teuthology.orchestra.run.smithi177.stdout:90 punch from 0x1c729d to 0x1cd7a1, (0x6504 bytes) 2019-12-16T22:45:14.973 INFO:teuthology.orchestra.run.smithi177.stdout:134 trunc from 0x9ad3f35 to 0x56eb8b 2019-12-16T22:45:14.990 INFO:teuthology.orchestra.run.smithi177.stdout:113 write 0xe5ecd29 thru 0xe5fad4a (0xe022 bytes) 2019-12-16T22:45:14.992 INFO:teuthology.orchestra.run.smithi177.stdout:34 writesame 0x5ed891a thru 0x5ee5502 data_size 0x1(0xcbe9 bytes) 2019-12-16T22:45:15.009 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.014 INFO:teuthology.orchestra.run.smithi177.stdout:93 writesame 0x9695561 thru 0x96a2039 data_size 0x1(0xcad9 bytes) 2019-12-16T22:45:15.021 INFO:teuthology.orchestra.run.smithi177.stdout:114 write 0xe164e20 thru 0xe166e1d (0x1ffe bytes) 2019-12-16T22:45:15.023 INFO:teuthology.orchestra.run.smithi177.stdout:94 read 0x386a113 thru 0x386fb37 (0x5a25 bytes) 2019-12-16T22:45:15.027 INFO:teuthology.orchestra.run.smithi177.stdout:96 trunc from 0x96a203a to 0x76c898c 2019-12-16T22:45:15.030 INFO:teuthology.orchestra.run.smithi177.stdout:137 read 0x32d68f thru 0x32e7dc (0x114e bytes) 2019-12-16T22:45:15.031 INFO:teuthology.orchestra.run.smithi177.stdout:138 punch from 0x26669b to 0x26a18c, (0x3af1 bytes) 2019-12-16T22:45:15.031 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.031 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.031 INFO:teuthology.orchestra.run.smithi177.stdout:143 read 0x3c1515 thru 0x3c93b3 (0x7e9f bytes) 2019-12-16T22:45:15.039 INFO:teuthology.orchestra.run.smithi177.stdout:35 writesame 0xacae078 thru 0xacb1cca data_size 0x1(0x3c53 bytes) 2019-12-16T22:45:15.046 INFO:teuthology.orchestra.run.smithi177.stdout:116 punch from 0xc0517c8 to 0xc05f292, (0xdaca bytes) 2019-12-16T22:45:15.046 INFO:teuthology.orchestra.run.smithi177.stdout:117 writesame 0x65768e8 thru 0x657c152 data_size 0xf(0x586b bytes) 2019-12-16T22:45:15.055 INFO:teuthology.orchestra.run.smithi177.stdout:58 write 0x957d8ad thru 0x9589135 (0xb889 bytes) 2019-12-16T22:45:15.061 INFO:teuthology.orchestra.run.smithi177.stdout:98 read 0x75846b7 thru 0x7586c50 (0x259a bytes) 2019-12-16T22:45:15.061 INFO:teuthology.orchestra.run.smithi177.stdout:99 write 0xef72b1 thru 0xef72d2 (0x22 bytes) 2019-12-16T22:45:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:118 writesame 0xbc83196 thru 0xbc91bfb data_size 0x6(0xea66 bytes) 2019-12-16T22:45:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:59 punch from 0x539deaf to 0x53aa596, (0xc6e7 bytes) 2019-12-16T22:45:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:62 read 0x3be3651 thru 0x3beaffd (0x79ad bytes) 2019-12-16T22:45:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xd9abc1e 2019-12-16T22:45:15.074 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.074 INFO:teuthology.orchestra.run.smithi177.stdout:102 write 0x56043d4 thru 0x560ee5c (0xaa89 bytes) 2019-12-16T22:45:15.076 INFO:teuthology.orchestra.run.smithi177.stdout:63 trunc from 0x9589136 to 0xd9abc1e 2019-12-16T22:45:15.085 INFO:teuthology.orchestra.run.smithi177.stdout:119 clone 2 order 20 su 32768 sc 8 2019-12-16T22:45:15.086 INFO:teuthology.orchestra.run.smithi177.stdout:144 writesame 0xe8eae72 thru 0xe8f8bba data_size 0x17(0xdd49 bytes) 2019-12-16T22:45:15.086 INFO:teuthology.orchestra.run.smithi177.stdout:36 write 0xeb1110f thru 0xeb13f23 (0x2e15 bytes) 2019-12-16T22:45:15.086 INFO:teuthology.orchestra.run.smithi177.stdout:103 read 0x605469c thru 0x6054e12 (0x777 bytes) 2019-12-16T22:45:15.087 INFO:teuthology.orchestra.run.smithi177.stdout:104 read 0x3d86076 thru 0x3d8bd00 (0x5c8b bytes) 2019-12-16T22:45:15.087 INFO:teuthology.orchestra.run.smithi177.stdout:105 read 0x602f941 thru 0x6039c02 (0xa2c2 bytes) 2019-12-16T22:45:15.087 INFO:teuthology.orchestra.run.smithi177.stdout:145 writesame 0xe47d731 thru 0xe48947c data_size 0xa(0xbd4c bytes) 2019-12-16T22:45:15.091 INFO:teuthology.orchestra.run.smithi177.stdout:37 clone 2 order 19 su 16384 sc 5 2019-12-16T22:45:15.096 INFO:teuthology.orchestra.run.smithi177.stdout:146 read 0xa5e8449 thru 0xa5f2606 (0xa1be bytes) 2019-12-16T22:45:15.096 INFO:teuthology.orchestra.run.smithi177.stdout:149 write 0x298fd30 thru 0x299ef2a (0xf1fb bytes) 2019-12-16T22:45:15.104 INFO:teuthology.orchestra.run.smithi177.stdout:65 read 0x379ea06 thru 0x37a3379 (0x4974 bytes) 2019-12-16T22:45:15.104 INFO:teuthology.orchestra.run.smithi177.stdout:66 write 0xbe82cae thru 0xbe9032b (0xd67e bytes) 2019-12-16T22:45:15.104 INFO:teuthology.orchestra.run.smithi177.stdout:150 write 0x515a50b thru 0x5162b10 (0x8606 bytes) 2019-12-16T22:45:15.112 INFO:teuthology.orchestra.run.smithi177.stdout:151 punch from 0x394e98a to 0x39595c9, (0xac3f bytes) 2019-12-16T22:45:15.112 INFO:teuthology.orchestra.run.smithi177.stdout:152 writesame 0x8622bbc thru 0x862f60b data_size 0x68(0xca50 bytes) 2019-12-16T22:45:15.113 INFO:teuthology.orchestra.run.smithi177.stdout:69 writesame 0x430bd8b thru 0x431b30c data_size 0x4b(0xf582 bytes) 2019-12-16T22:45:15.117 INFO:teuthology.orchestra.run.smithi177.stdout:154 write 0x61ea0f9 thru 0x61ef42b (0x5333 bytes) 2019-12-16T22:45:15.119 INFO:teuthology.orchestra.run.smithi177.stdout:72 write 0x6ef7d77 thru 0x6eff6b9 (0x7943 bytes) 2019-12-16T22:45:15.120 INFO:teuthology.orchestra.run.smithi177.stdout:106 write 0xd74ddbc thru 0xd759b5b (0xbda0 bytes) 2019-12-16T22:45:15.126 INFO:teuthology.orchestra.run.smithi177.stdout:73 read 0x6a45850 thru 0x6a541a1 (0xe952 bytes) 2019-12-16T22:45:15.126 INFO:teuthology.orchestra.run.smithi177.stdout:75 punch from 0x62e3844 to 0x62f2624, (0xede0 bytes) 2019-12-16T22:45:15.126 INFO:teuthology.orchestra.run.smithi177.stdout:76 clone 2 order 22 su 32768 sc 12 2019-12-16T22:45:15.127 INFO:teuthology.orchestra.run.smithi177.stdout:108 writesame 0x6eb38a5 thru 0x6ebd65a data_size 0x9(0x9db6 bytes) 2019-12-16T22:45:15.130 INFO:teuthology.orchestra.run.smithi177.stdout:155 read 0x5ad980c thru 0x5adc47c (0x2c71 bytes) 2019-12-16T22:45:15.130 INFO:teuthology.orchestra.run.smithi177.stdout:156 writesame 0xd240f86 thru 0xd24ab94 data_size 0x45(0x9c0f bytes) 2019-12-16T22:45:15.134 INFO:teuthology.orchestra.run.smithi177.stdout:109 read 0x5dd9c54 thru 0x5de4920 (0xaccd bytes) 2019-12-16T22:45:15.134 INFO:teuthology.orchestra.run.smithi177.stdout:110 read 0xaa131ed thru 0xaa1b48b (0x829f bytes) 2019-12-16T22:45:15.134 INFO:teuthology.orchestra.run.smithi177.stdout:111 punch from 0x2932f01 to 0x293af8c, (0x808b bytes) 2019-12-16T22:45:15.134 INFO:teuthology.orchestra.run.smithi177.stdout:113 write 0x25bcbfe thru 0x25be181 (0x1584 bytes) 2019-12-16T22:45:15.138 INFO:teuthology.orchestra.run.smithi177.stdout:157 writesame 0xa648cd0 thru 0xa6533ae data_size 0x1(0xa6df bytes) 2019-12-16T22:45:15.170 INFO:teuthology.orchestra.run.smithi177.stdout:158 write 0x36b928b thru 0x36c5707 (0xc47d bytes) 2019-12-16T22:45:15.171 INFO:teuthology.orchestra.run.smithi177.stdout:116 writesame 0xd819b82 thru 0xd826e98 data_size 0x3(0xd317 bytes) 2019-12-16T22:45:15.197 INFO:teuthology.orchestra.run.smithi177.stdout:117 read 0xce52851 thru 0xce602c5 (0xda75 bytes) 2019-12-16T22:45:15.198 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.198 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.198 INFO:teuthology.orchestra.run.smithi177.stdout:161 punch from 0xbc8f8fe to 0xbc905ce, (0xcd0 bytes) 2019-12-16T22:45:15.198 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.198 INFO:teuthology.orchestra.run.smithi177.stdout:118 trunc from 0xd826e99 to 0x2da84f4 2019-12-16T22:45:15.201 INFO:teuthology.orchestra.run.smithi177.stdout:163 trunc from 0xe8f8bbb to 0x2716ac8 2019-12-16T22:45:15.224 INFO:teuthology.orchestra.run.smithi177.stdout:164 read 0x1c18da9 thru 0x1c1a7dc (0x1a34 bytes) 2019-12-16T22:45:15.224 INFO:teuthology.orchestra.run.smithi177.stdout:165 read 0x1d93a8d thru 0x1d9a01b (0x658f bytes) 2019-12-16T22:45:15.224 INFO:teuthology.orchestra.run.smithi177.stdout:166 punch from 0x8308fd to 0x83fe8e, (0xf591 bytes) 2019-12-16T22:45:15.225 INFO:teuthology.orchestra.run.smithi177.stdout:167 read 0x135e945 thru 0x136d099 (0xe755 bytes) 2019-12-16T22:45:15.225 INFO:teuthology.orchestra.run.smithi177.stdout:168 read 0x1c96b54 thru 0x1ca118a (0xa637 bytes) 2019-12-16T22:45:15.225 INFO:teuthology.orchestra.run.smithi177.stdout:169 punch from 0x224d8bc to 0x2256939, (0x907d bytes) 2019-12-16T22:45:15.239 INFO:teuthology.orchestra.run.smithi177.stdout:119 writesame 0x3eb9d88 thru 0x3ebba41 data_size 0x1(0x1cba bytes) 2019-12-16T22:45:15.239 INFO:teuthology.orchestra.run.smithi177.stdout:170 write 0x2bd74d7 thru 0x2bd7bbe (0x6e8 bytes) 2019-12-16T22:45:15.243 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.248 INFO:teuthology.orchestra.run.smithi177.stdout:120 trunc from 0x3ebba42 to 0x6683637 2019-12-16T22:45:15.255 INFO:teuthology.orchestra.run.smithi177.stdout:189 trunc from 0xb7c06be to 0xb00d6b6 2019-12-16T22:45:15.268 INFO:teuthology.orchestra.run.smithi177.stdout:121 trunc from 0x6683637 to 0x4b5e6c7 2019-12-16T22:45:15.280 INFO:teuthology.orchestra.run.smithi177.stdout:176 write 0xc715419 thru 0xc7165ef (0x11d7 bytes) 2019-12-16T22:45:15.289 INFO:teuthology.orchestra.run.smithi177.stdout:128 trunc from 0x4b5e6c7 to 0x3703b48 2019-12-16T22:45:15.289 INFO:teuthology.orchestra.run.smithi177.stdout:177 writesame 0xaca6a5b thru 0xacacb8b data_size 0x1(0x6131 bytes) 2019-12-16T22:45:15.314 INFO:teuthology.orchestra.run.smithi177.stdout:190 read 0x2a23a22 thru 0x2a2f186 (0xb765 bytes) 2019-12-16T22:45:15.315 INFO:teuthology.orchestra.run.smithi177.stdout:191 write 0x328ddc4 thru 0x329c934 (0xeb71 bytes) 2019-12-16T22:45:15.315 INFO:teuthology.orchestra.run.smithi177.stdout:178 trunc from 0xc7165f0 to 0xb031101 2019-12-16T22:45:15.331 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.332 INFO:teuthology.orchestra.run.smithi177.stdout:195 writesame 0x562ffc0 thru 0x563febb data_size 0x2(0xfefc bytes) 2019-12-16T22:45:15.339 INFO:teuthology.orchestra.run.smithi177.stdout:129 writesame 0x4be7716 thru 0x4bed211 data_size 0x12(0x5afc bytes) 2019-12-16T22:45:15.342 INFO:teuthology.orchestra.run.smithi177.stdout:131 read 0x49080bf thru 0x490c070 (0x3fb2 bytes) 2019-12-16T22:45:15.343 INFO:teuthology.orchestra.run.smithi177.stdout:132 read 0x2f7afe2 thru 0x2f7f31d (0x433c bytes) 2019-12-16T22:45:15.350 INFO:teuthology.orchestra.run.smithi177.stdout:133 read 0x21f4d34 thru 0x2201d33 (0xd000 bytes) 2019-12-16T22:45:15.351 INFO:teuthology.orchestra.run.smithi177.stdout:179 writesame 0x5f543fe thru 0x5f5cb1f data_size 0x31(0x8722 bytes) 2019-12-16T22:45:15.351 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.351 INFO:teuthology.orchestra.run.smithi177.stdout:135 read 0x1fbb453 thru 0x1fbf9de (0x458c bytes) 2019-12-16T22:45:15.354 INFO:teuthology.orchestra.run.smithi177.stdout:196 punch from 0x1c9dcb5 to 0x1ca5e7a, (0x81c5 bytes) 2019-12-16T22:45:15.356 INFO:teuthology.orchestra.run.smithi177.stdout:201 trunc from 0xb00d6b6 to 0xbc49372 2019-12-16T22:45:15.356 INFO:teuthology.orchestra.run.smithi177.stdout:139 trunc from 0x4bed212 to 0x2bb98df 2019-12-16T22:45:15.374 INFO:teuthology.orchestra.run.smithi177.stdout:202 read 0x72de9f9 thru 0x72e7794 (0x8d9c bytes) 2019-12-16T22:45:15.375 INFO:teuthology.orchestra.run.smithi177.stdout:203 write 0x3906eb thru 0x394db9 (0x46cf bytes) 2019-12-16T22:45:15.375 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.382 INFO:teuthology.orchestra.run.smithi177.stdout:180 writesame 0xe42d0b5 thru 0xe439f95 data_size 0x1(0xcee1 bytes) 2019-12-16T22:45:15.383 INFO:teuthology.orchestra.run.smithi177.stdout:204 punch from 0x81ce91f to 0x81d4e54, (0x6535 bytes) 2019-12-16T22:45:15.384 INFO:teuthology.orchestra.run.smithi177.stdout:181 punch from 0xb0276a9 to 0xb02cb1c, (0x5473 bytes) 2019-12-16T22:45:15.388 INFO:teuthology.orchestra.run.smithi177.stdout:182 trunc from 0xe439f96 to 0xc952bad 2019-12-16T22:45:15.401 INFO:teuthology.orchestra.run.smithi177.stdout:141 write 0x813aa5b thru 0x81493d6 (0xe97c bytes) 2019-12-16T22:45:15.407 INFO:teuthology.orchestra.run.smithi177.stdout:183 punch from 0xaf56b35 to 0xaf57274, (0x73f bytes) 2019-12-16T22:45:15.408 INFO:teuthology.orchestra.run.smithi177.stdout:205 writesame 0xe589b65 thru 0xe59293e data_size 0x2(0x8dda bytes) 2019-12-16T22:45:15.410 INFO:teuthology.orchestra.run.smithi177.stdout:144 read 0x3cafb43 thru 0x3cb0912 (0xdd0 bytes) 2019-12-16T22:45:15.410 INFO:teuthology.orchestra.run.smithi177.stdout:145 read 0x4cfefd3 thru 0x4cff011 (0x3f bytes) 2019-12-16T22:45:15.410 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.410 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.410 INFO:teuthology.orchestra.run.smithi177.stdout:209 read 0xbea3a7f thru 0xbeab0d4 (0x7656 bytes) 2019-12-16T22:45:15.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.412 INFO:teuthology.orchestra.run.smithi177.stdout:221 write 0x1908d5b thru 0x190a9fd (0x1ca3 bytes) 2019-12-16T22:45:15.418 INFO:teuthology.orchestra.run.smithi177.stdout:223 writesame 0xa5d3f5d thru 0xa5df554 data_size 0x24(0xb5f8 bytes) 2019-12-16T22:45:15.424 INFO:teuthology.orchestra.run.smithi177.stdout:185 writesame 0xd6f277e thru 0xd7007ea data_size 0xb(0xe06d bytes) 2019-12-16T22:45:15.426 INFO:teuthology.orchestra.run.smithi177.stdout:148 trunc from 0x81493d7 to 0x104ac9e 2019-12-16T22:45:15.445 INFO:teuthology.orchestra.run.smithi177.stdout:187 writesame 0xdcfff12 thru 0xdd04114 data_size 0x2b(0x4203 bytes) 2019-12-16T22:45:15.446 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.447 INFO:teuthology.orchestra.run.smithi177.stdout:190 write 0x14655d5 thru 0x1470b46 (0xb572 bytes) 2019-12-16T22:45:15.449 INFO:teuthology.orchestra.run.smithi177.stdout:149 punch from 0x656da5 to 0x6608a4, (0x9aff bytes) 2019-12-16T22:45:15.455 INFO:teuthology.orchestra.run.smithi177.stdout:225 trunc from 0xe59293f to 0x1a6a505 2019-12-16T22:45:15.475 INFO:teuthology.orchestra.run.smithi177.stdout:191 writesame 0xeba83e1 thru 0xebb5d91 data_size 0x1(0xd9b1 bytes) 2019-12-16T22:45:15.477 INFO:teuthology.orchestra.run.smithi177.stdout:192 write 0x68c4253 thru 0x68cafde (0x6d8c bytes) 2019-12-16T22:45:15.486 INFO:teuthology.orchestra.run.smithi177.stdout:194 punch from 0xa13f262 to 0xa141e7d, (0x2c1b bytes) 2019-12-16T22:45:15.486 INFO:teuthology.orchestra.run.smithi177.stdout:196 read 0xbe4020e thru 0xbe4da72 (0xd865 bytes) 2019-12-16T22:45:15.486 INFO:teuthology.orchestra.run.smithi177.stdout:197 read 0xd1d2fb5 thru 0xd1e1f6f (0xefbb bytes) 2019-12-16T22:45:15.487 INFO:teuthology.orchestra.run.smithi177.stdout:198 write 0x23ea2fa thru 0x23f6466 (0xc16d bytes) 2019-12-16T22:45:15.489 INFO:teuthology.orchestra.run.smithi177.stdout:151 write 0xba4eb9a thru 0xba5d792 (0xebf9 bytes) 2019-12-16T22:45:15.497 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.497 INFO:teuthology.orchestra.run.smithi177.stdout:200 write 0x89d6d9 thru 0x8a59da (0x8302 bytes) 2019-12-16T22:45:15.504 INFO:teuthology.orchestra.run.smithi177.stdout:152 read 0x1a9f73b thru 0x1a9fe96 (0x75c bytes) 2019-12-16T22:45:15.504 INFO:teuthology.orchestra.run.smithi177.stdout:153 write 0x2d1030d thru 0x2d19719 (0x940d bytes) 2019-12-16T22:45:15.507 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.507 INFO:teuthology.orchestra.run.smithi177.stdout:202 write 0x37a8257 thru 0x37b4802 (0xc5ac bytes) 2019-12-16T22:45:15.512 INFO:teuthology.orchestra.run.smithi177.stdout:154 punch from 0x661090 to 0x66a9c6, (0x9936 bytes) 2019-12-16T22:45:15.513 INFO:teuthology.orchestra.run.smithi177.stdout:155 write 0x9f5306d thru 0x9f5f1f4 (0xc188 bytes) 2019-12-16T22:45:15.516 INFO:teuthology.orchestra.run.smithi177.stdout:203 writesame 0xab07941 thru 0xab11686 data_size 0x29(0x9d46 bytes) 2019-12-16T22:45:15.521 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.521 INFO:teuthology.orchestra.run.smithi177.stdout:157 writesame 0xa077948 thru 0xa078ee7 data_size 0x10(0x15a0 bytes) 2019-12-16T22:45:15.523 INFO:teuthology.orchestra.run.smithi177.stdout:204 read 0x897c673 thru 0x8980116 (0x3aa4 bytes) 2019-12-16T22:45:15.524 INFO:teuthology.orchestra.run.smithi177.stdout:205 writesame 0xc00363e thru 0xc006028 data_size 0x31(0x29eb bytes) 2019-12-16T22:45:15.528 INFO:teuthology.orchestra.run.smithi177.stdout:206 write 0x968b127 thru 0x968d683 (0x255d bytes) 2019-12-16T22:45:15.532 INFO:teuthology.orchestra.run.smithi177.stdout:226 write 0x4cd9c1b thru 0x4ce07d3 (0x6bb9 bytes) 2019-12-16T22:45:15.534 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.534 INFO:teuthology.orchestra.run.smithi177.stdout:208 punch from 0x30ed646 to 0x30ee368, (0xd22 bytes) 2019-12-16T22:45:15.535 INFO:teuthology.orchestra.run.smithi177.stdout:209 read 0xc04cb4a thru 0xc05b4f0 (0xe9a7 bytes) 2019-12-16T22:45:15.535 INFO:teuthology.orchestra.run.smithi177.stdout:210 read 0x8843c68 thru 0x8844e60 (0x11f9 bytes) 2019-12-16T22:45:15.535 INFO:teuthology.orchestra.run.smithi177.stdout:211 write 0xbf5ce99 thru 0xbf6ccbc (0xfe24 bytes) 2019-12-16T22:45:15.544 INFO:teuthology.orchestra.run.smithi177.stdout:227 read 0x746bd4 thru 0x74a9ef (0x3e1c bytes) 2019-12-16T22:45:15.545 INFO:teuthology.orchestra.run.smithi177.stdout:212 write 0x9d98f40 thru 0x9da4d7b (0xbe3c bytes) 2019-12-16T22:45:15.545 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.545 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.545 INFO:teuthology.orchestra.run.smithi177.stdout:231 punch from 0x3b6719d to 0x3b76fe4, (0xfe47 bytes) 2019-12-16T22:45:15.546 INFO:teuthology.orchestra.run.smithi177.stdout:232 read 0x356b4e8 thru 0x35758cf (0xa3e8 bytes) 2019-12-16T22:45:15.546 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.551 INFO:teuthology.orchestra.run.smithi177.stdout:213 trunc from 0xebb5d92 to 0xeb72d78 2019-12-16T22:45:15.553 INFO:teuthology.orchestra.run.smithi177.stdout:159 write 0xd89b5da thru 0xd89bb63 (0x58a bytes) 2019-12-16T22:45:15.555 INFO:teuthology.orchestra.run.smithi177.stdout:235 trunc from 0x4ce07d4 to 0x98923fa 2019-12-16T22:45:15.556 INFO:teuthology.orchestra.run.smithi177.stdout:160 punch from 0x5f4021c to 0x5f4a62b, (0xa40f bytes) 2019-12-16T22:45:15.568 INFO:teuthology.orchestra.run.smithi177.stdout:161 trunc from 0xd89bb64 to 0x68dfcad 2019-12-16T22:45:15.571 INFO:teuthology.orchestra.run.smithi177.stdout:214 punch from 0x5a759d9 to 0x5a7eb57, (0x917e bytes) 2019-12-16T22:45:15.571 INFO:teuthology.orchestra.run.smithi177.stdout:215 writesame 0xc904cae thru 0xc9090de data_size 0x3(0x4431 bytes) 2019-12-16T22:45:15.573 INFO:teuthology.orchestra.run.smithi177.stdout:238 write 0x52538d3 thru 0x52587eb (0x4f19 bytes) 2019-12-16T22:45:15.582 INFO:teuthology.orchestra.run.smithi177.stdout:216 read 0x30ae05b thru 0x30b8cd3 (0xac79 bytes) 2019-12-16T22:45:15.582 INFO:teuthology.orchestra.run.smithi177.stdout:217 write 0x452630 thru 0x45fae7 (0xd4b8 bytes) 2019-12-16T22:45:15.587 INFO:teuthology.orchestra.run.smithi177.stdout:241 punch from 0x2a688fa to 0x2a741e2, (0xb8e8 bytes) 2019-12-16T22:45:15.590 INFO:teuthology.orchestra.run.smithi177.stdout:218 writesame 0x9751609 thru 0x9756ac2 data_size 0x12(0x54ba bytes) 2019-12-16T22:45:15.595 INFO:teuthology.orchestra.run.smithi177.stdout:219 write 0xc385db2 thru 0xc394621 (0xe870 bytes) 2019-12-16T22:45:15.601 INFO:teuthology.orchestra.run.smithi177.stdout:162 read 0x50377da thru 0x503e28b (0x6ab2 bytes) 2019-12-16T22:45:15.601 INFO:teuthology.orchestra.run.smithi177.stdout:163 punch from 0x3f151a5 to 0x3f18d06, (0x3b61 bytes) 2019-12-16T22:45:15.601 INFO:teuthology.orchestra.run.smithi177.stdout:164 read 0x5df9d45 thru 0x5dfc2f0 (0x25ac bytes) 2019-12-16T22:45:15.605 INFO:teuthology.orchestra.run.smithi177.stdout:220 punch from 0xd1d16b7 to 0xd1ddd7c, (0xc6c5 bytes) 2019-12-16T22:45:15.605 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.605 INFO:teuthology.orchestra.run.smithi177.stdout:223 write 0x3b3f0db thru 0x3b47ff3 (0x8f19 bytes) 2019-12-16T22:45:15.612 INFO:teuthology.orchestra.run.smithi177.stdout:242 writesame 0xa457033 thru 0xa45cf77 data_size 0x1(0x5f45 bytes) 2019-12-16T22:45:15.612 INFO:teuthology.orchestra.run.smithi177.stdout:225 read 0xdd72 thru 0x1a39d (0xc62c bytes) 2019-12-16T22:45:15.613 INFO:teuthology.orchestra.run.smithi177.stdout:227 write 0x859f023 thru 0x859f08d (0x6b bytes) 2019-12-16T22:45:15.618 INFO:teuthology.orchestra.run.smithi177.stdout:228 read 0x5b429ea thru 0x5b4fc4d (0xd264 bytes) 2019-12-16T22:45:15.618 INFO:teuthology.orchestra.run.smithi177.stdout:229 read 0xcdb6134 thru 0xcdba087 (0x3f54 bytes) 2019-12-16T22:45:15.620 INFO:teuthology.orchestra.run.smithi177.stdout:165 write 0x8b9ea50 thru 0x8ba136c (0x291d bytes) 2019-12-16T22:45:15.626 INFO:teuthology.orchestra.run.smithi177.stdout:167 write 0x1ce32bc thru 0x1ce54a7 (0x21ec bytes) 2019-12-16T22:45:15.630 INFO:teuthology.orchestra.run.smithi177.stdout:243 writesame 0xaf154a1 thru 0xaf16136 data_size 0x9(0xc96 bytes) 2019-12-16T22:45:15.632 INFO:teuthology.orchestra.run.smithi177.stdout:244 read 0x89ee022 thru 0x89ee58f (0x56e bytes) 2019-12-16T22:45:15.633 INFO:teuthology.orchestra.run.smithi177.stdout:246 read 0x7fb29b0 thru 0x7fba2ec (0x793d bytes) 2019-12-16T22:45:15.633 INFO:teuthology.orchestra.run.smithi177.stdout:247 writesame 0x2a4ac7b thru 0x2a52cfd data_size 0x1(0x8083 bytes) 2019-12-16T22:45:15.633 INFO:teuthology.orchestra.run.smithi177.stdout:168 trunc from 0x8ba136d to 0x912583f 2019-12-16T22:45:15.633 INFO:teuthology.orchestra.run.smithi177.stdout:230 trunc from 0xeb72d78 to 0x74edd6c 2019-12-16T22:45:15.654 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.654 INFO:teuthology.orchestra.run.smithi177.stdout:249 writesame 0x121eb46 thru 0x1224084 data_size 0x1(0x553f bytes) 2019-12-16T22:45:15.662 INFO:teuthology.orchestra.run.smithi177.stdout:169 punch from 0x5a1ea8d to 0x5a2066e, (0x1be1 bytes) 2019-12-16T22:45:15.674 INFO:teuthology.orchestra.run.smithi177.stdout:232 read 0x1301054 thru 0x13035de (0x258b bytes) 2019-12-16T22:45:15.674 INFO:teuthology.orchestra.run.smithi177.stdout:234 punch from 0x7b838 to 0x89916, (0xe0de bytes) 2019-12-16T22:45:15.674 INFO:teuthology.orchestra.run.smithi177.stdout:235 clone 1 order 25 su 16777216 sc 15 2019-12-16T22:45:15.675 INFO:teuthology.orchestra.run.smithi177.stdout:250 read 0x3c1e341 thru 0x3c1fcb0 (0x1970 bytes) 2019-12-16T22:45:15.682 INFO:teuthology.orchestra.run.smithi177.stdout:170 writesame 0xb33a440 thru 0xb340c52 data_size 0x53(0x6813 bytes) 2019-12-16T22:45:15.682 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.691 INFO:teuthology.orchestra.run.smithi177.stdout:252 trunc from 0xaf16137 to 0x3042b12 2019-12-16T22:45:15.691 INFO:teuthology.orchestra.run.smithi177.stdout:172 trunc from 0xb340c53 to 0x71f32bc 2019-12-16T22:45:15.714 INFO:teuthology.orchestra.run.smithi177.stdout:173 read 0x1a17348 thru 0x1a26666 (0xf31f bytes) 2019-12-16T22:45:15.714 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.715 INFO:teuthology.orchestra.run.smithi177.stdout:176 write 0x4da4a2 thru 0x4e363c (0x919b bytes) 2019-12-16T22:45:15.715 INFO:teuthology.orchestra.run.smithi177.stdout:255 read 0x12f4e6a thru 0x13004b0 (0xb647 bytes) 2019-12-16T22:45:15.716 INFO:teuthology.orchestra.run.smithi177.stdout:256 read 0x20f7a2f thru 0x2103dfb (0xc3cd bytes) 2019-12-16T22:45:15.726 INFO:teuthology.orchestra.run.smithi177.stdout:178 trunc from 0x71f32bc to 0x8d77b30 2019-12-16T22:45:15.743 INFO:teuthology.orchestra.run.smithi177.stdout:257 write 0x742e840 thru 0x743a695 (0xbe56 bytes) 2019-12-16T22:45:15.744 INFO:teuthology.orchestra.run.smithi177.stdout:179 punch from 0x1b23aaa to 0x1b254f4, (0x1a4a bytes) 2019-12-16T22:45:15.745 INFO:teuthology.orchestra.run.smithi177.stdout:184 read 0x6b4cba4 thru 0x6b595db (0xca38 bytes) 2019-12-16T22:45:15.745 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.746 INFO:teuthology.orchestra.run.smithi177.stdout:187 read 0x688e5a3 thru 0x6899351 (0xadaf bytes) 2019-12-16T22:45:15.754 INFO:teuthology.orchestra.run.smithi177.stdout:259 read 0x4a581e2 thru 0x4a63d72 (0xbb91 bytes) 2019-12-16T22:45:15.754 INFO:teuthology.orchestra.run.smithi177.stdout:260 read 0x396eb33 thru 0x3971ce3 (0x31b1 bytes) 2019-12-16T22:45:15.755 INFO:teuthology.orchestra.run.smithi177.stdout:263 write 0x4fc7bd thru 0x508a56 (0xc29a bytes) 2019-12-16T22:45:15.769 INFO:teuthology.orchestra.run.smithi177.stdout:265 trunc from 0x743a696 to 0x6fc575c 2019-12-16T22:45:15.774 INFO:teuthology.orchestra.run.smithi177.stdout:188 writesame 0xdf5df16 thru 0xdf6c112 data_size 0x1(0xe1fd bytes) 2019-12-16T22:45:15.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.776 INFO:teuthology.orchestra.run.smithi177.stdout:193 read 0xbe662c2 thru 0xbe7166f (0xb3ae bytes) 2019-12-16T22:45:15.777 INFO:teuthology.orchestra.run.smithi177.stdout:194 punch from 0xc822da3 to 0xc82e810, (0xba6d bytes) 2019-12-16T22:45:15.777 INFO:teuthology.orchestra.run.smithi177.stdout:195 writesame 0xbcc2d95 thru 0xbcd0937 data_size 0x1(0xdba3 bytes) 2019-12-16T22:45:15.821 INFO:teuthology.orchestra.run.smithi177.stdout:196 write 0x1b694d5 thru 0x1b6b43e (0x1f6a bytes) 2019-12-16T22:45:15.824 INFO:teuthology.orchestra.run.smithi177.stdout:197 punch from 0xb480098 to 0xb4804a1, (0x409 bytes) 2019-12-16T22:45:15.825 INFO:teuthology.orchestra.run.smithi177.stdout:198 write 0x60e159c thru 0x60e7fbb (0x6a20 bytes) 2019-12-16T22:45:15.828 INFO:teuthology.orchestra.run.smithi177.stdout:199 write 0x20c67ce thru 0x20caf5c (0x478f bytes) 2019-12-16T22:45:15.831 INFO:teuthology.orchestra.run.smithi177.stdout:268 writesame 0x8073856 thru 0x807aad5 data_size 0x20(0x7280 bytes) 2019-12-16T22:45:15.834 INFO:teuthology.orchestra.run.smithi177.stdout:269 read 0x5eba00b thru 0x5ebf8a8 (0x589e bytes) 2019-12-16T22:45:15.834 INFO:teuthology.orchestra.run.smithi177.stdout:270 punch from 0x48d200e to 0x48de31c, (0xc30e bytes) 2019-12-16T22:45:15.834 INFO:teuthology.orchestra.run.smithi177.stdout:271 punch from 0x36ff879 to 0x37005b0, (0xd37 bytes) 2019-12-16T22:45:15.844 INFO:teuthology.orchestra.run.smithi177.stdout:200 trunc from 0xdf6c113 to 0x95e43de 2019-12-16T22:45:15.853 INFO:teuthology.orchestra.run.smithi177.stdout:273 write 0x8b85b02 thru 0x8b8ffcd (0xa4cc bytes) 2019-12-16T22:45:15.868 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xeb7fc98 2019-12-16T22:45:15.874 INFO:teuthology.orchestra.run.smithi177.stdout:274 trunc from 0x8b8ffce to 0xd6a1f0c 2019-12-16T22:45:15.884 INFO:teuthology.orchestra.run.smithi177.stdout:201 trunc from 0x95e43de to 0xeb7fc98 2019-12-16T22:45:15.899 INFO:teuthology.orchestra.run.smithi177.stdout:276 write 0x8ef5c1d thru 0x8f00595 (0xa979 bytes) 2019-12-16T22:45:15.899 INFO:teuthology.orchestra.run.smithi177.stdout:203 read 0x7f1628b thru 0x7f1c60b (0x6381 bytes) 2019-12-16T22:45:15.899 INFO:teuthology.orchestra.run.smithi177.stdout:204 read 0xe2846f0 thru 0xe28c015 (0x7926 bytes) 2019-12-16T22:45:15.900 INFO:teuthology.orchestra.run.smithi177.stdout:205 read 0xd273756 thru 0xd277690 (0x3f3b bytes) 2019-12-16T22:45:15.900 INFO:teuthology.orchestra.run.smithi177.stdout:207 read 0x9b8d30d thru 0x9b9d297 (0xff8b bytes) 2019-12-16T22:45:15.900 INFO:teuthology.orchestra.run.smithi177.stdout:208 punch from 0x768767a to 0x7691f78, (0xa8fe bytes) 2019-12-16T22:45:15.900 INFO:teuthology.orchestra.run.smithi177.stdout:209 punch from 0x9b65dc6 to 0x9b6c888, (0x6ac2 bytes) 2019-12-16T22:45:15.900 INFO:teuthology.orchestra.run.smithi177.stdout:210 punch from 0x8169044 to 0x8172d8b, (0x9d47 bytes) 2019-12-16T22:45:15.900 INFO:teuthology.orchestra.run.smithi177.stdout:211 read 0x7185b66 thru 0x71938d1 (0xdd6c bytes) 2019-12-16T22:45:15.901 INFO:teuthology.orchestra.run.smithi177.stdout:277 write 0x4a0a910 thru 0x4a13774 (0x8e65 bytes) 2019-12-16T22:45:15.908 INFO:teuthology.orchestra.run.smithi177.stdout:216 trunc from 0xeb7fc98 to 0x86f000b 2019-12-16T22:45:15.909 INFO:teuthology.orchestra.run.smithi177.stdout:279 punch from 0xa8ff1e5 to 0xa90223f, (0x305a bytes) 2019-12-16T22:45:15.909 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.909 INFO:teuthology.orchestra.run.smithi177.stdout:281 punch from 0x7fe4c32 to 0x7fef128, (0xa4f6 bytes) 2019-12-16T22:45:15.909 INFO:teuthology.orchestra.run.smithi177.stdout:282 read 0xc5649c4 thru 0xc56997a (0x4fb7 bytes) 2019-12-16T22:45:15.909 INFO:teuthology.orchestra.run.smithi177.stdout:284 trunc from 0xd6a1f0c to 0xdc0dec3 2019-12-16T22:45:15.922 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.923 INFO:teuthology.orchestra.run.smithi177.stdout:219 read 0x46efece thru 0x46efeee (0x21 bytes) 2019-12-16T22:45:15.923 INFO:teuthology.orchestra.run.smithi177.stdout:220 punch from 0x390bab3 to 0x3918f6d, (0xd4ba bytes) 2019-12-16T22:45:15.924 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.924 INFO:teuthology.orchestra.run.smithi177.stdout:223 write 0x42da78c thru 0x42dcd3e (0x25b3 bytes) 2019-12-16T22:45:15.925 INFO:teuthology.orchestra.run.smithi177.stdout:286 clone 2 order 19 su 262144 sc 12 2019-12-16T22:45:15.956 INFO:teuthology.orchestra.run.smithi177.stdout:224 write 0xe9fb2f6 thru 0xe9fc384 (0x108f bytes) 2019-12-16T22:45:15.961 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.962 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:15.962 INFO:teuthology.orchestra.run.smithi177.stdout:228 write 0x63d6350 thru 0x63e1587 (0xb238 bytes) 2019-12-16T22:45:15.966 INFO:teuthology.orchestra.run.smithi177.stdout:229 writesame 0x3eab145 thru 0x3eae97d data_size 0x1(0x3839 bytes) 2019-12-16T22:45:15.979 INFO:teuthology.orchestra.run.smithi177.stdout:230 writesame 0xb55700e thru 0xb55a274 data_size 0x33(0x3267 bytes) 2019-12-16T22:45:15.988 INFO:teuthology.orchestra.run.smithi177.stdout:231 punch from 0xe0c9210 to 0xe0d7e33, (0xec23 bytes) 2019-12-16T22:45:15.989 INFO:teuthology.orchestra.run.smithi177.stdout:232 read 0xe30fad2 thru 0xe316933 (0x6e62 bytes) 2019-12-16T22:45:15.989 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.008 INFO:teuthology.orchestra.run.smithi177.stdout:234 trunc from 0xe9fc385 to 0x67e46e4 2019-12-16T22:45:16.036 INFO:teuthology.orchestra.run.smithi177.stdout:238 write 0x2d92119 thru 0x2d960c6 (0x3fae bytes) 2019-12-16T22:45:16.040 INFO:teuthology.orchestra.run.smithi177.stdout:240 read 0x552e04e thru 0x553d0fe (0xf0b1 bytes) 2019-12-16T22:45:16.072 INFO:teuthology.orchestra.run.smithi177.stdout:243 write 0xbd477a8 thru 0xbd5161e (0x9e77 bytes) 2019-12-16T22:45:16.097 INFO:teuthology.orchestra.run.smithi177.stdout:244 trunc from 0xbd5161f to 0x4d70a58 2019-12-16T22:45:16.100 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone1 from 0xd9abc1e (overlap 0xcc9148) to 0x28e9db 2019-12-16T22:45:16.101 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone1 from 0xdc0dec3 (overlap 0x1a6a505) to 0x0 2019-12-16T22:45:16.103 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone1 from 0xeb13f24 (overlap 0x239806b) to 0x38f33d 2019-12-16T22:45:16.110 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone1 from 0xe5fad4b (overlap 0x3f9fbec) to 0x32e6323 2019-12-16T22:45:16.213 INFO:teuthology.orchestra.run.smithi177.stdout:248 write 0xc2e6d86 thru 0xc2ee159 (0x73d4 bytes) 2019-12-16T22:45:16.231 INFO:teuthology.orchestra.run.smithi177.stdout:249 read 0x890ddf5 thru 0x890fd15 (0x1f21 bytes) 2019-12-16T22:45:16.231 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.231 INFO:teuthology.orchestra.run.smithi177.stdout:240 punch from 0x724a030 to 0x7251396, (0x7366 bytes) 2019-12-16T22:45:16.252 INFO:teuthology.orchestra.run.smithi177.stdout:242 read 0x3c4c97f thru 0x3c54b21 (0x81a3 bytes) 2019-12-16T22:45:16.253 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.257 INFO:teuthology.orchestra.run.smithi177.stdout:244 trunc from 0x74edd6c to 0x47db92b 2019-12-16T22:45:16.262 INFO:teuthology.orchestra.run.smithi177.stdout:251 write 0xe49b40a thru 0xe4a5fe5 (0xabdc bytes) 2019-12-16T22:45:16.269 INFO:teuthology.orchestra.run.smithi177.stdout:252 writesame 0x8a3fdf0 thru 0x8a4a52d data_size 0x1(0xa73e bytes) 2019-12-16T22:45:16.278 INFO:teuthology.orchestra.run.smithi177.stdout:245 read 0x2c8b3db thru 0x2c95d49 (0xa96f bytes) 2019-12-16T22:45:16.279 INFO:teuthology.orchestra.run.smithi177.stdout:246 write 0x18a3ad2 thru 0x18ae371 (0xa8a0 bytes) 2019-12-16T22:45:16.306 INFO:teuthology.orchestra.run.smithi177.stdout:247 read 0x1229087 thru 0x1238eb8 (0xfe32 bytes) 2019-12-16T22:45:16.308 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #0, image image_cluster1.client.mirror.4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent1 2019-12-16T22:45:16.313 INFO:teuthology.orchestra.run.smithi177.stdout:253 trunc from 0xe4a5fe6 to 0x9c932da 2019-12-16T22:45:16.316 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #0, image image_cluster1.client.mirror.1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent1 2019-12-16T22:45:16.323 INFO:teuthology.orchestra.run.smithi177.stdout:248 trunc from 0x47db92b to 0xc91aed6 2019-12-16T22:45:16.339 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.340 INFO:teuthology.orchestra.run.smithi177.stdout:250 write 0x4d6a8c2 thru 0x4d721fd (0x793c bytes) 2019-12-16T22:45:16.346 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.346 INFO:teuthology.orchestra.run.smithi177.stdout:254 writesame 0xad053f8 thru 0xad11a6e data_size 0x17(0xc677 bytes) 2019-12-16T22:45:16.348 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #0, image image_cluster1.client.mirror.5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent1 2019-12-16T22:45:16.353 INFO:teuthology.orchestra.run.smithi177.stdout:255 trunc from 0xad11a6f to 0xa7b4a13 2019-12-16T22:45:16.360 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #0, image image_cluster1.client.mirror.2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent1 2019-12-16T22:45:16.364 INFO:teuthology.orchestra.run.smithi177.stdout:252 write 0xe142a7f thru 0xe14eeae (0xc430 bytes) 2019-12-16T22:45:16.373 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.373 INFO:teuthology.orchestra.run.smithi177.stdout:255 write 0x80d335b thru 0x80e0421 (0xd0c7 bytes) 2019-12-16T22:45:16.379 INFO:teuthology.orchestra.run.smithi177.stdout:256 read 0x717cf76 thru 0x717d791 (0x81c bytes) 2019-12-16T22:45:16.379 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.379 INFO:teuthology.orchestra.run.smithi177.stdout:262 write 0x3eb58dd thru 0x3ebeca3 (0x93c7 bytes) 2019-12-16T22:45:16.386 INFO:teuthology.orchestra.run.smithi177.stdout:256 writesame 0xca85d40 thru 0xca8be43 data_size 0xe(0x6104 bytes) 2019-12-16T22:45:16.389 INFO:teuthology.orchestra.run.smithi177.stdout:257 write 0xa2902cf thru 0xa29999c (0x96ce bytes) 2019-12-16T22:45:16.393 INFO:teuthology.orchestra.run.smithi177.stdout:259 writesame 0x71ef02c thru 0x71fdb85 data_size 0x7d(0xeb5a bytes) 2019-12-16T22:45:16.396 INFO:teuthology.orchestra.run.smithi177.stdout:261 write 0xab058ca thru 0xab06074 (0x7ab bytes) 2019-12-16T22:45:16.400 INFO:teuthology.orchestra.run.smithi177.stdout:262 read 0x7d6eb11 thru 0x7d7a35c (0xb84c bytes) 2019-12-16T22:45:16.401 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.401 INFO:teuthology.orchestra.run.smithi177.stdout:264 punch from 0x8b7fb8e to 0x8b8f568, (0xf9da bytes) 2019-12-16T22:45:16.401 INFO:teuthology.orchestra.run.smithi177.stdout:265 read 0x8b41e7e thru 0x8b50746 (0xe8c9 bytes) 2019-12-16T22:45:16.415 INFO:teuthology.orchestra.run.smithi177.stdout:264 trunc from 0xe14eeaf to 0x2a62526 2019-12-16T22:45:16.421 INFO:teuthology.orchestra.run.smithi177.stdout:267 writesame 0xe427193 thru 0xe42ed3b data_size 0x1(0x7ba9 bytes) 2019-12-16T22:45:16.430 INFO:teuthology.orchestra.run.smithi177.stdout:268 writesame 0x360df60 thru 0x361ba52 data_size 0x1(0xdaf3 bytes) 2019-12-16T22:45:16.473 INFO:teuthology.orchestra.run.smithi177.stdout:269 read 0x732a493 thru 0x732abb0 (0x71e bytes) 2019-12-16T22:45:16.474 INFO:teuthology.orchestra.run.smithi177.stdout:270 write 0x9edaa52 thru 0x9ee24cb (0x7a7a bytes) 2019-12-16T22:45:16.474 INFO:teuthology.orchestra.run.smithi177.stdout:265 write 0x3070530 thru 0x3077e3a (0x790b bytes) 2019-12-16T22:45:16.483 INFO:teuthology.orchestra.run.smithi177.stdout:271 read 0x4d6dd5a thru 0x4d74fc6 (0x726d bytes) 2019-12-16T22:45:16.483 INFO:teuthology.orchestra.run.smithi177.stdout:273 punch from 0x606baf3 to 0x6070925, (0x4e32 bytes) 2019-12-16T22:45:16.483 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.484 INFO:teuthology.orchestra.run.smithi177.stdout:275 write 0x110b251 thru 0x111724b (0xbffb bytes) 2019-12-16T22:45:16.484 INFO:teuthology.orchestra.run.smithi177.stdout:268 read 0x1d0d89c thru 0x1d136c4 (0x5e29 bytes) 2019-12-16T22:45:16.493 INFO:teuthology.orchestra.run.smithi177.stdout:277 punch from 0xd353811 to 0xd355c1a, (0x2409 bytes) 2019-12-16T22:45:16.494 INFO:teuthology.orchestra.run.smithi177.stdout:278 write 0x809adac thru 0x80a75c9 (0xc81e bytes) 2019-12-16T22:45:16.501 INFO:teuthology.orchestra.run.smithi177.stdout:279 read 0x7dc424b thru 0x7dc61f8 (0x1fae bytes) 2019-12-16T22:45:16.501 INFO:teuthology.orchestra.run.smithi177.stdout:280 trunc from 0xe42ed3c to 0xe834a86 2019-12-16T22:45:16.513 INFO:teuthology.orchestra.run.smithi177.stdout:269 writesame 0x3131a8b thru 0x3135ffe data_size 0x46(0x4574 bytes) 2019-12-16T22:45:16.514 INFO:teuthology.orchestra.run.smithi177.stdout:281 read 0x66666a7 thru 0x66688d4 (0x222e bytes) 2019-12-16T22:45:16.515 INFO:teuthology.orchestra.run.smithi177.stdout:282 read 0x224ec8 thru 0x22dd46 (0x8e7f bytes) 2019-12-16T22:45:16.516 INFO:teuthology.orchestra.run.smithi177.stdout:283 write 0x5168be3 thru 0x517495e (0xbd7c bytes) 2019-12-16T22:45:16.543 INFO:teuthology.orchestra.run.smithi177.stdout:284 trunc from 0xe834a86 to 0x51325ce 2019-12-16T22:45:16.551 INFO:teuthology.orchestra.run.smithi177.stdout:270 writesame 0xe16cac3 thru 0xe171fcf data_size 0x1(0x550d bytes) 2019-12-16T22:45:16.553 INFO:teuthology.orchestra.run.smithi177.stdout:271 write 0x9f3a7d6 thru 0x9f48297 (0xdac2 bytes) 2019-12-16T22:45:16.565 INFO:teuthology.orchestra.run.smithi177.stdout:272 read 0x4a64d5e thru 0x4a6a11b (0x53be bytes) 2019-12-16T22:45:16.565 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.565 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.565 INFO:teuthology.orchestra.run.smithi177.stdout:277 write 0x8a144f0 thru 0x8a226d9 (0xe1ea bytes) 2019-12-16T22:45:16.572 INFO:teuthology.orchestra.run.smithi177.stdout:286 read 0x503a9e2 thru 0x503b6d6 (0xcf5 bytes) 2019-12-16T22:45:16.572 INFO:teuthology.orchestra.run.smithi177.stdout:289 punch from 0x254d752 to 0x254e75c, (0x100a bytes) 2019-12-16T22:45:16.572 INFO:teuthology.orchestra.run.smithi177.stdout:290 read 0x34f3dda thru 0x34f6ec9 (0x30f0 bytes) 2019-12-16T22:45:16.573 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.574 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.574 INFO:teuthology.orchestra.run.smithi177.stdout:280 writesame 0x8edd428 thru 0x8ee5d27 data_size 0x40(0x8900 bytes) 2019-12-16T22:45:16.577 INFO:teuthology.orchestra.run.smithi177.stdout:281 writesame 0x36454bf thru 0x36525b7 data_size 0x1(0xd0f9 bytes) 2019-12-16T22:45:16.578 INFO:teuthology.orchestra.run.smithi177.stdout:291 trunc from 0x51325ce to 0x159c677 2019-12-16T22:45:16.616 INFO:teuthology.orchestra.run.smithi177.stdout:282 write 0x1fac56c thru 0x1fb33c1 (0x6e56 bytes) 2019-12-16T22:45:16.626 INFO:teuthology.orchestra.run.smithi177.stdout:283 clone 2 order 20 su 32768 sc 5 2019-12-16T22:45:16.638 INFO:teuthology.orchestra.run.smithi177.stdout:292 punch from 0x147261c to 0x147cfea, (0xa9ce bytes) 2019-12-16T22:45:16.638 INFO:teuthology.orchestra.run.smithi177.stdout:293 read 0x476709 thru 0x47ed16 (0x860e bytes) 2019-12-16T22:45:16.639 INFO:teuthology.orchestra.run.smithi177.stdout:294 read 0x1302de thru 0x13dafd (0xd820 bytes) 2019-12-16T22:45:16.661 INFO:teuthology.orchestra.run.smithi177.stdout:297 writesame 0x50fc814 thru 0x50ffd17 data_size 0x3a(0x3504 bytes) 2019-12-16T22:45:16.663 INFO:teuthology.orchestra.run.smithi177.stdout:300 read 0x30def2e thru 0x30e14fb (0x25ce bytes) 2019-12-16T22:45:16.664 INFO:teuthology.orchestra.run.smithi177.stdout:302 read 0x2ab0f54 thru 0x2ab45a8 (0x3655 bytes) 2019-12-16T22:45:16.675 INFO:teuthology.orchestra.run.smithi177.stdout:304 trunc from 0x50ffd18 to 0xa529550 2019-12-16T22:45:16.690 INFO:teuthology.orchestra.run.smithi177.stdout:305 write 0x272b2fa thru 0x2737fdd (0xcce4 bytes) 2019-12-16T22:45:16.701 INFO:teuthology.orchestra.run.smithi177.stdout:306 punch from 0x5026f03 to 0x5036032, (0xf12f bytes) 2019-12-16T22:45:16.701 INFO:teuthology.orchestra.run.smithi177.stdout:310 trunc from 0xa529550 to 0x7246899 2019-12-16T22:45:16.711 INFO:teuthology.orchestra.run.smithi177.stdout:287 trunc from 0xdc0dec3 to 0xc9281a7 2019-12-16T22:45:16.714 INFO:teuthology.orchestra.run.smithi177.stdout:311 read 0xa73dc8 thru 0xa75054 (0x128d bytes) 2019-12-16T22:45:16.715 INFO:teuthology.orchestra.run.smithi177.stdout:312 read 0x607fc50 thru 0x60859df (0x5d90 bytes) 2019-12-16T22:45:16.715 INFO:teuthology.orchestra.run.smithi177.stdout:313 writesame 0x2d3c6d4 thru 0x2d42756 data_size 0x1(0x6083 bytes) 2019-12-16T22:45:16.719 INFO:teuthology.orchestra.run.smithi177.stdout:38 punch from 0xc13dcd to 0xc15b65, (0x1d98 bytes) 2019-12-16T22:45:16.726 INFO:teuthology.orchestra.run.smithi177.stdout:78 read 0xa25340d thru 0xa25b954 (0x8548 bytes) 2019-12-16T22:45:16.734 INFO:teuthology.orchestra.run.smithi177.stdout:316 punch from 0x711c6ac to 0x7123dd1, (0x7725 bytes) 2019-12-16T22:45:16.743 INFO:teuthology.orchestra.run.smithi177.stdout:39 read 0x8fa58c7 thru 0x8fa8383 (0x2abd bytes) 2019-12-16T22:45:16.744 INFO:teuthology.orchestra.run.smithi177.stdout:40 read 0xa2d6e3f thru 0xa2e50e3 (0xe2a5 bytes) 2019-12-16T22:45:16.744 INFO:teuthology.orchestra.run.smithi177.stdout:41 read 0x9915c91 thru 0x991e0c4 (0x8434 bytes) 2019-12-16T22:45:16.744 INFO:teuthology.orchestra.run.smithi177.stdout:84 punch from 0x56270e6 to 0x5634757, (0xd671 bytes) 2019-12-16T22:45:16.745 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.745 INFO:teuthology.orchestra.run.smithi177.stdout:44 read 0x828a654 thru 0x82968fc (0xc2a9 bytes) 2019-12-16T22:45:16.745 INFO:teuthology.orchestra.run.smithi177.stdout:45 punch from 0xc0e3fa to 0xc151a4, (0x6daa bytes) 2019-12-16T22:45:16.746 INFO:teuthology.orchestra.run.smithi177.stdout:47 writesame 0x7ee2b75 thru 0x7ee4e8b data_size 0x1(0x2317 bytes) 2019-12-16T22:45:16.752 INFO:teuthology.orchestra.run.smithi177.stdout:120 trunc from 0xe5fad4b to 0x264ac32 2019-12-16T22:45:16.767 INFO:teuthology.orchestra.run.smithi177.stdout:317 write 0x97cf264 thru 0x97d4bd5 (0x5972 bytes) 2019-12-16T22:45:16.768 INFO:teuthology.orchestra.run.smithi177.stdout:48 read 0x31a23a7 thru 0x31ab131 (0x8d8b bytes) 2019-12-16T22:45:16.774 INFO:teuthology.orchestra.run.smithi177.stdout:320 read 0x7365fdc thru 0x7367c77 (0x1c9c bytes) 2019-12-16T22:45:16.776 INFO:teuthology.orchestra.run.smithi177.stdout:86 writesame 0xdb4d6de thru 0xdb5c2b9 data_size 0xa(0xebdc bytes) 2019-12-16T22:45:16.789 INFO:teuthology.orchestra.run.smithi177.stdout:321 trunc from 0x97d4bd6 to 0xdfa5792 2019-12-16T22:45:16.789 INFO:teuthology.orchestra.run.smithi177.stdout:52 trunc from 0xeb13f24 to 0x5d795a6 2019-12-16T22:45:16.789 INFO:teuthology.orchestra.run.smithi177.stdout:288 write 0x4e36805 thru 0x4e3e736 (0x7f32 bytes) 2019-12-16T22:45:16.793 INFO:teuthology.orchestra.run.smithi177.stdout:88 punch from 0x80930ce to 0x80a0ca8, (0xdbda bytes) 2019-12-16T22:45:16.793 INFO:teuthology.orchestra.run.smithi177.stdout:89 write 0x4689f9 thru 0x46c8d8 (0x3ee0 bytes) 2019-12-16T22:45:16.795 INFO:teuthology.orchestra.run.smithi177.stdout:289 read 0xc0e00b0 thru 0xc0e75a8 (0x74f9 bytes) 2019-12-16T22:45:16.799 INFO:teuthology.orchestra.run.smithi177.stdout:290 writesame 0x812f7d6 thru 0x8133ce9 data_size 0x2(0x4514 bytes) 2019-12-16T22:45:16.828 INFO:teuthology.orchestra.run.smithi177.stdout:322 read 0xc1efb20 thru 0xc1f721a (0x76fb bytes) 2019-12-16T22:45:16.828 INFO:teuthology.orchestra.run.smithi177.stdout:90 read 0x74d0edf thru 0x74d305a (0x217c bytes) 2019-12-16T22:45:16.828 INFO:teuthology.orchestra.run.smithi177.stdout:91 write 0x6177753 thru 0x617a061 (0x290f bytes) 2019-12-16T22:45:16.832 INFO:teuthology.orchestra.run.smithi177.stdout:291 write 0xb98e77b thru 0xb999369 (0xabef bytes) 2019-12-16T22:45:16.841 INFO:teuthology.orchestra.run.smithi177.stdout:323 trunc from 0xdfa5792 to 0x6113313 2019-12-16T22:45:16.850 INFO:teuthology.orchestra.run.smithi177.stdout:292 read 0x2b6ec69 thru 0x2b786f5 (0x9a8d bytes) 2019-12-16T22:45:16.851 INFO:teuthology.orchestra.run.smithi177.stdout:293 read 0x7c61e63 thru 0x7c6653e (0x46dc bytes) 2019-12-16T22:45:16.851 INFO:teuthology.orchestra.run.smithi177.stdout:294 punch from 0x1edd46 to 0x1ee1ce, (0x488 bytes) 2019-12-16T22:45:16.871 INFO:teuthology.orchestra.run.smithi177.stdout:92 trunc from 0xdb5c2ba to 0x1b590dc 2019-12-16T22:45:16.873 INFO:teuthology.orchestra.run.smithi177.stdout:121 read 0x14c4ff5 thru 0x14cda5e (0x8a6a bytes) 2019-12-16T22:45:16.873 INFO:teuthology.orchestra.run.smithi177.stdout:324 punch from 0x55fd390 to 0x560046b, (0x30db bytes) 2019-12-16T22:45:16.873 INFO:teuthology.orchestra.run.smithi177.stdout:325 write 0x17f4e8f thru 0x17fe16b (0x92dd bytes) 2019-12-16T22:45:16.877 INFO:teuthology.orchestra.run.smithi177.stdout:53 read 0x19ddb8a thru 0x19ec219 (0xe690 bytes) 2019-12-16T22:45:16.877 INFO:teuthology.orchestra.run.smithi177.stdout:296 write 0xd6a8d23 thru 0xd6a8daf (0x8d bytes) 2019-12-16T22:45:16.884 INFO:teuthology.orchestra.run.smithi177.stdout:329 read 0x17ccf90 thru 0x17d64b2 (0x9523 bytes) 2019-12-16T22:45:16.892 INFO:teuthology.orchestra.run.smithi177.stdout:299 read 0x9d72803 thru 0x9d7fc08 (0xd406 bytes) 2019-12-16T22:45:16.892 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.892 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:16.892 INFO:teuthology.orchestra.run.smithi177.stdout:302 punch from 0xa91a235 to 0xa91a949, (0x714 bytes) 2019-12-16T22:45:16.893 INFO:teuthology.orchestra.run.smithi177.stdout:303 read 0x5a582df thru 0x5a60059 (0x7d7b bytes) 2019-12-16T22:45:16.893 INFO:teuthology.orchestra.run.smithi177.stdout:306 read 0x5c295d7 thru 0x5c2fdd6 (0x6800 bytes) 2019-12-16T22:45:16.893 INFO:teuthology.orchestra.run.smithi177.stdout:307 read 0x8f144b8 thru 0x8f23b80 (0xf6c9 bytes) 2019-12-16T22:45:16.893 INFO:teuthology.orchestra.run.smithi177.stdout:310 read 0x5524c36 thru 0x55326cb (0xda96 bytes) 2019-12-16T22:45:16.900 INFO:teuthology.orchestra.run.smithi177.stdout:330 trunc from 0x6113313 to 0xe7a40fe 2019-12-16T22:45:16.962 INFO:teuthology.orchestra.run.smithi177.stdout:56 writesame 0x98bf269 thru 0x98c55ba data_size 0x1(0x6352 bytes) 2019-12-16T22:45:16.963 INFO:teuthology.orchestra.run.smithi177.stdout:122 write 0x68d63fe thru 0x68d8fdf (0x2be2 bytes) 2019-12-16T22:45:16.966 INFO:teuthology.orchestra.run.smithi177.stdout:57 punch from 0x6258f4e to 0x6262d85, (0x9e37 bytes) 2019-12-16T22:45:16.966 INFO:teuthology.orchestra.run.smithi177.stdout:58 write 0x3346d80 thru 0x334a7d0 (0x3a51 bytes) 2019-12-16T22:45:16.977 INFO:teuthology.orchestra.run.smithi177.stdout:311 write 0xd749e19 thru 0xd74a379 (0x561 bytes) 2019-12-16T22:45:16.992 INFO:teuthology.orchestra.run.smithi177.stdout:59 write 0x1c5c41c thru 0x1c5fd61 (0x3946 bytes) 2019-12-16T22:45:16.992 INFO:teuthology.orchestra.run.smithi177.stdout:123 write 0x27da13d thru 0x27e7d78 (0xdc3c bytes) 2019-12-16T22:45:16.994 INFO:teuthology.orchestra.run.smithi177.stdout:312 write 0x9e13e58 thru 0x9e1a209 (0x63b2 bytes) 2019-12-16T22:45:16.997 INFO:teuthology.orchestra.run.smithi177.stdout:331 write 0x33b6a6 thru 0x3420f0 (0x6a4b bytes) 2019-12-16T22:45:17.009 INFO:teuthology.orchestra.run.smithi177.stdout:125 clone 3 order 22 su 262144 sc 12 2019-12-16T22:45:17.010 INFO:teuthology.orchestra.run.smithi177.stdout:332 read 0x7c9506f thru 0x7c9da0a (0x899c bytes) 2019-12-16T22:45:17.010 INFO:teuthology.orchestra.run.smithi177.stdout:333 write 0x517723e thru 0x518356f (0xc332 bytes) 2019-12-16T22:45:17.010 INFO:teuthology.orchestra.run.smithi177.stdout:314 write 0x51a2e15 thru 0x51ac95c (0x9b48 bytes) 2019-12-16T22:45:17.026 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.026 INFO:teuthology.orchestra.run.smithi177.stdout:335 write 0x2568fa8 thru 0x256ba4f (0x2aa8 bytes) 2019-12-16T22:45:17.026 INFO:teuthology.orchestra.run.smithi177.stdout:315 write 0xc9fd4b3 thru 0xca020ea (0x4c38 bytes) 2019-12-16T22:45:17.026 INFO:teuthology.orchestra.run.smithi177.stdout:61 write 0x8ba249 thru 0x8c9e8c (0xfc44 bytes) 2019-12-16T22:45:17.037 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.037 INFO:teuthology.orchestra.run.smithi177.stdout:317 read 0x2638b06 thru 0x26470d4 (0xe5cf bytes) 2019-12-16T22:45:17.038 INFO:teuthology.orchestra.run.smithi177.stdout:318 writesame 0xa38eeb7 thru 0xa3949c4 data_size 0x2d(0x5b0e bytes) 2019-12-16T22:45:17.040 INFO:teuthology.orchestra.run.smithi177.stdout:336 trunc from 0xe7a40fe to 0xbf6e4e4 2019-12-16T22:45:17.045 INFO:teuthology.orchestra.run.smithi177.stdout:93 read 0x24ea97 thru 0x250b74 (0x20de bytes) 2019-12-16T22:45:17.048 INFO:teuthology.orchestra.run.smithi177.stdout:94 trunc from 0x1b590dc to 0xbbbe6b 2019-12-16T22:45:17.058 INFO:teuthology.orchestra.run.smithi177.stdout:320 trunc from 0xd74a37a to 0x53060c5 2019-12-16T22:45:17.071 INFO:teuthology.orchestra.run.smithi177.stdout:62 read 0x550d06c thru 0x5516df9 (0x9d8e bytes) 2019-12-16T22:45:17.073 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.074 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.075 INFO:teuthology.orchestra.run.smithi177.stdout:63 trunc from 0x98c55bb to 0x834ab4e 2019-12-16T22:45:17.086 INFO:teuthology.orchestra.run.smithi177.stdout:337 write 0xdc88151 thru 0xdc8d5d6 (0x5486 bytes) 2019-12-16T22:45:17.096 INFO:teuthology.orchestra.run.smithi177.stdout:341 punch from 0x1ac3bfc to 0x1acc908, (0x8d0c bytes) 2019-12-16T22:45:17.097 INFO:teuthology.orchestra.run.smithi177.stdout:64 trunc from 0x834ab4e to 0x9338b3d 2019-12-16T22:45:17.114 INFO:teuthology.orchestra.run.smithi177.stdout:97 writesame 0xe2c0db0 thru 0xe2ce21d data_size 0x1(0xd46e bytes) 2019-12-16T22:45:17.115 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.115 INFO:teuthology.orchestra.run.smithi177.stdout:99 read 0xac61c52 thru 0xac625e5 (0x994 bytes) 2019-12-16T22:45:17.115 INFO:teuthology.orchestra.run.smithi177.stdout:100 writesame 0x3b2d4f5 thru 0x3b3c734 data_size 0x13(0xf240 bytes) 2019-12-16T22:45:17.115 INFO:teuthology.orchestra.run.smithi177.stdout:321 trunc from 0x53060c5 to 0xd1da03a 2019-12-16T22:45:17.116 INFO:teuthology.orchestra.run.smithi177.stdout:65 writesame 0x1c8fdf2 thru 0x1c936e0 data_size 0x35(0x38ef bytes) 2019-12-16T22:45:17.123 INFO:teuthology.orchestra.run.smithi177.stdout:342 trunc from 0xdc8d5d7 to 0x156d053 2019-12-16T22:45:17.136 INFO:teuthology.orchestra.run.smithi177.stdout:101 punch from 0xb73ee6 to 0xb7aa28, (0x6b42 bytes) 2019-12-16T22:45:17.137 INFO:teuthology.orchestra.run.smithi177.stdout:103 write 0x709d7e8 thru 0x70a8b42 (0xb35b bytes) 2019-12-16T22:45:17.139 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.139 INFO:teuthology.orchestra.run.smithi177.stdout:325 punch from 0x77a02ae to 0x77a3ef9, (0x3c4b bytes) 2019-12-16T22:45:17.139 INFO:teuthology.orchestra.run.smithi177.stdout:328 writesame 0x9fb5215 thru 0x9fbfc80 data_size 0x1a(0xaa6c bytes) 2019-12-16T22:45:17.142 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.3-clone1 2019-12-16T22:45:17.145 INFO:teuthology.orchestra.run.smithi177.stdout:66 read 0x5c1bd32 thru 0x5c21b2e (0x5dfd bytes) 2019-12-16T22:45:17.147 INFO:teuthology.orchestra.run.smithi177.stdout:67 punch from 0x48ee390 to 0x48f27be, (0x442e bytes) 2019-12-16T22:45:17.150 INFO:teuthology.orchestra.run.smithi177.stdout:329 writesame 0x12c4a53 thru 0x12cb92d data_size 0x25(0x6edb bytes) 2019-12-16T22:45:17.152 INFO:teuthology.orchestra.run.smithi177.stdout:104 writesame 0x1a5ba4a thru 0x1a61c80 data_size 0x3(0x6237 bytes) 2019-12-16T22:45:17.159 INFO:teuthology.orchestra.run.smithi177.stdout:330 write 0x27f59f thru 0x28df4a (0xe9ac bytes) 2019-12-16T22:45:17.166 INFO:teuthology.orchestra.run.smithi177.stdout:105 write 0xd92b271 thru 0xd93b20b (0xff9b bytes) 2019-12-16T22:45:17.172 INFO:teuthology.orchestra.run.smithi177.stdout:344 trunc from 0x156d053 to 0x4bdcd26 2019-12-16T22:45:17.174 INFO:teuthology.orchestra.run.smithi177.stdout:68 write 0x98ef00f thru 0x98fd5c0 (0xe5b2 bytes) 2019-12-16T22:45:17.182 INFO:teuthology.orchestra.run.smithi177.stdout:333 read 0xc2a09a5 thru 0xc2a79d6 (0x7032 bytes) 2019-12-16T22:45:17.183 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.183 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.183 INFO:teuthology.orchestra.run.smithi177.stdout:336 write 0xcfd32e6 thru 0xcfd9b6f (0x688a bytes) 2019-12-16T22:45:17.192 INFO:teuthology.orchestra.run.smithi177.stdout:106 punch from 0x81b0935 to 0x81bd71b, (0xcde6 bytes) 2019-12-16T22:45:17.193 INFO:teuthology.orchestra.run.smithi177.stdout:107 write 0x933f047 thru 0x93490f5 (0xa0af bytes) 2019-12-16T22:45:17.201 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.201 INFO:teuthology.orchestra.run.smithi177.stdout:338 write 0x193e8e0 thru 0x1943eb4 (0x55d5 bytes) 2019-12-16T22:45:17.214 INFO:teuthology.orchestra.run.smithi177.stdout:108 write 0xb0e8ed3 thru 0xb0eca28 (0x3b56 bytes) 2019-12-16T22:45:17.220 INFO:teuthology.orchestra.run.smithi177.stdout:109 punch from 0x61c169d to 0x61d0158, (0xeabb bytes) 2019-12-16T22:45:17.220 INFO:teuthology.orchestra.run.smithi177.stdout:110 read 0x600f5a7 thru 0x6015629 (0x6083 bytes) 2019-12-16T22:45:17.220 INFO:teuthology.orchestra.run.smithi177.stdout:112 write 0x3a3e902 thru 0x3a44e54 (0x6553 bytes) 2019-12-16T22:45:17.223 INFO:teuthology.orchestra.run.smithi177.stdout:69 trunc from 0x98fd5c1 to 0x3d1384d 2019-12-16T22:45:17.226 INFO:teuthology.orchestra.run.smithi177.stdout:113 writesame 0x7323854 thru 0x7332553 data_size 0x80(0xed00 bytes) 2019-12-16T22:45:17.238 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.238 INFO:teuthology.orchestra.run.smithi177.stdout:115 clone 3 order 24 su 65536 sc 15 2019-12-16T22:45:17.238 INFO:teuthology.orchestra.run.smithi177.stdout:339 trunc from 0xd1da03a to 0x1d7fc71 2019-12-16T22:45:17.241 INFO:teuthology.orchestra.run.smithi177.stdout:345 write 0x9f9dd14 thru 0x9fab765 (0xda52 bytes) 2019-12-16T22:45:17.252 INFO:teuthology.orchestra.run.smithi177.stdout:347 writesame 0x43de6b7 thru 0x43e26db data_size 0x1(0x4025 bytes) 2019-12-16T22:45:17.263 INFO:teuthology.orchestra.run.smithi177.stdout:348 read 0x9028192 thru 0x902f09c (0x6f0b bytes) 2019-12-16T22:45:17.263 INFO:teuthology.orchestra.run.smithi177.stdout:349 read 0x9bc3034 thru 0x9bd071e (0xd6eb bytes) 2019-12-16T22:45:17.263 INFO:teuthology.orchestra.run.smithi177.stdout:351 write 0x719110f thru 0x71a0c52 (0xfb44 bytes) 2019-12-16T22:45:17.270 INFO:teuthology.orchestra.run.smithi177.stdout:353 punch from 0x7109ad2 to 0x71143ff, (0xa92d bytes) 2019-12-16T22:45:17.271 INFO:teuthology.orchestra.run.smithi177.stdout:354 flatten 2019-12-16T22:45:17.279 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.279 INFO:teuthology.orchestra.run.smithi177.stdout:342 read 0x818012 thru 0x818d69 (0xd58 bytes) 2019-12-16T22:45:17.288 INFO:teuthology.orchestra.run.smithi177.stdout:355 read 0x9eb0ea4 thru 0x9eb11c0 (0x31d bytes) 2019-12-16T22:45:17.290 INFO:teuthology.orchestra.run.smithi177.stdout:357 trunc from 0x9fab766 to 0x9136366 2019-12-16T22:45:17.298 INFO:teuthology.orchestra.run.smithi177.stdout:343 writesame 0x43c6573 thru 0x43d33bd data_size 0x1(0xce4b bytes) 2019-12-16T22:45:17.329 INFO:teuthology.orchestra.run.smithi177.stdout:70 write 0x9b04ed0 thru 0x9b0e5c2 (0x96f3 bytes) 2019-12-16T22:45:17.329 INFO:teuthology.orchestra.run.smithi177.stdout:71 punch from 0x84b439f to 0x84b661e, (0x227f bytes) 2019-12-16T22:45:17.330 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.330 INFO:teuthology.orchestra.run.smithi177.stdout:73 trunc from 0x9b0e5c3 to 0x340f239 2019-12-16T22:45:17.330 INFO:teuthology.orchestra.run.smithi177.stdout:344 punch from 0x2dd8de4 to 0x2de0b58, (0x7d74 bytes) 2019-12-16T22:45:17.330 INFO:teuthology.orchestra.run.smithi177.stdout:346 punch from 0x2991b7f to 0x29961ac, (0x462d bytes) 2019-12-16T22:45:17.330 INFO:teuthology.orchestra.run.smithi177.stdout:358 punch from 0x5ce32cc to 0x5cf2552, (0xf286 bytes) 2019-12-16T22:45:17.330 INFO:teuthology.orchestra.run.smithi177.stdout:359 trunc from 0x9136366 to 0xbb2f035 2019-12-16T22:45:17.331 INFO:teuthology.orchestra.run.smithi177.stdout:348 writesame 0xa455ca9 thru 0xa45e425 data_size 0x7(0x877d bytes) 2019-12-16T22:45:17.332 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.332 INFO:teuthology.orchestra.run.smithi177.stdout:351 read 0x835723 thru 0x841ec1 (0xc79f bytes) 2019-12-16T22:45:17.332 INFO:teuthology.orchestra.run.smithi177.stdout:360 read 0x154e3be thru 0x1558091 (0x9cd4 bytes) 2019-12-16T22:45:17.332 INFO:teuthology.orchestra.run.smithi177.stdout:361 punch from 0x7bd2d8d to 0x7bd4642, (0x18b5 bytes) 2019-12-16T22:45:17.332 INFO:teuthology.orchestra.run.smithi177.stdout:362 punch from 0xa6b50eb to 0xa6bb722, (0x6637 bytes) 2019-12-16T22:45:17.333 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.333 INFO:teuthology.orchestra.run.smithi177.stdout:364 trunc from 0xbb2f035 to 0xaf433c2 2019-12-16T22:45:17.341 INFO:teuthology.orchestra.run.smithi177.stdout:352 trunc from 0xa45e426 to 0xcae9dad 2019-12-16T22:45:17.350 INFO:teuthology.orchestra.run.smithi177.stdout:365 read 0x56d6647 thru 0x56dc57f (0x5f39 bytes) 2019-12-16T22:45:17.354 INFO:teuthology.orchestra.run.smithi177.stdout:353 write 0x4a0f2a9 thru 0x4a1a8a8 (0xb600 bytes) 2019-12-16T22:45:17.362 INFO:teuthology.orchestra.run.smithi177.stdout:354 write 0x9f4346e thru 0x9f48221 (0x4db4 bytes) 2019-12-16T22:45:17.364 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #0, image image_cluster1.client.mirror.3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent1 2019-12-16T22:45:17.371 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.371 INFO:teuthology.orchestra.run.smithi177.stdout:356 read 0x1a189fc thru 0x1a1cd54 (0x4359 bytes) 2019-12-16T22:45:17.372 INFO:teuthology.orchestra.run.smithi177.stdout:357 read 0x30c3246 thru 0x30cb9b7 (0x8772 bytes) 2019-12-16T22:45:17.374 INFO:teuthology.orchestra.run.smithi177.stdout:366 trunc from 0xaf433c2 to 0x79b7d8 2019-12-16T22:45:17.388 INFO:teuthology.orchestra.run.smithi177.stdout:74 write 0x676ce2d thru 0x6775c03 (0x8dd7 bytes) 2019-12-16T22:45:17.392 INFO:teuthology.orchestra.run.smithi177.stdout:359 write 0xe06cc04 thru 0xe06fcb0 (0x30ad bytes) 2019-12-16T22:45:17.400 INFO:teuthology.orchestra.run.smithi177.stdout:360 read 0x4feeb10 thru 0x4ffa7c2 (0xbcb3 bytes) 2019-12-16T22:45:17.400 INFO:teuthology.orchestra.run.smithi177.stdout:361 read 0x455996d thru 0x455c7e8 (0x2e7c bytes) 2019-12-16T22:45:17.400 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.400 INFO:teuthology.orchestra.run.smithi177.stdout:363 write 0x3d849c6 thru 0x3d91a32 (0xd06d bytes) 2019-12-16T22:45:17.403 INFO:teuthology.orchestra.run.smithi177.stdout:367 punch from 0x710616 to 0x71a673, (0xa05d bytes) 2019-12-16T22:45:17.405 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.405 INFO:teuthology.orchestra.run.smithi177.stdout:76 punch from 0x2a00d0d to 0x2a09f75, (0x9268 bytes) 2019-12-16T22:45:17.405 INFO:teuthology.orchestra.run.smithi177.stdout:77 read 0x482d765 thru 0x48391d9 (0xba75 bytes) 2019-12-16T22:45:17.409 INFO:teuthology.orchestra.run.smithi177.stdout:364 write 0x3e6de76 thru 0x3e79dc1 (0xbf4c bytes) 2019-12-16T22:45:17.414 INFO:teuthology.orchestra.run.smithi177.stdout:78 trunc from 0x6775c04 to 0xa6f3f60 2019-12-16T22:45:17.421 INFO:teuthology.orchestra.run.smithi177.stdout:369 trunc from 0x79b7d8 to 0xa984f92 2019-12-16T22:45:17.427 INFO:teuthology.orchestra.run.smithi177.stdout:365 read 0xd2cfcdf thru 0xd2d1093 (0x13b5 bytes) 2019-12-16T22:45:17.427 INFO:teuthology.orchestra.run.smithi177.stdout:366 write 0x8ebb944 thru 0x8ecb457 (0xfb14 bytes) 2019-12-16T22:45:17.438 INFO:teuthology.orchestra.run.smithi177.stdout:370 write 0x42d975f thru 0x42dd503 (0x3da5 bytes) 2019-12-16T22:45:17.440 INFO:teuthology.orchestra.run.smithi177.stdout:79 trunc from 0xa6f3f60 to 0x7f84f4a 2019-12-16T22:45:17.445 INFO:teuthology.orchestra.run.smithi177.stdout:371 punch from 0x31ade24 to 0x31af32c, (0x1508 bytes) 2019-12-16T22:45:17.445 INFO:teuthology.orchestra.run.smithi177.stdout:372 write 0x7996b7e thru 0x799a195 (0x3618 bytes) 2019-12-16T22:45:17.460 INFO:teuthology.orchestra.run.smithi177.stdout:367 write 0xeaddcf7 thru 0xeaea342 (0xc64c bytes) 2019-12-16T22:45:17.464 INFO:teuthology.orchestra.run.smithi177.stdout:80 trunc from 0x7f84f4a to 0x55263ff 2019-12-16T22:45:17.467 INFO:teuthology.orchestra.run.smithi177.stdout:368 punch from 0x788d7dc to 0x789a437, (0xcc5b bytes) 2019-12-16T22:45:17.468 INFO:teuthology.orchestra.run.smithi177.stdout:370 writesame 0x3462feb thru 0x3472fe4 data_size 0x5(0xfffa bytes) 2019-12-16T22:45:17.468 INFO:teuthology.orchestra.run.smithi177.stdout:375 trunc from 0xa984f92 to 0x44b100a 2019-12-16T22:45:17.484 INFO:teuthology.orchestra.run.smithi177.stdout:371 writesame 0x6d51e88 thru 0x6d5dad5 data_size 0x1(0xbc4e bytes) 2019-12-16T22:45:17.493 INFO:teuthology.orchestra.run.smithi177.stdout:376 read 0x29a8415 thru 0x29b0c41 (0x882d bytes) 2019-12-16T22:45:17.493 INFO:teuthology.orchestra.run.smithi177.stdout:377 write 0x1cdebe5 thru 0x1ce09c2 (0x1dde bytes) 2019-12-16T22:45:17.494 INFO:teuthology.orchestra.run.smithi177.stdout:81 read 0x451d182 thru 0x451eb96 (0x1a15 bytes) 2019-12-16T22:45:17.500 INFO:teuthology.orchestra.run.smithi177.stdout:83 trunc from 0x55263ff to 0x1860ea8 2019-12-16T22:45:17.512 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.512 INFO:teuthology.orchestra.run.smithi177.stdout:381 writesame 0x2bb9d5c thru 0x2bc25a9 data_size 0x49(0x884e bytes) 2019-12-16T22:45:17.523 INFO:teuthology.orchestra.run.smithi177.stdout:372 writesame 0x8d876b7 thru 0x8d95e7d data_size 0x1(0xe7c7 bytes) 2019-12-16T22:45:17.535 INFO:teuthology.orchestra.run.smithi177.stdout:382 trunc from 0x44b100a to 0xb8a9dd7 2019-12-16T22:45:17.565 INFO:teuthology.orchestra.run.smithi177.stdout:383 punch from 0x4b9323c to 0x4b9b13a, (0x7efe bytes) 2019-12-16T22:45:17.566 INFO:teuthology.orchestra.run.smithi177.stdout:384 write 0x68bce54 thru 0x68bf8bd (0x2a6a bytes) 2019-12-16T22:45:17.580 INFO:teuthology.orchestra.run.smithi177.stdout:373 trunc from 0xeaea343 to 0x9db8447 2019-12-16T22:45:17.593 INFO:teuthology.orchestra.run.smithi177.stdout:385 trunc from 0xb8a9dd7 to 0x3b53cc 2019-12-16T22:45:17.612 INFO:teuthology.orchestra.run.smithi177.stdout:84 write 0xad898a4 thru 0xad97188 (0xd8e5 bytes) 2019-12-16T22:45:17.613 INFO:teuthology.orchestra.run.smithi177.stdout:284 writesame 0x5a12834 thru 0x5a1f07f data_size 0x6(0xc84c bytes) 2019-12-16T22:45:17.617 INFO:teuthology.orchestra.run.smithi177.stdout:387 clone 2 order 20 su 262144 sc 6 2019-12-16T22:45:17.629 INFO:teuthology.orchestra.run.smithi177.stdout:374 write 0xed2a734 thru 0xed3a3fd (0xfcca bytes) 2019-12-16T22:45:17.629 INFO:teuthology.orchestra.run.smithi177.stdout:87 read 0x6a0d9e2 thru 0x6a17041 (0x9660 bytes) 2019-12-16T22:45:17.630 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.630 INFO:teuthology.orchestra.run.smithi177.stdout:89 write 0x6ff6299 thru 0x7005529 (0xf291 bytes) 2019-12-16T22:45:17.641 INFO:teuthology.orchestra.run.smithi177.stdout:285 read 0x4ba652b thru 0x4bb0e19 (0xa8ef bytes) 2019-12-16T22:45:17.641 INFO:teuthology.orchestra.run.smithi177.stdout:286 read 0x1fed2fd thru 0x1ff95e6 (0xc2ea bytes) 2019-12-16T22:45:17.642 INFO:teuthology.orchestra.run.smithi177.stdout:287 read 0xd4f9d71 thru 0xd502c12 (0x8ea2 bytes) 2019-12-16T22:45:17.642 INFO:teuthology.orchestra.run.smithi177.stdout:288 read 0x4516e02 thru 0x4523bf0 (0xcdef bytes) 2019-12-16T22:45:17.642 INFO:teuthology.orchestra.run.smithi177.stdout:289 read 0x8ac558e thru 0x8acd5ff (0x8072 bytes) 2019-12-16T22:45:17.643 INFO:teuthology.orchestra.run.smithi177.stdout:291 read 0xb7a1112 thru 0xb7a35f7 (0x24e6 bytes) 2019-12-16T22:45:17.644 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.644 INFO:teuthology.orchestra.run.smithi177.stdout:293 write 0x9074130 thru 0x9077127 (0x2ff8 bytes) 2019-12-16T22:45:17.653 INFO:teuthology.orchestra.run.smithi177.stdout:91 read 0x74c3eb1 thru 0x74d169e (0xd7ee bytes) 2019-12-16T22:45:17.654 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.654 INFO:teuthology.orchestra.run.smithi177.stdout:93 writesame 0x27640e8 thru 0x2766010 data_size 0x1(0x1f29 bytes) 2019-12-16T22:45:17.659 INFO:teuthology.orchestra.run.smithi177.stdout:375 trunc from 0xed3a3fe to 0x656af43 2019-12-16T22:45:17.659 INFO:teuthology.orchestra.run.smithi177.stdout:294 write 0xe079ffc thru 0xe087379 (0xd37e bytes) 2019-12-16T22:45:17.663 INFO:teuthology.orchestra.run.smithi177.stdout:94 read 0x4ab599f thru 0x4abfc84 (0xa2e6 bytes) 2019-12-16T22:45:17.663 INFO:teuthology.orchestra.run.smithi177.stdout:95 punch from 0x9a660c0 to 0x9a6bf9d, (0x5edd bytes) 2019-12-16T22:45:17.668 INFO:teuthology.orchestra.run.smithi177.stdout:96 trunc from 0xad97189 to 0xc665cd1 2019-12-16T22:45:17.671 INFO:teuthology.orchestra.run.smithi177.stdout:295 writesame 0xde1d0c3 thru 0xde214d2 data_size 0x58(0x4410 bytes) 2019-12-16T22:45:17.686 INFO:teuthology.orchestra.run.smithi177.stdout:376 punch from 0x2e2f68a to 0x2e3270e, (0x3084 bytes) 2019-12-16T22:45:17.686 INFO:teuthology.orchestra.run.smithi177.stdout:377 read 0x6ea6d1 thru 0x6eb075 (0x9a5 bytes) 2019-12-16T22:45:17.687 INFO:teuthology.orchestra.run.smithi177.stdout:378 punch from 0xf1f75d to 0xf25b06, (0x63a9 bytes) 2019-12-16T22:45:17.694 INFO:teuthology.orchestra.run.smithi177.stdout:296 trunc from 0xe171fd0 to 0x759667b 2019-12-16T22:45:17.695 INFO:teuthology.orchestra.run.smithi177.stdout:97 trunc from 0xc665cd1 to 0x80543b3 2019-12-16T22:45:17.720 INFO:teuthology.orchestra.run.smithi177.stdout:380 write 0xd4aa7a9 thru 0xd4b1452 (0x6caa bytes) 2019-12-16T22:45:17.724 INFO:teuthology.orchestra.run.smithi177.stdout:101 punch from 0x71efb57 to 0x71fd457, (0xd900 bytes) 2019-12-16T22:45:17.724 INFO:teuthology.orchestra.run.smithi177.stdout:102 punch from 0x2e21d1e to 0x2e26a29, (0x4d0b bytes) 2019-12-16T22:45:17.724 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.724 INFO:teuthology.orchestra.run.smithi177.stdout:104 write 0xd52127 thru 0xd53722 (0x15fc bytes) 2019-12-16T22:45:17.728 INFO:teuthology.orchestra.run.smithi177.stdout:381 punch from 0xd0cbdb7 to 0xd0cf5ec, (0x3835 bytes) 2019-12-16T22:45:17.728 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.737 INFO:teuthology.orchestra.run.smithi177.stdout:105 read 0x259523d thru 0x259d256 (0x801a bytes) 2019-12-16T22:45:17.741 INFO:teuthology.orchestra.run.smithi177.stdout:106 trunc from 0x80543b3 to 0x6425616 2019-12-16T22:45:17.747 INFO:teuthology.orchestra.run.smithi177.stdout:382 write 0xe6e6971 thru 0xe6e6bc1 (0x251 bytes) 2019-12-16T22:45:17.748 INFO:teuthology.orchestra.run.smithi177.stdout:298 write 0xa3da39f thru 0xa3e1231 (0x6e93 bytes) 2019-12-16T22:45:17.755 INFO:teuthology.orchestra.run.smithi177.stdout:383 punch from 0x7ddeb76 to 0x7de16ad, (0x2b37 bytes) 2019-12-16T22:45:17.755 INFO:teuthology.orchestra.run.smithi177.stdout:384 write 0xbb17d02 thru 0xbb247c2 (0xcac1 bytes) 2019-12-16T22:45:17.762 INFO:teuthology.orchestra.run.smithi177.stdout:299 read 0x91c63b8 thru 0x91c7ca6 (0x18ef bytes) 2019-12-16T22:45:17.762 INFO:teuthology.orchestra.run.smithi177.stdout:300 read 0xa2c1b6e thru 0xa2c4ce7 (0x317a bytes) 2019-12-16T22:45:17.763 INFO:teuthology.orchestra.run.smithi177.stdout:302 read 0x1415a3 thru 0x14e308 (0xcd66 bytes) 2019-12-16T22:45:17.763 INFO:teuthology.orchestra.run.smithi177.stdout:385 punch from 0x5bfffb to 0x5c40af, (0x40b4 bytes) 2019-12-16T22:45:17.763 INFO:teuthology.orchestra.run.smithi177.stdout:386 write 0x3ed4992 thru 0x3ed646c (0x1adb bytes) 2019-12-16T22:45:17.772 INFO:teuthology.orchestra.run.smithi177.stdout:107 punch from 0x391a794 to 0x39258e1, (0xb14d bytes) 2019-12-16T22:45:17.772 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.772 INFO:teuthology.orchestra.run.smithi177.stdout:109 write 0x3bc040 thru 0x3c32d2 (0x7293 bytes) 2019-12-16T22:45:17.775 INFO:teuthology.orchestra.run.smithi177.stdout:303 trunc from 0xa3e1232 to 0x3b71205 2019-12-16T22:45:17.785 INFO:teuthology.orchestra.run.smithi177.stdout:387 write 0xebd0b7e thru 0xebde866 (0xdce9 bytes) 2019-12-16T22:45:17.788 INFO:teuthology.orchestra.run.smithi177.stdout:117 punch from 0x1ddef3a to 0x1de1237, (0x22fd bytes) 2019-12-16T22:45:17.788 INFO:teuthology.orchestra.run.smithi177.stdout:119 read 0x22a5e99 thru 0x22b0afe (0xac66 bytes) 2019-12-16T22:45:17.788 INFO:teuthology.orchestra.run.smithi177.stdout:124 read 0x9b5aa7 thru 0x9bdc0a (0x8164 bytes) 2019-12-16T22:45:17.788 INFO:teuthology.orchestra.run.smithi177.stdout:125 write 0xc6a278 thru 0xc79d41 (0xfaca bytes) 2019-12-16T22:45:17.814 INFO:teuthology.orchestra.run.smithi177.stdout:388 trunc from 0xebde867 to 0x4050099 2019-12-16T22:45:17.831 INFO:teuthology.orchestra.run.smithi177.stdout:126 write 0x1cc8656 thru 0x1ccf1e9 (0x6b94 bytes) 2019-12-16T22:45:17.856 INFO:teuthology.orchestra.run.smithi177.stdout:304 trunc from 0x3b71205 to 0xd99a07a 2019-12-16T22:45:17.872 INFO:teuthology.orchestra.run.smithi177.stdout:306 writesame 0x142cdcb thru 0x14305fb data_size 0x7(0x3831 bytes) 2019-12-16T22:45:17.873 INFO:teuthology.orchestra.run.smithi177.stdout:127 writesame 0xd07088f thru 0xd07ef78 data_size 0xb(0xe6ea bytes) 2019-12-16T22:45:17.875 INFO:teuthology.orchestra.run.smithi177.stdout:129 write 0x7b0ce7c thru 0x7b0f893 (0x2a18 bytes) 2019-12-16T22:45:17.876 INFO:teuthology.orchestra.run.smithi177.stdout:392 write 0xeb27004 thru 0xeb29200 (0x21fd bytes) 2019-12-16T22:45:17.884 INFO:teuthology.orchestra.run.smithi177.stdout:394 write 0x541020a thru 0x541397a (0x3771 bytes) 2019-12-16T22:45:17.890 INFO:teuthology.orchestra.run.smithi177.stdout:395 punch from 0x5f8cf34 to 0x5f92f4a, (0x6016 bytes) 2019-12-16T22:45:17.891 INFO:teuthology.orchestra.run.smithi177.stdout:308 read 0x2ae81ff thru 0x2af7f83 (0xfd85 bytes) 2019-12-16T22:45:17.891 INFO:teuthology.orchestra.run.smithi177.stdout:309 write 0xc44e666 thru 0xc451b0a (0x34a5 bytes) 2019-12-16T22:45:17.898 INFO:teuthology.orchestra.run.smithi177.stdout:312 write 0x7b8b397 thru 0x7b9819a (0xce04 bytes) 2019-12-16T22:45:17.903 INFO:teuthology.orchestra.run.smithi177.stdout:130 write 0xe7cec9d thru 0xe7d0b30 (0x1e94 bytes) 2019-12-16T22:45:17.909 INFO:teuthology.orchestra.run.smithi177.stdout:397 trunc from 0xeb29201 to 0x4e7ed9b 2019-12-16T22:45:17.912 INFO:teuthology.orchestra.run.smithi177.stdout:313 write 0x983fe8c thru 0x9846781 (0x68f6 bytes) 2019-12-16T22:45:17.918 INFO:teuthology.orchestra.run.smithi177.stdout:132 read 0x3408a29 thru 0x34184e2 (0xfaba bytes) 2019-12-16T22:45:17.919 INFO:teuthology.orchestra.run.smithi177.stdout:134 write 0x60ff4b7 thru 0x6105540 (0x608a bytes) 2019-12-16T22:45:17.928 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.928 INFO:teuthology.orchestra.run.smithi177.stdout:315 writesame 0x5760433 thru 0x576f8af data_size 0x1f(0xf47d bytes) 2019-12-16T22:45:17.936 INFO:teuthology.orchestra.run.smithi177.stdout:135 write 0x2a458da thru 0x2a5036b (0xaa92 bytes) 2019-12-16T22:45:17.938 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.939 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.939 INFO:teuthology.orchestra.run.smithi177.stdout:319 write 0x95b3e9 thru 0x9699f1 (0xe609 bytes) 2019-12-16T22:45:17.967 INFO:teuthology.orchestra.run.smithi177.stdout:320 punch from 0xb0fcafb to 0xb105839, (0x8d3e bytes) 2019-12-16T22:45:17.967 INFO:teuthology.orchestra.run.smithi177.stdout:322 read 0x900cd25 thru 0x9019479 (0xc755 bytes) 2019-12-16T22:45:17.968 INFO:teuthology.orchestra.run.smithi177.stdout:323 read 0xad27b1 thru 0xad8cdf (0x652f bytes) 2019-12-16T22:45:17.968 INFO:teuthology.orchestra.run.smithi177.stdout:324 write 0x39324c thru 0x39a519 (0x72ce bytes) 2019-12-16T22:45:17.971 INFO:teuthology.orchestra.run.smithi177.stdout:398 write 0x8e5660d thru 0x8e5cdf1 (0x67e5 bytes) 2019-12-16T22:45:17.973 INFO:teuthology.orchestra.run.smithi177.stdout:137 write 0xe9eae34 thru 0xe9f1030 (0x61fd bytes) 2019-12-16T22:45:17.981 INFO:teuthology.orchestra.run.smithi177.stdout:399 punch from 0x478f6dc to 0x478fcd4, (0x5f8 bytes) 2019-12-16T22:45:17.981 INFO:teuthology.orchestra.run.smithi177.stdout:401 read 0xd53dd8 thru 0xd54385 (0x5ae bytes) 2019-12-16T22:45:17.982 INFO:teuthology.orchestra.run.smithi177.stdout:402 read 0x6d59608 thru 0x6d5e2d0 (0x4cc9 bytes) 2019-12-16T22:45:17.982 INFO:teuthology.orchestra.run.smithi177.stdout:403 writesame 0x4a9e0c9 thru 0x4aa4c03 data_size 0x1(0x6b3b bytes) 2019-12-16T22:45:17.992 INFO:teuthology.orchestra.run.smithi177.stdout:404 punch from 0x32bcea5 to 0x32bdfbe, (0x1119 bytes) 2019-12-16T22:45:17.992 INFO:teuthology.orchestra.run.smithi177.stdout:405 read 0x86e910f thru 0x86f68e4 (0xd7d6 bytes) 2019-12-16T22:45:17.992 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:17.999 INFO:teuthology.orchestra.run.smithi177.stdout:325 clone 3 order 25 su 2097152 sc 2 2019-12-16T22:45:18.014 INFO:teuthology.orchestra.run.smithi177.stdout:139 trunc from 0xe9f1031 to 0xad6bb0f 2019-12-16T22:45:18.018 INFO:teuthology.orchestra.run.smithi177.stdout:407 trunc from 0x8e5cdf2 to 0x1d5c2c 2019-12-16T22:45:18.045 INFO:teuthology.orchestra.run.smithi177.stdout:141 read 0x8e1027 thru 0x8e4e4f (0x3e29 bytes) 2019-12-16T22:45:18.045 INFO:teuthology.orchestra.run.smithi177.stdout:142 writesame 0x53333f thru 0x540dec data_size 0x17(0xdaae bytes) 2019-12-16T22:45:18.086 INFO:teuthology.orchestra.run.smithi177.stdout:146 read 0x24588a3 thru 0x246583f (0xcf9d bytes) 2019-12-16T22:45:18.087 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.104 INFO:teuthology.orchestra.run.smithi177.stdout:149 trunc from 0xad6bb0f to 0x1ddf8b5 2019-12-16T22:45:18.121 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone2 from 0x68d8fe0 (overlap 0x264ac32) to 0x1ea235b 2019-12-16T22:45:18.128 INFO:teuthology.orchestra.run.smithi177.stdout:408 writesame 0x79ad2c9 thru 0x79b4be5 data_size 0x41(0x791d bytes) 2019-12-16T22:45:18.133 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.133 INFO:teuthology.orchestra.run.smithi177.stdout:412 punch from 0x4fe93a to 0x4ff095, (0x75b bytes) 2019-12-16T22:45:18.133 INFO:teuthology.orchestra.run.smithi177.stdout:413 punch from 0x18e7f1a to 0x18edc9c, (0x5d82 bytes) 2019-12-16T22:45:18.134 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.134 INFO:teuthology.orchestra.run.smithi177.stdout:415 punch from 0xbb6412 to 0xbc0f64, (0xab52 bytes) 2019-12-16T22:45:18.134 INFO:teuthology.orchestra.run.smithi177.stdout:417 writesame 0x21d50de thru 0x21d52fc data_size 0x1(0x21f bytes) 2019-12-16T22:45:18.138 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone2 from 0xe2ce21e (overlap 0xbbbe6b) to 0x5ddf35 2019-12-16T22:45:18.157 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #0, image image_cluster1.client.mirror.0 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent1 2019-12-16T22:45:18.164 INFO:teuthology.orchestra.run.smithi177.stdout:150 write 0x595a995 thru 0x5967cd3 (0xd33f bytes) 2019-12-16T22:45:18.165 INFO:teuthology.orchestra.run.smithi177.stdout:418 write 0xb36edea thru 0xb37045a (0x1671 bytes) 2019-12-16T22:45:18.178 INFO:teuthology.orchestra.run.smithi177.stdout:419 trunc from 0xb37045b to 0xa5eb2bd 2019-12-16T22:45:18.186 INFO:teuthology.orchestra.run.smithi177.stdout:151 punch from 0x4a611ff to 0x4a61c55, (0xa56 bytes) 2019-12-16T22:45:18.187 INFO:teuthology.orchestra.run.smithi177.stdout:152 read 0x1f3f94d thru 0x1f4de67 (0xe51b bytes) 2019-12-16T22:45:18.191 INFO:teuthology.orchestra.run.smithi177.stdout:155 trunc from 0x5967cd4 to 0x35211c5 2019-12-16T22:45:18.210 INFO:teuthology.orchestra.run.smithi177.stdout:420 trunc from 0xa5eb2bd to 0xcc31b74 2019-12-16T22:45:18.227 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe458c6a 2019-12-16T22:45:18.229 INFO:teuthology.orchestra.run.smithi177.stdout:421 trunc from 0xcc31b74 to 0xe458c6a 2019-12-16T22:45:18.239 INFO:teuthology.orchestra.run.smithi177.stdout:157 write 0x7ba3c3d thru 0x7ba46a8 (0xa6c bytes) 2019-12-16T22:45:18.243 INFO:teuthology.orchestra.run.smithi177.stdout:423 punch from 0xa96f3fb to 0xa97b72f, (0xc334 bytes) 2019-12-16T22:45:18.244 INFO:teuthology.orchestra.run.smithi177.stdout:424 read 0x338a0d thru 0x3448a7 (0xbe9b bytes) 2019-12-16T22:45:18.244 INFO:teuthology.orchestra.run.smithi177.stdout:426 write 0x3f8152e thru 0x3f8b1ae (0x9c81 bytes) 2019-12-16T22:45:18.246 INFO:teuthology.orchestra.run.smithi177.stdout:160 read 0x3eff8d3 thru 0x3f0ddf1 (0xe51f bytes) 2019-12-16T22:45:18.247 INFO:teuthology.orchestra.run.smithi177.stdout:162 punch from 0x3307164 to 0x330ce55, (0x5cf1 bytes) 2019-12-16T22:45:18.247 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.247 INFO:teuthology.orchestra.run.smithi177.stdout:165 punch from 0x387bde5 to 0x38823cc, (0x65e7 bytes) 2019-12-16T22:45:18.248 INFO:teuthology.orchestra.run.smithi177.stdout:166 trunc from 0x7ba46a9 to 0x719e022 2019-12-16T22:45:18.251 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.251 INFO:teuthology.orchestra.run.smithi177.stdout:428 read 0x7aede7c thru 0x7afa68f (0xc814 bytes) 2019-12-16T22:45:18.251 INFO:teuthology.orchestra.run.smithi177.stdout:429 punch from 0x4eb3795 to 0x4ec06ef, (0xcf5a bytes) 2019-12-16T22:45:18.251 INFO:teuthology.orchestra.run.smithi177.stdout:430 write 0xc3a2b32 thru 0xc3a56a8 (0x2b77 bytes) 2019-12-16T22:45:18.257 INFO:teuthology.orchestra.run.smithi177.stdout:431 write 0xc56a1d thru 0xc64960 (0xdf44 bytes) 2019-12-16T22:45:18.269 INFO:teuthology.orchestra.run.smithi177.stdout:432 punch from 0x30cc0e7 to 0x30d2b7b, (0x6a94 bytes) 2019-12-16T22:45:18.269 INFO:teuthology.orchestra.run.smithi177.stdout:433 read 0x66579a thru 0x6735b1 (0xde18 bytes) 2019-12-16T22:45:18.275 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #1, image image_cluster1.client.mirror.4-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent2 2019-12-16T22:45:18.277 INFO:teuthology.orchestra.run.smithi177.stdout:167 punch from 0x36cec29 to 0x36da11f, (0xb4f6 bytes) 2019-12-16T22:45:18.277 INFO:teuthology.orchestra.run.smithi177.stdout:168 read 0x3398c13 thru 0x33a0d9b (0x8189 bytes) 2019-12-16T22:45:18.277 INFO:teuthology.orchestra.run.smithi177.stdout:169 writesame 0x3d0241 thru 0x3d2126 data_size 0x23(0x1ee6 bytes) 2019-12-16T22:45:18.280 INFO:teuthology.orchestra.run.smithi177.stdout:171 write 0xbd0f26 thru 0xbd60e4 (0x51bf bytes) 2019-12-16T22:45:18.281 INFO:teuthology.orchestra.run.smithi177.stdout:434 trunc from 0xe458c6a to 0x6c596f2 2019-12-16T22:45:18.289 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.290 INFO:teuthology.orchestra.run.smithi177.stdout:173 read 0x517b28d thru 0x5186059 (0xadcd bytes) 2019-12-16T22:45:18.290 INFO:teuthology.orchestra.run.smithi177.stdout:174 read 0x519fa9c thru 0x51af92b (0xfe90 bytes) 2019-12-16T22:45:18.290 INFO:teuthology.orchestra.run.smithi177.stdout:176 read 0x35d7cc8 thru 0x35de09a (0x63d3 bytes) 2019-12-16T22:45:18.313 INFO:teuthology.orchestra.run.smithi177.stdout:435 write 0x364b22a thru 0x36594c1 (0xe298 bytes) 2019-12-16T22:45:18.314 INFO:teuthology.orchestra.run.smithi177.stdout:116 read 0x52b499 thru 0x52e84b (0x33b3 bytes) 2019-12-16T22:45:18.317 INFO:teuthology.orchestra.run.smithi177.stdout:177 write 0xb6f8636 thru 0xb70507d (0xca48 bytes) 2019-12-16T22:45:18.326 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #1, image image_cluster1.client.mirror.2-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent2 2019-12-16T22:45:18.328 INFO:teuthology.orchestra.run.smithi177.stdout:118 write 0xbefddb9 thru 0xbf00ee2 (0x312a bytes) 2019-12-16T22:45:18.344 INFO:teuthology.orchestra.run.smithi177.stdout:178 write 0xf95e0d thru 0xf982a0 (0x2494 bytes) 2019-12-16T22:45:18.367 INFO:teuthology.orchestra.run.smithi177.stdout:436 writesame 0xe27ca0c thru 0xe28495b data_size 0x30(0x7f50 bytes) 2019-12-16T22:45:18.374 INFO:teuthology.orchestra.run.smithi177.stdout:440 read 0xaba7af6 thru 0xabb03ec (0x88f7 bytes) 2019-12-16T22:45:18.374 INFO:teuthology.orchestra.run.smithi177.stdout:441 write 0x82cd350 thru 0x82d4c5d (0x790e bytes) 2019-12-16T22:45:18.383 INFO:teuthology.orchestra.run.smithi177.stdout:119 punch from 0xab5b91b to 0xab66d0a, (0xb3ef bytes) 2019-12-16T22:45:18.383 INFO:teuthology.orchestra.run.smithi177.stdout:120 read 0xd0a2793 thru 0xd0a445e (0x1ccc bytes) 2019-12-16T22:45:18.383 INFO:teuthology.orchestra.run.smithi177.stdout:121 read 0xd4f2204 thru 0xd4f8ff8 (0x6df5 bytes) 2019-12-16T22:45:18.383 INFO:teuthology.orchestra.run.smithi177.stdout:125 read 0x86a5efd thru 0x86ab2bd (0x53c1 bytes) 2019-12-16T22:45:18.386 INFO:teuthology.orchestra.run.smithi177.stdout:442 write 0xb01c24b thru 0xb01cbc5 (0x97b bytes) 2019-12-16T22:45:18.392 INFO:teuthology.orchestra.run.smithi177.stdout:126 trunc from 0xe2ce21e to 0x9973ac4 2019-12-16T22:45:18.398 INFO:teuthology.orchestra.run.smithi177.stdout:443 read 0xda879e4 thru 0xda8db0e (0x612b bytes) 2019-12-16T22:45:18.403 INFO:teuthology.orchestra.run.smithi177.stdout:444 trunc from 0xe28495c to 0xb629de2 2019-12-16T22:45:18.407 INFO:teuthology.orchestra.run.smithi177.stdout:179 write 0xc33c403 thru 0xc346019 (0x9c17 bytes) 2019-12-16T22:45:18.477 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.477 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.477 INFO:teuthology.orchestra.run.smithi177.stdout:182 write 0x8d36452 thru 0x8d3d4f0 (0x709f bytes) 2019-12-16T22:45:18.526 INFO:teuthology.orchestra.run.smithi177.stdout:183 read 0xbdbe375 thru 0xbdc5d20 (0x79ac bytes) 2019-12-16T22:45:18.526 INFO:teuthology.orchestra.run.smithi177.stdout:184 punch from 0x5795203 to 0x579bed1, (0x6cce bytes) 2019-12-16T22:45:18.526 INFO:teuthology.orchestra.run.smithi177.stdout:185 read 0x7a6409c thru 0x7a682bc (0x4221 bytes) 2019-12-16T22:45:18.526 INFO:teuthology.orchestra.run.smithi177.stdout:186 write 0x5d7facd thru 0x5d865be (0x6af2 bytes) 2019-12-16T22:45:18.566 INFO:teuthology.orchestra.run.smithi177.stdout:446 read 0x7884637 thru 0x78883c9 (0x3d93 bytes) 2019-12-16T22:45:18.566 INFO:teuthology.orchestra.run.smithi177.stdout:448 read 0x84704bf thru 0x8473682 (0x31c4 bytes) 2019-12-16T22:45:18.566 INFO:teuthology.orchestra.run.smithi177.stdout:449 write 0x7f01d3c thru 0x7f0a3c5 (0x868a bytes) 2019-12-16T22:45:18.567 INFO:teuthology.orchestra.run.smithi177.stdout:187 write 0x996c2e2 thru 0x997a0f1 (0xde10 bytes) 2019-12-16T22:45:18.579 INFO:teuthology.orchestra.run.smithi177.stdout:388 writesame 0xece976e thru 0xecefd5b data_size 0x3(0x65ee bytes) 2019-12-16T22:45:18.589 INFO:teuthology.orchestra.run.smithi177.stdout:389 writesame 0xba0d4a6 thru 0xba1ad91 data_size 0x2(0xd8ec bytes) 2019-12-16T22:45:18.601 INFO:teuthology.orchestra.run.smithi177.stdout:450 read 0x90e44f2 thru 0x90ebfb5 (0x7ac4 bytes) 2019-12-16T22:45:18.601 INFO:teuthology.orchestra.run.smithi177.stdout:452 writesame 0x27e44d3 thru 0x27ea787 data_size 0x1(0x62b5 bytes) 2019-12-16T22:45:18.638 INFO:teuthology.orchestra.run.smithi177.stdout:390 write 0xe86d84b thru 0xe87a172 (0xc928 bytes) 2019-12-16T22:45:18.640 INFO:teuthology.orchestra.run.smithi177.stdout:188 trunc from 0xc34601a to 0x886e10d 2019-12-16T22:45:18.672 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.673 INFO:teuthology.orchestra.run.smithi177.stdout:456 read 0x6926873 thru 0x6926e29 (0x5b7 bytes) 2019-12-16T22:45:18.673 INFO:teuthology.orchestra.run.smithi177.stdout:460 write 0xa6e482f thru 0xa6f0c2c (0xc3fe bytes) 2019-12-16T22:45:18.680 INFO:teuthology.orchestra.run.smithi177.stdout:391 write 0xc7dc116 thru 0xc7e73df (0xb2ca bytes) 2019-12-16T22:45:18.682 INFO:teuthology.orchestra.run.smithi177.stdout:461 read 0x4e150a5 thru 0x4e18dec (0x3d48 bytes) 2019-12-16T22:45:18.682 INFO:teuthology.orchestra.run.smithi177.stdout:462 write 0x65a6eca thru 0x65b428e (0xd3c5 bytes) 2019-12-16T22:45:18.699 INFO:teuthology.orchestra.run.smithi177.stdout:463 write 0x4af2c9f thru 0x4af4517 (0x1879 bytes) 2019-12-16T22:45:18.705 INFO:teuthology.orchestra.run.smithi177.stdout:464 writesame 0x2866678 thru 0x286f906 data_size 0x1(0x928f bytes) 2019-12-16T22:45:18.712 INFO:teuthology.orchestra.run.smithi177.stdout:392 trunc from 0xecefd5c to 0x77bc875 2019-12-16T22:45:18.728 INFO:teuthology.orchestra.run.smithi177.stdout:189 writesame 0x2465a40 thru 0x2473232 data_size 0x1(0xd7f3 bytes) 2019-12-16T22:45:18.729 INFO:teuthology.orchestra.run.smithi177.stdout:127 punch from 0x6497c96 to 0x64a34de, (0xb848 bytes) 2019-12-16T22:45:18.729 INFO:teuthology.orchestra.run.smithi177.stdout:128 read 0x2b79442 thru 0x2b7cfb2 (0x3b71 bytes) 2019-12-16T22:45:18.729 INFO:teuthology.orchestra.run.smithi177.stdout:129 write 0x5d91486 thru 0x5da116d (0xfce8 bytes) 2019-12-16T22:45:18.756 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.759 INFO:teuthology.orchestra.run.smithi177.stdout:130 read 0x8643bf4 thru 0x864edb4 (0xb1c1 bytes) 2019-12-16T22:45:18.760 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.760 INFO:teuthology.orchestra.run.smithi177.stdout:133 punch from 0x61d023 to 0x622cc8, (0x5ca5 bytes) 2019-12-16T22:45:18.760 INFO:teuthology.orchestra.run.smithi177.stdout:134 read 0x759e680 thru 0x75aa708 (0xc089 bytes) 2019-12-16T22:45:18.762 INFO:teuthology.orchestra.run.smithi177.stdout:135 read 0x5af350d thru 0x5afd5c6 (0xa0ba bytes) 2019-12-16T22:45:18.765 INFO:teuthology.orchestra.run.smithi177.stdout:469 trunc from 0xb629de2 to 0x64dddbc 2019-12-16T22:45:18.769 INFO:teuthology.orchestra.run.smithi177.stdout:137 write 0x184bd11 thru 0x184ee24 (0x3114 bytes) 2019-12-16T22:45:18.786 INFO:teuthology.orchestra.run.smithi177.stdout:190 writesame 0x7c778fb thru 0x7c7dc7b data_size 0x7(0x6381 bytes) 2019-12-16T22:45:18.792 INFO:teuthology.orchestra.run.smithi177.stdout:393 read 0x7771762 thru 0x7772f0a (0x17a9 bytes) 2019-12-16T22:45:18.792 INFO:teuthology.orchestra.run.smithi177.stdout:394 read 0x3f6b308 thru 0x3f74aca (0x97c3 bytes) 2019-12-16T22:45:18.792 INFO:teuthology.orchestra.run.smithi177.stdout:395 punch from 0x1543a4c to 0x155238b, (0xe93f bytes) 2019-12-16T22:45:18.799 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.800 INFO:teuthology.orchestra.run.smithi177.stdout:193 trunc from 0x886e10d to 0x8c75537 2019-12-16T22:45:18.802 INFO:teuthology.orchestra.run.smithi177.stdout:396 trunc from 0x77bc875 to 0xd161f29 2019-12-16T22:45:18.807 INFO:teuthology.orchestra.run.smithi177.stdout:138 writesame 0xa1477fa thru 0xa1573b4 data_size 0x1(0xfbbb bytes) 2019-12-16T22:45:18.808 INFO:teuthology.orchestra.run.smithi177.stdout:470 read 0x5e3b9c0 thru 0x5e44f66 (0x95a7 bytes) 2019-12-16T22:45:18.815 INFO:teuthology.orchestra.run.smithi177.stdout:140 trunc from 0xa1573b5 to 0xbc87b74 2019-12-16T22:45:18.815 INFO:teuthology.orchestra.run.smithi177.stdout:471 trunc from 0x64dddbc to 0x9b01f0f 2019-12-16T22:45:18.820 INFO:teuthology.orchestra.run.smithi177.stdout:397 punch from 0x6e9ff2a to 0x6ea5676, (0x574c bytes) 2019-12-16T22:45:18.820 INFO:teuthology.orchestra.run.smithi177.stdout:398 read 0x7eb2531 thru 0x7eb7d83 (0x5853 bytes) 2019-12-16T22:45:18.820 INFO:teuthology.orchestra.run.smithi177.stdout:399 read 0x3e7159a thru 0x3e7fca1 (0xe708 bytes) 2019-12-16T22:45:18.820 INFO:teuthology.orchestra.run.smithi177.stdout:402 read 0x9f96577 thru 0x9fa0149 (0x9bd3 bytes) 2019-12-16T22:45:18.821 INFO:teuthology.orchestra.run.smithi177.stdout:403 punch from 0x2360ba1 to 0x236b154, (0xa5b3 bytes) 2019-12-16T22:45:18.821 INFO:teuthology.orchestra.run.smithi177.stdout:406 punch from 0x80e4b3 to 0x81a6d0, (0xc21d bytes) 2019-12-16T22:45:18.821 INFO:teuthology.orchestra.run.smithi177.stdout:408 writesame 0x7e50085 thru 0x7e5cc53 data_size 0x5(0xcbcf bytes) 2019-12-16T22:45:18.831 INFO:teuthology.orchestra.run.smithi177.stdout:410 writesame 0x995f3c2 thru 0x9962696 data_size 0x4d(0x32d5 bytes) 2019-12-16T22:45:18.838 INFO:teuthology.orchestra.run.smithi177.stdout:411 read 0xa92287f thru 0xa928379 (0x5afb bytes) 2019-12-16T22:45:18.838 INFO:teuthology.orchestra.run.smithi177.stdout:413 write 0x173f4ae thru 0x1741ad5 (0x2628 bytes) 2019-12-16T22:45:18.839 INFO:teuthology.orchestra.run.smithi177.stdout:472 punch from 0x17aabed to 0x17b1784, (0x6b97 bytes) 2019-12-16T22:45:18.839 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.839 INFO:teuthology.orchestra.run.smithi177.stdout:476 read 0x95896 thru 0xa52bb (0xfa26 bytes) 2019-12-16T22:45:18.840 INFO:teuthology.orchestra.run.smithi177.stdout:477 read 0x6344f50 thru 0x634b6d7 (0x6788 bytes) 2019-12-16T22:45:18.847 INFO:teuthology.orchestra.run.smithi177.stdout:141 punch from 0xb9c9384 to 0xb9cf726, (0x63a2 bytes) 2019-12-16T22:45:18.848 INFO:teuthology.orchestra.run.smithi177.stdout:142 read 0x192f6b2 thru 0x19361a5 (0x6af4 bytes) 2019-12-16T22:45:18.850 INFO:teuthology.orchestra.run.smithi177.stdout:195 write 0xab90bbf thru 0xab9e220 (0xd662 bytes) 2019-12-16T22:45:18.875 INFO:teuthology.orchestra.run.smithi177.stdout:414 write 0xc8eadb7 thru 0xc8ef184 (0x43ce bytes) 2019-12-16T22:45:18.879 INFO:teuthology.orchestra.run.smithi177.stdout:479 write 0xabea7ff thru 0xabf976f (0xef71 bytes) 2019-12-16T22:45:18.888 INFO:teuthology.orchestra.run.smithi177.stdout:197 writesame 0xa1760c9 thru 0xa17de27 data_size 0x31(0x7d5f bytes) 2019-12-16T22:45:18.890 INFO:teuthology.orchestra.run.smithi177.stdout:143 write 0xceb84c7 thru 0xcebcd31 (0x486b bytes) 2019-12-16T22:45:18.905 INFO:teuthology.orchestra.run.smithi177.stdout:481 trunc from 0xabf9770 to 0x301737b 2019-12-16T22:45:18.922 INFO:teuthology.orchestra.run.smithi177.stdout:144 read 0x3d4f72d thru 0x3d55fd6 (0x68aa bytes) 2019-12-16T22:45:18.922 INFO:teuthology.orchestra.run.smithi177.stdout:145 write 0xc34a01f thru 0xc358bd6 (0xebb8 bytes) 2019-12-16T22:45:18.922 INFO:teuthology.orchestra.run.smithi177.stdout:199 trunc from 0xab9e221 to 0xd153a8b 2019-12-16T22:45:18.927 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.927 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xdf258db 2019-12-16T22:45:18.929 INFO:teuthology.orchestra.run.smithi177.stdout:148 trunc from 0xcebcd32 to 0xdf258db 2019-12-16T22:45:18.935 INFO:teuthology.orchestra.run.smithi177.stdout:415 write 0xe9be877 thru 0xe9c50bb (0x6845 bytes) 2019-12-16T22:45:18.937 INFO:teuthology.orchestra.run.smithi177.stdout:482 punch from 0x2080000 to 0x208b4aa, (0xb4aa bytes) 2019-12-16T22:45:18.937 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:18.937 INFO:teuthology.orchestra.run.smithi177.stdout:485 read 0x13a5d38 thru 0x13b168c (0xb955 bytes) 2019-12-16T22:45:18.986 INFO:teuthology.orchestra.run.smithi177.stdout:487 write 0xc54d17d thru 0xc55a49b (0xd31f bytes) 2019-12-16T22:45:18.991 INFO:teuthology.orchestra.run.smithi177.stdout:416 trunc from 0xe9c50bc to 0x269b6f7 2019-12-16T22:45:19.005 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.027 INFO:teuthology.orchestra.run.smithi177.stdout:202 write 0x2625ead thru 0x2634220 (0xe374 bytes) 2019-12-16T22:45:19.028 INFO:teuthology.orchestra.run.smithi177.stdout:489 write 0x6c9e37e thru 0x6caa4ed (0xc170 bytes) 2019-12-16T22:45:19.031 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.031 INFO:teuthology.orchestra.run.smithi177.stdout:419 read 0xeb2f98 thru 0xeb55e2 (0x264b bytes) 2019-12-16T22:45:19.050 INFO:teuthology.orchestra.run.smithi177.stdout:420 trunc from 0x269b6f7 to 0xd13a431 2019-12-16T22:45:19.055 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.056 INFO:teuthology.orchestra.run.smithi177.stdout:494 read 0x2d59734 thru 0x2d62500 (0x8dcd bytes) 2019-12-16T22:45:19.056 INFO:teuthology.orchestra.run.smithi177.stdout:495 punch from 0x2d0fb5e to 0x2d1af0f, (0xb3b1 bytes) 2019-12-16T22:45:19.056 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.056 INFO:teuthology.orchestra.run.smithi177.stdout:497 read 0x5900afd thru 0x59080c4 (0x75c8 bytes) 2019-12-16T22:45:19.066 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.073 INFO:teuthology.orchestra.run.smithi177.stdout:203 read 0xae3b97c thru 0xae409b4 (0x5039 bytes) 2019-12-16T22:45:19.074 INFO:teuthology.orchestra.run.smithi177.stdout:204 read 0xb6f280d thru 0xb6ff656 (0xce4a bytes) 2019-12-16T22:45:19.074 INFO:teuthology.orchestra.run.smithi177.stdout:206 read 0x7e714c3 thru 0x7e7ae47 (0x9985 bytes) 2019-12-16T22:45:19.074 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.074 INFO:teuthology.orchestra.run.smithi177.stdout:208 writesame 0x22974b8 thru 0x22a421c data_size 0x3(0xcd65 bytes) 2019-12-16T22:45:19.084 INFO:teuthology.orchestra.run.smithi177.stdout:422 write 0xd9b6295 thru 0xd9c3e64 (0xdbd0 bytes) 2019-12-16T22:45:19.086 INFO:teuthology.orchestra.run.smithi177.stdout:498 write 0xd0d3834 thru 0xd0dd5e4 (0x9db1 bytes) 2019-12-16T22:45:19.093 INFO:teuthology.orchestra.run.smithi177.stdout:150 trunc from 0xdf258db to 0x874e619 2019-12-16T22:45:19.097 INFO:teuthology.orchestra.run.smithi177.stdout:210 writesame 0x94593e7 thru 0x9464594 data_size 0x15(0xb1ae bytes) 2019-12-16T22:45:19.098 INFO:teuthology.orchestra.run.smithi177.stdout:423 write 0x13386a7 thru 0x133c8a1 (0x41fb bytes) 2019-12-16T22:45:19.104 INFO:teuthology.orchestra.run.smithi177.stdout:499 write 0x4fe5522 thru 0x4ff24fc (0xcfdb bytes) 2019-12-16T22:45:19.114 INFO:teuthology.orchestra.run.smithi177.stdout:500 writesame 0xb161efd thru 0xb16444a data_size 0x19(0x254e bytes) 2019-12-16T22:45:19.123 INFO:teuthology.orchestra.run.smithi177.stdout:424 punch from 0x80f4e04 to 0x81011b5, (0xc3b1 bytes) 2019-12-16T22:45:19.126 INFO:teuthology.orchestra.run.smithi177.stdout:501 write 0x85dc9ee thru 0x85e3d81 (0x7394 bytes) 2019-12-16T22:45:19.132 INFO:teuthology.orchestra.run.smithi177.stdout:151 read 0x58acc55 thru 0x58b829d (0xb649 bytes) 2019-12-16T22:45:19.132 INFO:teuthology.orchestra.run.smithi177.stdout:211 trunc from 0xd153a8b to 0x7dcc4ab 2019-12-16T22:45:19.136 INFO:teuthology.orchestra.run.smithi177.stdout:425 trunc from 0xd9c3e65 to 0x660588a 2019-12-16T22:45:19.142 INFO:teuthology.orchestra.run.smithi177.stdout:154 trunc from 0x874e619 to 0xdbda05b 2019-12-16T22:45:19.166 INFO:teuthology.orchestra.run.smithi177.stdout:156 read 0x28527af thru 0x2858f53 (0x67a5 bytes) 2019-12-16T22:45:19.167 INFO:teuthology.orchestra.run.smithi177.stdout:157 punch from 0x6e437d6 to 0x6e48e2f, (0x5659 bytes) 2019-12-16T22:45:19.167 INFO:teuthology.orchestra.run.smithi177.stdout:158 read 0x6e3b362 thru 0x6e46db6 (0xba55 bytes) 2019-12-16T22:45:19.170 INFO:teuthology.orchestra.run.smithi177.stdout:503 write 0xe5c7dde thru 0xe5cca7f (0x4ca2 bytes) 2019-12-16T22:45:19.171 INFO:teuthology.orchestra.run.smithi177.stdout:427 read 0x19a0229 thru 0x19aab27 (0xa8ff bytes) 2019-12-16T22:45:19.172 INFO:teuthology.orchestra.run.smithi177.stdout:159 trunc from 0xdbda05b to 0xbefe318 2019-12-16T22:45:19.183 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.184 INFO:teuthology.orchestra.run.smithi177.stdout:214 write 0x39d6161 thru 0x39db3bb (0x525b bytes) 2019-12-16T22:45:19.184 INFO:teuthology.orchestra.run.smithi177.stdout:428 trunc from 0x660588a to 0xaf54b20 2019-12-16T22:45:19.187 INFO:teuthology.orchestra.run.smithi177.stdout:504 trunc from 0xe5cca80 to 0xc4b8f6f 2019-12-16T22:45:19.190 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone2 from 0xd99a07a (overlap 0x3b71205) to 0xbe36cd 2019-12-16T22:45:19.203 INFO:teuthology.orchestra.run.smithi177.stdout:215 trunc from 0x7dcc4ab to 0xd7c5aba 2019-12-16T22:45:19.212 INFO:teuthology.orchestra.run.smithi177.stdout:430 read 0x776c9fb thru 0x777086e (0x3e74 bytes) 2019-12-16T22:45:19.213 INFO:teuthology.orchestra.run.smithi177.stdout:432 read 0x77034e2 thru 0x770c1c6 (0x8ce5 bytes) 2019-12-16T22:45:19.213 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.213 INFO:teuthology.orchestra.run.smithi177.stdout:435 write 0x9d30490 thru 0x9d3bc4a (0xb7bb bytes) 2019-12-16T22:45:19.213 INFO:teuthology.orchestra.run.smithi177.stdout:160 read 0x195e0e thru 0x19c35a (0x654d bytes) 2019-12-16T22:45:19.214 INFO:teuthology.orchestra.run.smithi177.stdout:161 punch from 0x2a63536 to 0x2a6f233, (0xbcfd bytes) 2019-12-16T22:45:19.214 INFO:teuthology.orchestra.run.smithi177.stdout:162 trunc from 0xbefe318 to 0xb99a648 2019-12-16T22:45:19.283 INFO:teuthology.orchestra.run.smithi177.stdout:506 punch from 0x6feee83 to 0x6ff2b50, (0x3ccd bytes) 2019-12-16T22:45:19.283 INFO:teuthology.orchestra.run.smithi177.stdout:509 writesame 0x1e7eb5c thru 0x1e84007 data_size 0x2(0x54ac bytes) 2019-12-16T22:45:19.284 INFO:teuthology.orchestra.run.smithi177.stdout:436 read 0x26be8f2 thru 0x26cb6a7 (0xcdb6 bytes) 2019-12-16T22:45:19.301 INFO:teuthology.orchestra.run.smithi177.stdout:437 trunc from 0xaf54b20 to 0x32fa8c4 2019-12-16T22:45:19.304 INFO:teuthology.orchestra.run.smithi177.stdout:216 write 0x823edb5 thru 0x8241501 (0x274d bytes) 2019-12-16T22:45:19.306 INFO:teuthology.orchestra.run.smithi177.stdout:163 write 0x6fe4ef2 thru 0x6feceab (0x7fba bytes) 2019-12-16T22:45:19.315 INFO:teuthology.orchestra.run.smithi177.stdout:164 read 0x726b2d9 thru 0x7279de5 (0xeb0d bytes) 2019-12-16T22:45:19.318 INFO:teuthology.orchestra.run.smithi177.stdout:165 read 0x7c79f8b thru 0x7c874c6 (0xd53c bytes) 2019-12-16T22:45:19.324 INFO:teuthology.orchestra.run.smithi177.stdout:217 writesame 0x3f8aba9 thru 0x3f97de8 data_size 0x4(0xd240 bytes) 2019-12-16T22:45:19.325 INFO:teuthology.orchestra.run.smithi177.stdout:511 trunc from 0xc4b8f6f to 0x18d331c 2019-12-16T22:45:19.352 INFO:teuthology.orchestra.run.smithi177.stdout:166 writesame 0xca86e1f thru 0xca8a36a data_size 0x12(0x354c bytes) 2019-12-16T22:45:19.352 INFO:teuthology.orchestra.run.smithi177.stdout:219 trunc from 0xd7c5aba to 0x9a4d34d 2019-12-16T22:45:19.356 INFO:teuthology.orchestra.run.smithi177.stdout:167 trunc from 0xca8a36b to 0xca80ef3 2019-12-16T22:45:19.361 INFO:teuthology.orchestra.run.smithi177.stdout:513 read 0xbf4e1c thru 0xbf784f (0x2a34 bytes) 2019-12-16T22:45:19.377 INFO:teuthology.orchestra.run.smithi177.stdout:438 write 0x9b6ce6d thru 0x9b720de (0x5272 bytes) 2019-12-16T22:45:19.388 INFO:teuthology.orchestra.run.smithi177.stdout:440 read 0x1a5f879 thru 0x1a6247d (0x2c05 bytes) 2019-12-16T22:45:19.389 INFO:teuthology.orchestra.run.smithi177.stdout:441 punch from 0x77b531b to 0x77ba80d, (0x54f2 bytes) 2019-12-16T22:45:19.389 INFO:teuthology.orchestra.run.smithi177.stdout:443 read 0x4e1850e thru 0x4e18e47 (0x93a bytes) 2019-12-16T22:45:19.389 INFO:teuthology.orchestra.run.smithi177.stdout:445 punch from 0x59c5455 to 0x59d1bcf, (0xc77a bytes) 2019-12-16T22:45:19.389 INFO:teuthology.orchestra.run.smithi177.stdout:168 read 0xa098f8f thru 0xa09b787 (0x27f9 bytes) 2019-12-16T22:45:19.390 INFO:teuthology.orchestra.run.smithi177.stdout:170 writesame 0x1e6d94d thru 0x1e75d03 data_size 0x1(0x83b7 bytes) 2019-12-16T22:45:19.398 INFO:teuthology.orchestra.run.smithi177.stdout:514 writesame 0x8278c1e thru 0x82826fa data_size 0xf(0x9add bytes) 2019-12-16T22:45:19.414 INFO:teuthology.orchestra.run.smithi177.stdout:515 write 0x448c3be thru 0x449ab02 (0xe745 bytes) 2019-12-16T22:45:19.415 INFO:teuthology.orchestra.run.smithi177.stdout:171 read 0x2927182 thru 0x292883a (0x16b9 bytes) 2019-12-16T22:45:19.416 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.417 INFO:teuthology.orchestra.run.smithi177.stdout:220 write 0xe612ab9 thru 0xe61f3f7 (0xc93f bytes) 2019-12-16T22:45:19.434 INFO:teuthology.orchestra.run.smithi177.stdout:174 trunc from 0xca80ef3 to 0x47bf319 2019-12-16T22:45:19.445 INFO:teuthology.orchestra.run.smithi177.stdout:221 writesame 0xcad561c thru 0xcae082d data_size 0x17(0xb212 bytes) 2019-12-16T22:45:19.451 INFO:teuthology.orchestra.run.smithi177.stdout:447 writesame 0xed5e944 thru 0xed62731 data_size 0x1(0x3dee bytes) 2019-12-16T22:45:19.456 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.461 INFO:teuthology.orchestra.run.smithi177.stdout:452 trunc from 0xed62732 to 0xc336dda 2019-12-16T22:45:19.473 INFO:teuthology.orchestra.run.smithi177.stdout:516 write 0x82d62d0 thru 0x82e0977 (0xa6a8 bytes) 2019-12-16T22:45:19.495 INFO:teuthology.orchestra.run.smithi177.stdout:222 trunc from 0xe61f3f8 to 0xa181f8d 2019-12-16T22:45:19.504 INFO:teuthology.orchestra.run.smithi177.stdout:517 write 0x3ffd6c thru 0x40d435 (0xd6ca bytes) 2019-12-16T22:45:19.505 INFO:teuthology.orchestra.run.smithi177.stdout:453 punch from 0x33e02f5 to 0x33ef3b6, (0xf0c1 bytes) 2019-12-16T22:45:19.505 INFO:teuthology.orchestra.run.smithi177.stdout:454 write 0x541e73e thru 0x542d6d9 (0xef9c bytes) 2019-12-16T22:45:19.534 INFO:teuthology.orchestra.run.smithi177.stdout:457 write 0x1c5c3db thru 0x1c651d5 (0x8dfb bytes) 2019-12-16T22:45:19.535 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe8d9928 2019-12-16T22:45:19.540 INFO:teuthology.orchestra.run.smithi177.stdout:176 write 0xddf59bf thru 0xddfceb4 (0x74f6 bytes) 2019-12-16T22:45:19.542 INFO:teuthology.orchestra.run.smithi177.stdout:458 trunc from 0xc336dda to 0xd1537c4 2019-12-16T22:45:19.545 INFO:teuthology.orchestra.run.smithi177.stdout:177 punch from 0x74e2538 to 0x74e3f62, (0x1a2a bytes) 2019-12-16T22:45:19.545 INFO:teuthology.orchestra.run.smithi177.stdout:183 read 0x9fd31db thru 0x9fdbdd3 (0x8bf9 bytes) 2019-12-16T22:45:19.545 INFO:teuthology.orchestra.run.smithi177.stdout:188 punch from 0x877076b to 0x877c3f5, (0xbc8a bytes) 2019-12-16T22:45:19.546 INFO:teuthology.orchestra.run.smithi177.stdout:190 write 0xa5a66e9 thru 0xa5af08e (0x89a6 bytes) 2019-12-16T22:45:19.546 INFO:teuthology.orchestra.run.smithi177.stdout:518 trunc from 0x82e0978 to 0xe8d9928 2019-12-16T22:45:19.551 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.552 INFO:teuthology.orchestra.run.smithi177.stdout:192 read 0x4733afc thru 0x473547e (0x1983 bytes) 2019-12-16T22:45:19.552 INFO:teuthology.orchestra.run.smithi177.stdout:193 punch from 0xd29184a to 0xd29e033, (0xc7e9 bytes) 2019-12-16T22:45:19.552 INFO:teuthology.orchestra.run.smithi177.stdout:194 write 0x8fb6545 thru 0x8fb7ff5 (0x1ab1 bytes) 2019-12-16T22:45:19.556 INFO:teuthology.orchestra.run.smithi177.stdout:196 writesame 0xc87eb9c thru 0xc889a9b data_size 0x38(0xaf00 bytes) 2019-12-16T22:45:19.562 INFO:teuthology.orchestra.run.smithi177.stdout:224 trunc from 0xa181f8d to 0x5f1913b 2019-12-16T22:45:19.563 INFO:teuthology.orchestra.run.smithi177.stdout:197 write 0xaa0e277 thru 0xaa147e8 (0x6572 bytes) 2019-12-16T22:45:19.568 INFO:teuthology.orchestra.run.smithi177.stdout:459 write 0x22fffd0 thru 0x2301fe2 (0x2013 bytes) 2019-12-16T22:45:19.573 INFO:teuthology.orchestra.run.smithi177.stdout:519 read 0xdde5980 thru 0xdded023 (0x76a4 bytes) 2019-12-16T22:45:19.573 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.573 INFO:teuthology.orchestra.run.smithi177.stdout:523 punch from 0x10c172f to 0x10c1b34, (0x405 bytes) 2019-12-16T22:45:19.573 INFO:teuthology.orchestra.run.smithi177.stdout:524 write 0x2c3c1f1 thru 0x2c446a8 (0x84b8 bytes) 2019-12-16T22:45:19.584 INFO:teuthology.orchestra.run.smithi177.stdout:460 punch from 0xc0ca53d to 0xc0d8eb3, (0xe976 bytes) 2019-12-16T22:45:19.585 INFO:teuthology.orchestra.run.smithi177.stdout:461 write 0xa841622 thru 0xa847d58 (0x6737 bytes) 2019-12-16T22:45:19.602 INFO:teuthology.orchestra.run.smithi177.stdout:199 trunc from 0xddfceb5 to 0xf0642 2019-12-16T22:45:19.604 INFO:teuthology.orchestra.run.smithi177.stdout:525 trunc from 0xe8d9928 to 0x6315d7e 2019-12-16T22:45:19.614 INFO:teuthology.orchestra.run.smithi177.stdout:462 read 0x6d2383d thru 0x6d2f92e (0xc0f2 bytes) 2019-12-16T22:45:19.615 INFO:teuthology.orchestra.run.smithi177.stdout:463 write 0x8d07657 thru 0x8d0eb7f (0x7529 bytes) 2019-12-16T22:45:19.619 INFO:teuthology.orchestra.run.smithi177.stdout:225 punch from 0x47d38bc to 0x47de95c, (0xb0a0 bytes) 2019-12-16T22:45:19.619 INFO:teuthology.orchestra.run.smithi177.stdout:226 writesame 0x299fc29 thru 0x29aa546 data_size 0x1(0xa91e bytes) 2019-12-16T22:45:19.652 INFO:teuthology.orchestra.run.smithi177.stdout:464 punch from 0xc2e71dc to 0xc2f2fce, (0xbdf2 bytes) 2019-12-16T22:45:19.653 INFO:teuthology.orchestra.run.smithi177.stdout:466 writesame 0x6d432c4 thru 0x6d514dc data_size 0x1(0xe219 bytes) 2019-12-16T22:45:19.671 INFO:teuthology.orchestra.run.smithi177.stdout:201 punch from 0xc6ab1 to 0xc81f0, (0x173f bytes) 2019-12-16T22:45:19.672 INFO:teuthology.orchestra.run.smithi177.stdout:202 read 0xddc4b thru 0xe8957 (0xad0d bytes) 2019-12-16T22:45:19.674 INFO:teuthology.orchestra.run.smithi177.stdout:203 punch from 0x1d872 to 0x1d9a2, (0x130 bytes) 2019-12-16T22:45:19.674 INFO:teuthology.orchestra.run.smithi177.stdout:204 read 0x303ba thru 0x3125f (0xea6 bytes) 2019-12-16T22:45:19.675 INFO:teuthology.orchestra.run.smithi177.stdout:206 read 0x47666 thru 0x51ecc (0xa867 bytes) 2019-12-16T22:45:19.676 INFO:teuthology.orchestra.run.smithi177.stdout:207 read 0x451ad thru 0x47f28 (0x2d7c bytes) 2019-12-16T22:45:19.682 INFO:teuthology.orchestra.run.smithi177.stdout:227 trunc from 0x5f1913b to 0xca0f468 2019-12-16T22:45:19.691 INFO:teuthology.orchestra.run.smithi177.stdout:526 read 0x4c9e5df thru 0x4ca2097 (0x3ab9 bytes) 2019-12-16T22:45:19.699 INFO:teuthology.orchestra.run.smithi177.stdout:467 trunc from 0xd1537c4 to 0xd038fb5 2019-12-16T22:45:19.705 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #1, image image_cluster1.client.mirror.3-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent2 2019-12-16T22:45:19.707 INFO:teuthology.orchestra.run.smithi177.stdout:208 writesame 0x4dcdf73 thru 0x4dd3094 data_size 0x1f(0x5122 bytes) 2019-12-16T22:45:19.711 INFO:teuthology.orchestra.run.smithi177.stdout:209 punch from 0x1d4d79b to 0x1d5c80e, (0xf073 bytes) 2019-12-16T22:45:19.711 INFO:teuthology.orchestra.run.smithi177.stdout:210 write 0x1314fd5 thru 0x1321a88 (0xcab4 bytes) 2019-12-16T22:45:19.712 INFO:teuthology.orchestra.run.smithi177.stdout:229 punch from 0x83887f0 to 0x8397475, (0xec85 bytes) 2019-12-16T22:45:19.712 INFO:teuthology.orchestra.run.smithi177.stdout:230 read 0x27bbef9 thru 0x27c11df (0x52e7 bytes) 2019-12-16T22:45:19.713 INFO:teuthology.orchestra.run.smithi177.stdout:231 write 0x52fcb8f thru 0x5307661 (0xaad3 bytes) 2019-12-16T22:45:19.718 INFO:teuthology.orchestra.run.smithi177.stdout:211 write 0x3d0a131 thru 0x3d133f9 (0x92c9 bytes) 2019-12-16T22:45:19.722 INFO:teuthology.orchestra.run.smithi177.stdout:468 read 0x4b68726 thru 0x4b72a8d (0xa368 bytes) 2019-12-16T22:45:19.722 INFO:teuthology.orchestra.run.smithi177.stdout:471 write 0x2301edc thru 0x23093cc (0x74f1 bytes) 2019-12-16T22:45:19.724 INFO:teuthology.orchestra.run.smithi177.stdout:527 write 0xdd0906a thru 0xdd0ec78 (0x5c0f bytes) 2019-12-16T22:45:19.733 INFO:teuthology.orchestra.run.smithi177.stdout:213 punch from 0x2225f67 to 0x2230169, (0xa202 bytes) 2019-12-16T22:45:19.735 INFO:teuthology.orchestra.run.smithi177.stdout:528 read 0x841267f thru 0x84201d7 (0xdb59 bytes) 2019-12-16T22:45:19.735 INFO:teuthology.orchestra.run.smithi177.stdout:529 write 0xbc1f09d thru 0xbc28541 (0x94a5 bytes) 2019-12-16T22:45:19.737 INFO:teuthology.orchestra.run.smithi177.stdout:233 read 0xa63e57b thru 0xa64a396 (0xbe1c bytes) 2019-12-16T22:45:19.737 INFO:teuthology.orchestra.run.smithi177.stdout:234 write 0x1661c95 thru 0x16682f9 (0x6665 bytes) 2019-12-16T22:45:19.750 INFO:teuthology.orchestra.run.smithi177.stdout:473 trunc from 0xd038fb5 to 0x357b6ab 2019-12-16T22:45:19.769 INFO:teuthology.orchestra.run.smithi177.stdout:214 writesame 0xbafde8e thru 0xbb0547b data_size 0x5(0x75ee bytes) 2019-12-16T22:45:19.771 INFO:teuthology.orchestra.run.smithi177.stdout:530 trunc from 0xdd0ec79 to 0x4d858ab 2019-12-16T22:45:19.779 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.779 INFO:teuthology.orchestra.run.smithi177.stdout:237 punch from 0x3b52bb4 to 0x3b5cad9, (0x9f25 bytes) 2019-12-16T22:45:19.779 INFO:teuthology.orchestra.run.smithi177.stdout:238 writesame 0x85b2457 thru 0x85bd2f0 data_size 0x1(0xae9a bytes) 2019-12-16T22:45:19.782 INFO:teuthology.orchestra.run.smithi177.stdout:474 write 0x1617c32 thru 0x16268c5 (0xec94 bytes) 2019-12-16T22:45:19.797 INFO:teuthology.orchestra.run.smithi177.stdout:215 write 0xc0dc4d9 thru 0xc0ebc72 (0xf79a bytes) 2019-12-16T22:45:19.822 INFO:teuthology.orchestra.run.smithi177.stdout:216 read 0x7f1f054 thru 0x7f1fe65 (0xe12 bytes) 2019-12-16T22:45:19.822 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.823 INFO:teuthology.orchestra.run.smithi177.stdout:218 write 0xb314af0 thru 0xb31c402 (0x7913 bytes) 2019-12-16T22:45:19.826 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.826 INFO:teuthology.orchestra.run.smithi177.stdout:240 read 0x1938076 thru 0x19423be (0xa349 bytes) 2019-12-16T22:45:19.826 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.827 INFO:teuthology.orchestra.run.smithi177.stdout:242 write 0x81b1512 thru 0x81b1623 (0x112 bytes) 2019-12-16T22:45:19.827 INFO:teuthology.orchestra.run.smithi177.stdout:531 trunc from 0x4d858ab to 0xdb57a05 2019-12-16T22:45:19.828 INFO:teuthology.orchestra.run.smithi177.stdout:220 read 0x95cb344 thru 0x95d689a (0xb557 bytes) 2019-12-16T22:45:19.833 INFO:teuthology.orchestra.run.smithi177.stdout:476 write 0xca7fe9e thru 0xca850be (0x5221 bytes) 2019-12-16T22:45:19.834 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.834 INFO:teuthology.orchestra.run.smithi177.stdout:244 punch from 0xbab68a9 to 0xbab9413, (0x2b6a bytes) 2019-12-16T22:45:19.834 INFO:teuthology.orchestra.run.smithi177.stdout:245 writesame 0x59cb8d6 thru 0x59cf29b data_size 0x22(0x39c6 bytes) 2019-12-16T22:45:19.849 INFO:teuthology.orchestra.run.smithi177.stdout:246 punch from 0x40ab20e to 0x40b1554, (0x6346 bytes) 2019-12-16T22:45:19.849 INFO:teuthology.orchestra.run.smithi177.stdout:247 write 0x355a5dc thru 0x3566ed2 (0xc8f7 bytes) 2019-12-16T22:45:19.850 INFO:teuthology.orchestra.run.smithi177.stdout:532 write 0x8048e19 thru 0x80567c4 (0xd9ac bytes) 2019-12-16T22:45:19.856 INFO:teuthology.orchestra.run.smithi177.stdout:481 trunc from 0xca850bf to 0xc250e37 2019-12-16T22:45:19.859 INFO:teuthology.orchestra.run.smithi177.stdout:221 write 0xc8646d2 thru 0xc871fbc (0xd8eb bytes) 2019-12-16T22:45:19.860 INFO:teuthology.orchestra.run.smithi177.stdout:533 writesame 0x9196130 thru 0x91a1706 data_size 0x3b(0xb5d7 bytes) 2019-12-16T22:45:19.871 INFO:teuthology.orchestra.run.smithi177.stdout:249 punch from 0x421660f to 0x4225841, (0xf232 bytes) 2019-12-16T22:45:19.873 INFO:teuthology.orchestra.run.smithi177.stdout:251 read 0xace62a1 thru 0xacf4ad0 (0xe830 bytes) 2019-12-16T22:45:19.873 INFO:teuthology.orchestra.run.smithi177.stdout:252 read 0x1999cac thru 0x199d610 (0x3965 bytes) 2019-12-16T22:45:19.873 INFO:teuthology.orchestra.run.smithi177.stdout:253 punch from 0x268acc5 to 0x268ca1f, (0x1d5a bytes) 2019-12-16T22:45:19.873 INFO:teuthology.orchestra.run.smithi177.stdout:254 writesame 0xa36e4eb thru 0xa36ee4a data_size 0x20(0x960 bytes) 2019-12-16T22:45:19.873 INFO:teuthology.orchestra.run.smithi177.stdout:535 write 0xb1feeb5 thru 0xb1ff001 (0x14d bytes) 2019-12-16T22:45:19.879 INFO:teuthology.orchestra.run.smithi177.stdout:255 trunc from 0xca0f468 to 0xc4817ae 2019-12-16T22:45:19.880 INFO:teuthology.orchestra.run.smithi177.stdout:536 punch from 0x8ee362e to 0x8ef276e, (0xf140 bytes) 2019-12-16T22:45:19.885 INFO:teuthology.orchestra.run.smithi177.stdout:537 trunc from 0xdb57a05 to 0xb4bfb99 2019-12-16T22:45:19.896 INFO:teuthology.orchestra.run.smithi177.stdout:482 writesame 0xb19027f thru 0xb191c87 data_size 0x5(0x1a09 bytes) 2019-12-16T22:45:19.905 INFO:teuthology.orchestra.run.smithi177.stdout:483 write 0xbf2bb36 thru 0xbf37eb7 (0xc382 bytes) 2019-12-16T22:45:19.905 INFO:teuthology.orchestra.run.smithi177.stdout:223 write 0xd87ce1e thru 0xd884425 (0x7608 bytes) 2019-12-16T22:45:19.905 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.906 INFO:teuthology.orchestra.run.smithi177.stdout:257 read 0x3aae469 thru 0x3abb5e4 (0xd17c bytes) 2019-12-16T22:45:19.906 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.906 INFO:teuthology.orchestra.run.smithi177.stdout:264 read 0x54eef05 thru 0x54f21ef (0x32eb bytes) 2019-12-16T22:45:19.912 INFO:teuthology.orchestra.run.smithi177.stdout:224 read 0x799912b thru 0x79a57f9 (0xc6cf bytes) 2019-12-16T22:45:19.912 INFO:teuthology.orchestra.run.smithi177.stdout:484 write 0x4b3093b thru 0x4b39a38 (0x90fe bytes) 2019-12-16T22:45:19.913 INFO:teuthology.orchestra.run.smithi177.stdout:538 write 0x3addf9a thru 0x3aebd07 (0xdd6e bytes) 2019-12-16T22:45:19.913 INFO:teuthology.orchestra.run.smithi177.stdout:225 read 0x287827b thru 0x287ee3f (0x6bc5 bytes) 2019-12-16T22:45:19.914 INFO:teuthology.orchestra.run.smithi177.stdout:266 trunc from 0xc4817ae to 0x7f3b0fc 2019-12-16T22:45:19.915 INFO:teuthology.orchestra.run.smithi177.stdout:226 writesame 0xa71316a thru 0xa71a89c data_size 0x11(0x7733 bytes) 2019-12-16T22:45:19.926 INFO:teuthology.orchestra.run.smithi177.stdout:227 write 0xd288e3a thru 0xd28a599 (0x1760 bytes) 2019-12-16T22:45:19.929 INFO:teuthology.orchestra.run.smithi177.stdout:485 punch from 0xa8cd0ca to 0xa8d98e8, (0xc81e bytes) 2019-12-16T22:45:19.929 INFO:teuthology.orchestra.run.smithi177.stdout:490 write 0xa330182 thru 0xa338244 (0x80c3 bytes) 2019-12-16T22:45:19.930 INFO:teuthology.orchestra.run.smithi177.stdout:539 punch from 0x4baf847 to 0x4bb70c7, (0x7880 bytes) 2019-12-16T22:45:19.930 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.935 INFO:teuthology.orchestra.run.smithi177.stdout:228 trunc from 0xd884426 to 0xc39c541 2019-12-16T22:45:19.937 INFO:teuthology.orchestra.run.smithi177.stdout:492 write 0xa0df0b1 thru 0xa0e2e04 (0x3d54 bytes) 2019-12-16T22:45:19.943 INFO:teuthology.orchestra.run.smithi177.stdout:541 trunc from 0xb4bfb99 to 0x393d994 2019-12-16T22:45:19.964 INFO:teuthology.orchestra.run.smithi177.stdout:229 write 0xad7a4d8 thru 0xad86363 (0xbe8c bytes) 2019-12-16T22:45:19.969 INFO:teuthology.orchestra.run.smithi177.stdout:267 write 0x39420d2 thru 0x394ae99 (0x8dc8 bytes) 2019-12-16T22:45:19.979 INFO:teuthology.orchestra.run.smithi177.stdout:230 read 0x7712147 thru 0x771271a (0x5d4 bytes) 2019-12-16T22:45:19.980 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.980 INFO:teuthology.orchestra.run.smithi177.stdout:234 writesame 0xae3d542 thru 0xae3e11f data_size 0x1f(0xbde bytes) 2019-12-16T22:45:19.983 INFO:teuthology.orchestra.run.smithi177.stdout:236 read 0x2f0340 thru 0x2f3323 (0x2fe4 bytes) 2019-12-16T22:45:19.984 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:19.984 INFO:teuthology.orchestra.run.smithi177.stdout:239 write 0xaf082d2 thru 0xaf10f1a (0x8c49 bytes) 2019-12-16T22:45:19.984 INFO:teuthology.orchestra.run.smithi177.stdout:493 trunc from 0xc250e37 to 0x502f4bb 2019-12-16T22:45:19.985 INFO:teuthology.orchestra.run.smithi177.stdout:268 punch from 0x452270a to 0x452f79e, (0xd094 bytes) 2019-12-16T22:45:19.985 INFO:teuthology.orchestra.run.smithi177.stdout:269 read 0x56a814d thru 0x56abe7c (0x3d30 bytes) 2019-12-16T22:45:19.985 INFO:teuthology.orchestra.run.smithi177.stdout:270 write 0x69e9c4e thru 0x69ee1f2 (0x45a5 bytes) 2019-12-16T22:45:20.003 INFO:teuthology.orchestra.run.smithi177.stdout:543 read 0x1f05559 thru 0x1f08722 (0x31ca bytes) 2019-12-16T22:45:20.005 INFO:teuthology.orchestra.run.smithi177.stdout:271 punch from 0x32bd5bf to 0x32c23a1, (0x4de2 bytes) 2019-12-16T22:45:20.020 INFO:teuthology.orchestra.run.smithi177.stdout:241 write 0xcb907a7 thru 0xcb936c9 (0x2f23 bytes) 2019-12-16T22:45:20.025 INFO:teuthology.orchestra.run.smithi177.stdout:242 punch from 0x39bf0d3 to 0x39cb063, (0xbf90 bytes) 2019-12-16T22:45:20.025 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.025 INFO:teuthology.orchestra.run.smithi177.stdout:244 write 0x185a275 thru 0x1861f43 (0x7ccf bytes) 2019-12-16T22:45:20.031 INFO:teuthology.orchestra.run.smithi177.stdout:545 write 0x83e9d4b thru 0x83f29e2 (0x8c98 bytes) 2019-12-16T22:45:20.039 INFO:teuthology.orchestra.run.smithi177.stdout:245 write 0xb4821 thru 0xba4f8 (0x5cd8 bytes) 2019-12-16T22:45:20.040 INFO:teuthology.orchestra.run.smithi177.stdout:274 write 0xacf2aee thru 0xacf2d45 (0x258 bytes) 2019-12-16T22:45:20.051 INFO:teuthology.orchestra.run.smithi177.stdout:275 read 0x6e44e20 thru 0x6e4f83b (0xaa1c bytes) 2019-12-16T22:45:20.054 INFO:teuthology.orchestra.run.smithi177.stdout:277 trunc from 0xacf2d46 to 0x9775065 2019-12-16T22:45:20.055 INFO:teuthology.orchestra.run.smithi177.stdout:494 writesame 0x6d7de5f thru 0x6d83f0d data_size 0x1(0x60af bytes) 2019-12-16T22:45:20.065 INFO:teuthology.orchestra.run.smithi177.stdout:498 write 0x5e093a3 thru 0x5e0c494 (0x30f2 bytes) 2019-12-16T22:45:20.072 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.072 INFO:teuthology.orchestra.run.smithi177.stdout:500 trunc from 0x6d83f0e to 0x6b09a38 2019-12-16T22:45:20.075 INFO:teuthology.orchestra.run.smithi177.stdout:546 writesame 0xbac522e thru 0xbac8ee2 data_size 0x1(0x3cb5 bytes) 2019-12-16T22:45:20.077 INFO:teuthology.orchestra.run.smithi177.stdout:547 write 0x43afaa4 thru 0x43b0e4c (0x13a9 bytes) 2019-12-16T22:45:20.087 INFO:teuthology.orchestra.run.smithi177.stdout:247 writesame 0xce29bd5 thru 0xce2b0f4 data_size 0x8(0x1520 bytes) 2019-12-16T22:45:20.087 INFO:teuthology.orchestra.run.smithi177.stdout:548 read 0x7812c50 thru 0x781e0b8 (0xb469 bytes) 2019-12-16T22:45:20.087 INFO:teuthology.orchestra.run.smithi177.stdout:549 writesame 0x9e7afb7 thru 0x9e84698 data_size 0x59(0x96e2 bytes) 2019-12-16T22:45:20.090 INFO:teuthology.orchestra.run.smithi177.stdout:248 write 0x117ee3b thru 0x118e35c (0xf522 bytes) 2019-12-16T22:45:20.095 INFO:teuthology.orchestra.run.smithi177.stdout:501 punch from 0x2054783 to 0x2056c0f, (0x248c bytes) 2019-12-16T22:45:20.100 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.100 INFO:teuthology.orchestra.run.smithi177.stdout:250 read 0x96bdc80 thru 0x96c0562 (0x28e3 bytes) 2019-12-16T22:45:20.101 INFO:teuthology.orchestra.run.smithi177.stdout:253 write 0x2cfa07 thru 0x2d7ad6 (0x80d0 bytes) 2019-12-16T22:45:20.101 INFO:teuthology.orchestra.run.smithi177.stdout:550 write 0xa9c0ca3 thru 0xa9cf4fa (0xe858 bytes) 2019-12-16T22:45:20.101 INFO:teuthology.orchestra.run.smithi177.stdout:278 read 0x722d4fa thru 0x723a88c (0xd393 bytes) 2019-12-16T22:45:20.102 INFO:teuthology.orchestra.run.smithi177.stdout:279 read 0x126f711 thru 0x1271d1c (0x260c bytes) 2019-12-16T22:45:20.102 INFO:teuthology.orchestra.run.smithi177.stdout:280 clone 3 order 21 su 524288 sc 12 2019-12-16T22:45:20.109 INFO:teuthology.orchestra.run.smithi177.stdout:504 trunc from 0x6b09a38 to 0xc37ee5 2019-12-16T22:45:20.116 INFO:teuthology.orchestra.run.smithi177.stdout:327 write 0x1314d3b thru 0x131c0dc (0x73a2 bytes) 2019-12-16T22:45:20.129 INFO:teuthology.orchestra.run.smithi177.stdout:551 clone 3 order 19 su 262144 sc 5 2019-12-16T22:45:20.161 INFO:teuthology.orchestra.run.smithi177.stdout:254 write 0x3f55d20 thru 0x3f5a0bc (0x439d bytes) 2019-12-16T22:45:20.166 INFO:teuthology.orchestra.run.smithi177.stdout:255 read 0x777c5f thru 0x77998a (0x1d2c bytes) 2019-12-16T22:45:20.167 INFO:teuthology.orchestra.run.smithi177.stdout:257 writesame 0xaa2b8c0 thru 0xaa37680 data_size 0x1(0xbdc1 bytes) 2019-12-16T22:45:20.197 INFO:teuthology.orchestra.run.smithi177.stdout:258 writesame 0x4cff644 thru 0x4d0931e data_size 0x5(0x9cdb bytes) 2019-12-16T22:45:20.230 INFO:teuthology.orchestra.run.smithi177.stdout:261 trunc from 0xce2b0f5 to 0x222f7fa 2019-12-16T22:45:20.294 INFO:teuthology.orchestra.run.smithi177.stdout:506 write 0xa3d22ce thru 0xa3d900d (0x6d40 bytes) 2019-12-16T22:45:20.301 INFO:teuthology.orchestra.run.smithi177.stdout:507 read 0x8c1ffd3 thru 0x8c26694 (0x66c2 bytes) 2019-12-16T22:45:20.301 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.301 INFO:teuthology.orchestra.run.smithi177.stdout:511 writesame 0x3e24f0a thru 0x3e2908f data_size 0x1(0x4186 bytes) 2019-12-16T22:45:20.312 INFO:teuthology.orchestra.run.smithi177.stdout:262 write 0x9fde49f thru 0x9feb966 (0xd4c8 bytes) 2019-12-16T22:45:20.320 INFO:teuthology.orchestra.run.smithi177.stdout:263 read 0x3098bb9 thru 0x30a0b1b (0x7f63 bytes) 2019-12-16T22:45:20.320 INFO:teuthology.orchestra.run.smithi177.stdout:264 read 0x7341d3c thru 0x7346c93 (0x4f58 bytes) 2019-12-16T22:45:20.321 INFO:teuthology.orchestra.run.smithi177.stdout:513 read 0xea2c6 thru 0xf8bf6 (0xe931 bytes) 2019-12-16T22:45:20.321 INFO:teuthology.orchestra.run.smithi177.stdout:514 read 0x7e3069f thru 0x7e376cb (0x702d bytes) 2019-12-16T22:45:20.322 INFO:teuthology.orchestra.run.smithi177.stdout:515 write 0x75c8f31 thru 0x75ce919 (0x59e9 bytes) 2019-12-16T22:45:20.322 INFO:teuthology.orchestra.run.smithi177.stdout:265 trunc from 0x9feb967 to 0xaec0078 2019-12-16T22:45:20.330 INFO:teuthology.orchestra.run.smithi177.stdout:516 read 0x74367a2 thru 0x743b12a (0x4989 bytes) 2019-12-16T22:45:20.331 INFO:teuthology.orchestra.run.smithi177.stdout:518 write 0x206f38f thru 0x2076201 (0x6e73 bytes) 2019-12-16T22:45:20.337 INFO:teuthology.orchestra.run.smithi177.stdout:519 clone 3 order 22 su 262144 sc 2 2019-12-16T22:45:20.346 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.346 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.347 INFO:teuthology.orchestra.run.smithi177.stdout:269 flatten 2019-12-16T22:45:20.359 INFO:teuthology.orchestra.run.smithi177.stdout:270 punch from 0x39c0487 to 0x39c35c2, (0x313b bytes) 2019-12-16T22:45:20.369 INFO:teuthology.orchestra.run.smithi177.stdout:271 trunc from 0xaec0078 to 0x73dc82b 2019-12-16T22:45:20.455 INFO:teuthology.orchestra.run.smithi177.stdout:328 write 0x6e8d85d thru 0x6e99d2b (0xc4cf bytes) 2019-12-16T22:45:20.477 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.477 INFO:teuthology.orchestra.run.smithi177.stdout:334 write 0x1aa9c1a thru 0x1ab704f (0xd436 bytes) 2019-12-16T22:45:20.485 INFO:teuthology.orchestra.run.smithi177.stdout:335 read 0x4955b03 thru 0x495932f (0x382d bytes) 2019-12-16T22:45:20.496 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.496 INFO:teuthology.orchestra.run.smithi177.stdout:336 trunc from 0xd99a07a to 0xa14de50 2019-12-16T22:45:20.539 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.539 INFO:teuthology.orchestra.run.smithi177.stdout:338 read 0x314bd3d thru 0x314e943 (0x2c07 bytes) 2019-12-16T22:45:20.544 INFO:teuthology.orchestra.run.smithi177.stdout:273 writesame 0xe7d30d6 thru 0xe7d8c20 data_size 0x1(0x5b4b bytes) 2019-12-16T22:45:20.548 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.548 INFO:teuthology.orchestra.run.smithi177.stdout:276 punch from 0x5c79bef to 0x5c7a3c9, (0x7da bytes) 2019-12-16T22:45:20.549 INFO:teuthology.orchestra.run.smithi177.stdout:277 write 0xd111533 thru 0xd118f69 (0x7a37 bytes) 2019-12-16T22:45:20.564 INFO:teuthology.orchestra.run.smithi177.stdout:339 write 0xc925e16 thru 0xc929848 (0x3a33 bytes) 2019-12-16T22:45:20.570 INFO:teuthology.orchestra.run.smithi177.stdout:340 read 0x8b0f0a1 thru 0x8b18bd0 (0x9b30 bytes) 2019-12-16T22:45:20.573 INFO:teuthology.orchestra.run.smithi177.stdout:278 trunc from 0xe7d8c21 to 0x5c1a726 2019-12-16T22:45:20.581 INFO:teuthology.orchestra.run.smithi177.stdout:341 trunc from 0xc929849 to 0x71ed71a 2019-12-16T22:45:20.641 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.653 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.653 INFO:teuthology.orchestra.run.smithi177.stdout:282 read 0x1e88fd7 thru 0x1e8c359 (0x3383 bytes) 2019-12-16T22:45:20.654 INFO:teuthology.orchestra.run.smithi177.stdout:283 write 0x310262b thru 0x3108515 (0x5eeb bytes) 2019-12-16T22:45:20.665 INFO:teuthology.orchestra.run.smithi177.stdout:284 read 0xc15ee7 thru 0xc18793 (0x28ad bytes) 2019-12-16T22:45:20.665 INFO:teuthology.orchestra.run.smithi177.stdout:285 write 0x183262f thru 0x183350b (0xedd bytes) 2019-12-16T22:45:20.671 INFO:teuthology.orchestra.run.smithi177.stdout:286 write 0x4b8ea34 thru 0x4b8efc2 (0x58f bytes) 2019-12-16T22:45:20.671 INFO:teuthology.orchestra.run.smithi177.stdout:345 write 0x8d6b7ba thru 0x8d7b783 (0xffca bytes) 2019-12-16T22:45:20.683 INFO:teuthology.orchestra.run.smithi177.stdout:287 trunc from 0x5c1a726 to 0x48a1d83 2019-12-16T22:45:20.685 INFO:teuthology.orchestra.run.smithi177.stdout:347 write 0x44e4231 thru 0x44ead07 (0x6ad7 bytes) 2019-12-16T22:45:20.712 INFO:teuthology.orchestra.run.smithi177.stdout:350 trunc from 0x8d7b784 to 0x113992c 2019-12-16T22:45:20.800 INFO:teuthology.orchestra.run.smithi177.stdout:290 writesame 0xe57ebfe thru 0xe584e37 data_size 0x63(0x623a bytes) 2019-12-16T22:45:20.805 INFO:teuthology.orchestra.run.smithi177.stdout:293 write 0xda771cb thru 0xda7a642 (0x3478 bytes) 2019-12-16T22:45:20.822 INFO:teuthology.orchestra.run.smithi177.stdout:294 trunc from 0xe584e38 to 0xc2e69ae 2019-12-16T22:45:20.859 INFO:teuthology.orchestra.run.smithi177.stdout:297 trunc from 0xc2e69ae to 0x6492555 2019-12-16T22:45:20.882 INFO:teuthology.orchestra.run.smithi177.stdout:298 punch from 0x2d4f6de to 0x2d5c6c0, (0xcfe2 bytes) 2019-12-16T22:45:20.912 INFO:teuthology.orchestra.run.smithi177.stdout:299 write 0x916fbf7 thru 0x917cb39 (0xcf43 bytes) 2019-12-16T22:45:20.921 INFO:teuthology.orchestra.run.smithi177.stdout:300 write 0x776a8cd thru 0x776d177 (0x28ab bytes) 2019-12-16T22:45:20.929 INFO:teuthology.orchestra.run.smithi177.stdout:301 write 0x8cd3b95 thru 0x8cdf00e (0xb47a bytes) 2019-12-16T22:45:20.929 INFO:teuthology.orchestra.run.smithi177.stdout:303 read 0x4465792 thru 0x4469817 (0x4086 bytes) 2019-12-16T22:45:20.971 INFO:teuthology.orchestra.run.smithi177.stdout:304 write 0xee13314 thru 0xee1746e (0x415b bytes) 2019-12-16T22:45:20.975 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.975 INFO:teuthology.orchestra.run.smithi177.stdout:307 write 0x62be8bc thru 0x62c7712 (0x8e57 bytes) 2019-12-16T22:45:20.979 INFO:teuthology.orchestra.run.smithi177.stdout:352 punch from 0xef96d1 to 0xf054ec, (0xbe1b bytes) 2019-12-16T22:45:20.979 INFO:teuthology.orchestra.run.smithi177.stdout:354 read 0x8873d0 thru 0x88a6a7 (0x32d8 bytes) 2019-12-16T22:45:20.980 INFO:teuthology.orchestra.run.smithi177.stdout:310 read 0xbd9e006 thru 0xbd9e9e8 (0x9e3 bytes) 2019-12-16T22:45:20.980 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.980 INFO:teuthology.orchestra.run.smithi177.stdout:357 read 0x98b31a thru 0x98b97a (0x661 bytes) 2019-12-16T22:45:20.981 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:20.981 INFO:teuthology.orchestra.run.smithi177.stdout:359 trunc from 0x113992c to 0x112f2a0 2019-12-16T22:45:21.008 INFO:teuthology.orchestra.run.smithi177.stdout:311 trunc from 0xee1746f to 0xcdb2 2019-12-16T22:45:21.008 INFO:teuthology.orchestra.run.smithi177.stdout:360 read 0xe8cf6 thru 0xeaa33 (0x1d3e bytes) 2019-12-16T22:45:21.053 INFO:teuthology.orchestra.run.smithi177.stdout:361 write 0xb1bff66 thru 0xb1c43a2 (0x443d bytes) 2019-12-16T22:45:21.086 INFO:teuthology.orchestra.run.smithi177.stdout:362 write 0xd0aec31 thru 0xd0b26e0 (0x3ab0 bytes) 2019-12-16T22:45:21.093 INFO:teuthology.orchestra.run.smithi177.stdout:363 write 0xb790058 thru 0xb799c64 (0x9c0d bytes) 2019-12-16T22:45:21.102 INFO:teuthology.orchestra.run.smithi177.stdout:364 read 0xb33938e thru 0xb339d09 (0x97c bytes) 2019-12-16T22:45:21.103 INFO:teuthology.orchestra.run.smithi177.stdout:365 read 0x92531eb thru 0x9258c5c (0x5a72 bytes) 2019-12-16T22:45:21.103 INFO:teuthology.orchestra.run.smithi177.stdout:366 punch from 0x4eaf431 to 0x4eb7304, (0x7ed3 bytes) 2019-12-16T22:45:21.104 INFO:teuthology.orchestra.run.smithi177.stdout:367 writesame 0xc1d3983 thru 0xc1df05c data_size 0x3e(0xb6da bytes) 2019-12-16T22:45:21.123 INFO:teuthology.orchestra.run.smithi177.stdout:368 read 0x9f91c90 thru 0x9fa1665 (0xf9d6 bytes) 2019-12-16T22:45:21.134 INFO:teuthology.orchestra.run.smithi177.stdout:369 trunc from 0xd0b26e1 to 0x58d81ed 2019-12-16T22:45:21.140 INFO:teuthology.orchestra.run.smithi177.stdout:312 write 0xa312b1 thru 0xa35578 (0x42c8 bytes) 2019-12-16T22:45:21.159 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.5-clone2 2019-12-16T22:45:21.162 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone2 from 0xa3d900e (overlap 0x3b53cc) to 0x0 2019-12-16T22:45:21.163 INFO:teuthology.orchestra.run.smithi177.stdout:372 write 0x2e3d6a9 thru 0x2e42fbb (0x5913 bytes) 2019-12-16T22:45:21.169 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.174 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone2 from 0xbac8ee3 (overlap 0x1d5c2c) to 0x0 2019-12-16T22:45:21.177 INFO:teuthology.orchestra.run.smithi177.stdout:375 trunc from 0x58d81ed to 0x8dd6505 2019-12-16T22:45:21.191 INFO:teuthology.orchestra.run.smithi177.stdout:126 writesame 0x362c33b thru 0x3636314 data_size 0x4f(0x9fda bytes) 2019-12-16T22:45:21.202 INFO:teuthology.orchestra.run.smithi177.stdout:313 write 0xb46528c thru 0xb468ecd (0x3c42 bytes) 2019-12-16T22:45:21.206 INFO:teuthology.orchestra.run.smithi177.stdout:376 write 0x4f3a2b2 thru 0x4f3afd3 (0xd22 bytes) 2019-12-16T22:45:21.213 INFO:teuthology.orchestra.run.smithi177.stdout:314 trunc from 0xb468ece to 0xa0622f8 2019-12-16T22:45:21.214 INFO:teuthology.orchestra.run.smithi177.stdout:377 write 0x1e21fd2 thru 0x1e22eeb (0xf1a bytes) 2019-12-16T22:45:21.223 INFO:teuthology.orchestra.run.smithi177.stdout:128 punch from 0x5c25733 to 0x5c281e9, (0x2ab6 bytes) 2019-12-16T22:45:21.223 INFO:teuthology.orchestra.run.smithi177.stdout:131 read 0x37fd9b4 thru 0x3805d4d (0x839a bytes) 2019-12-16T22:45:21.223 INFO:teuthology.orchestra.run.smithi177.stdout:132 write 0x10880df thru 0x10900d9 (0x7ffb bytes) 2019-12-16T22:45:21.234 INFO:teuthology.orchestra.run.smithi177.stdout:378 trunc from 0x8dd6505 to 0x25f94a1 2019-12-16T22:45:21.236 INFO:teuthology.orchestra.run.smithi177.stdout:315 write 0x4c5f992 thru 0x4c5fa03 (0x72 bytes) 2019-12-16T22:45:21.240 INFO:teuthology.orchestra.run.smithi177.stdout:316 read 0x837aab4 thru 0x83819c8 (0x6f15 bytes) 2019-12-16T22:45:21.263 INFO:teuthology.orchestra.run.smithi177.stdout:317 write 0xa52d0fb thru 0xa5300b4 (0x2fba bytes) 2019-12-16T22:45:21.265 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.265 INFO:teuthology.orchestra.run.smithi177.stdout:382 read 0x1df54b2 thru 0x1df7d31 (0x2880 bytes) 2019-12-16T22:45:21.265 INFO:teuthology.orchestra.run.smithi177.stdout:383 read 0x10843d2 thru 0x1088119 (0x3d48 bytes) 2019-12-16T22:45:21.266 INFO:teuthology.orchestra.run.smithi177.stdout:384 read 0xc34fdc thru 0xc3a756 (0x577b bytes) 2019-12-16T22:45:21.282 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #1, image image_cluster1.client.mirror.0-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent2 2019-12-16T22:45:21.289 INFO:teuthology.orchestra.run.smithi177.stdout:319 trunc from 0xa5300b5 to 0x576e73 2019-12-16T22:45:21.293 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #1, image image_cluster1.client.mirror.1-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent2 2019-12-16T22:45:21.301 INFO:teuthology.orchestra.run.smithi177.stdout:385 writesame 0xade518c thru 0xadf4ffa data_size 0x7(0xfe6f bytes) 2019-12-16T22:45:21.303 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.303 INFO:teuthology.orchestra.run.smithi177.stdout:387 read 0x685514 thru 0x69136e (0xbe5b bytes) 2019-12-16T22:45:21.304 INFO:teuthology.orchestra.run.smithi177.stdout:389 read 0x74c99b0 thru 0x74cc21e (0x286f bytes) 2019-12-16T22:45:21.304 INFO:teuthology.orchestra.run.smithi177.stdout:390 read 0x8aaa5d thru 0x8b2db6 (0x835a bytes) 2019-12-16T22:45:21.308 INFO:teuthology.orchestra.run.smithi177.stdout:392 read 0x33aa7a5 thru 0x33b55e4 (0xae40 bytes) 2019-12-16T22:45:21.308 INFO:teuthology.orchestra.run.smithi177.stdout:393 writesame 0x880ebdd thru 0x881ccbe data_size 0xbe(0xe0e2 bytes) 2019-12-16T22:45:21.313 INFO:teuthology.orchestra.run.smithi177.stdout:395 punch from 0x3adc3c2 to 0x3ae03c4, (0x4002 bytes) 2019-12-16T22:45:21.314 INFO:teuthology.orchestra.run.smithi177.stdout:396 punch from 0x67154bc to 0x6719c6c, (0x47b0 bytes) 2019-12-16T22:45:21.314 INFO:teuthology.orchestra.run.smithi177.stdout:397 write 0xef2bd4 thru 0xefcdc5 (0xa1f2 bytes) 2019-12-16T22:45:21.316 INFO:teuthology.orchestra.run.smithi177.stdout:135 read 0x4be6743 thru 0x4bf5c62 (0xf520 bytes) 2019-12-16T22:45:21.316 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.322 INFO:teuthology.orchestra.run.smithi177.stdout:398 punch from 0x62aa284 to 0x62aeaad, (0x4829 bytes) 2019-12-16T22:45:21.323 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.323 INFO:teuthology.orchestra.run.smithi177.stdout:401 read 0x9c492f5 thru 0x9c55b44 (0xc850 bytes) 2019-12-16T22:45:21.328 INFO:teuthology.orchestra.run.smithi177.stdout:552 read 0x80b7732 thru 0x80c1c33 (0xa502 bytes) 2019-12-16T22:45:21.328 INFO:teuthology.orchestra.run.smithi177.stdout:137 trunc from 0x68d8fe0 to 0x36c3fba 2019-12-16T22:45:21.329 INFO:teuthology.orchestra.run.smithi177.stdout:320 trunc from 0x576e73 to 0x3edc438 2019-12-16T22:45:21.334 INFO:teuthology.orchestra.run.smithi177.stdout:403 trunc from 0xadf4ffb to 0x599c3e1 2019-12-16T22:45:21.357 INFO:teuthology.orchestra.run.smithi177.stdout:520 read 0x892e562 thru 0x893b81a (0xd2b9 bytes) 2019-12-16T22:45:21.357 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.358 INFO:teuthology.orchestra.run.smithi177.stdout:555 read 0x30554c8 thru 0x305a5c6 (0x50ff bytes) 2019-12-16T22:45:21.358 INFO:teuthology.orchestra.run.smithi177.stdout:556 punch from 0x9029137 to 0x9037854, (0xe71d bytes) 2019-12-16T22:45:21.358 INFO:teuthology.orchestra.run.smithi177.stdout:558 read 0xb79cbba thru 0xb7ac8ce (0xfd15 bytes) 2019-12-16T22:45:21.358 INFO:teuthology.orchestra.run.smithi177.stdout:559 read 0xa6eabb9 thru 0xa6ecad5 (0x1f1d bytes) 2019-12-16T22:45:21.358 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.358 INFO:teuthology.orchestra.run.smithi177.stdout:564 read 0x8e76c31 thru 0x8e86bf0 (0xffc0 bytes) 2019-12-16T22:45:21.359 INFO:teuthology.orchestra.run.smithi177.stdout:566 punch from 0xbafe82 to 0xbbc92e, (0xcaac bytes) 2019-12-16T22:45:21.359 INFO:teuthology.orchestra.run.smithi177.stdout:322 read 0x2c8da1d thru 0x2c923f9 (0x49dd bytes) 2019-12-16T22:45:21.378 INFO:teuthology.orchestra.run.smithi177.stdout:323 trunc from 0x3edc438 to 0xb526d08 2019-12-16T22:45:21.387 INFO:teuthology.orchestra.run.smithi177.stdout:567 write 0xd666d60 thru 0xd6766be (0xf95f bytes) 2019-12-16T22:45:21.387 INFO:teuthology.orchestra.run.smithi177.stdout:568 writesame 0xb7eecf thru 0xb86e54 data_size 0x3(0x7f86 bytes) 2019-12-16T22:45:21.387 INFO:teuthology.orchestra.run.smithi177.stdout:404 trunc from 0x599c3e1 to 0xac1aecc 2019-12-16T22:45:21.387 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.388 INFO:teuthology.orchestra.run.smithi177.stdout:327 read 0xad6582f thru 0xad717c1 (0xbf93 bytes) 2019-12-16T22:45:21.389 INFO:teuthology.orchestra.run.smithi177.stdout:521 write 0xe9d62c2 thru 0xe9dd21d (0x6f5c bytes) 2019-12-16T22:45:21.389 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.389 INFO:teuthology.orchestra.run.smithi177.stdout:406 write 0x7dd71d thru 0x7e036b (0x2c4f bytes) 2019-12-16T22:45:21.390 INFO:teuthology.orchestra.run.smithi177.stdout:138 read 0x322b031 thru 0x323ae39 (0xfe09 bytes) 2019-12-16T22:45:21.397 INFO:teuthology.orchestra.run.smithi177.stdout:139 read 0x866475 thru 0x86c49d (0x6029 bytes) 2019-12-16T22:45:21.398 INFO:teuthology.orchestra.run.smithi177.stdout:140 read 0x23a8d02 thru 0x23b3a9b (0xad9a bytes) 2019-12-16T22:45:21.398 INFO:teuthology.orchestra.run.smithi177.stdout:569 read 0xcc6eafb thru 0xcc76226 (0x772c bytes) 2019-12-16T22:45:21.398 INFO:teuthology.orchestra.run.smithi177.stdout:570 write 0x2011d2a thru 0x2013ce8 (0x1fbf bytes) 2019-12-16T22:45:21.398 INFO:teuthology.orchestra.run.smithi177.stdout:407 writesame 0x2771b1f thru 0x27740e4 data_size 0x5(0x25c6 bytes) 2019-12-16T22:45:21.399 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.399 INFO:teuthology.orchestra.run.smithi177.stdout:524 write 0xc88efa6 thru 0xc89c6d1 (0xd72c bytes) 2019-12-16T22:45:21.399 INFO:teuthology.orchestra.run.smithi177.stdout:329 write 0xc99c6a8 thru 0xc99dd6f (0x16c8 bytes) 2019-12-16T22:45:21.414 INFO:teuthology.orchestra.run.smithi177.stdout:408 trunc from 0xac1aecc to 0xc5bb7f3 2019-12-16T22:45:21.414 INFO:teuthology.orchestra.run.smithi177.stdout:571 write 0x263883 thru 0x2700f5 (0xc873 bytes) 2019-12-16T22:45:21.415 INFO:teuthology.orchestra.run.smithi177.stdout:525 writesame 0xc23b2a5 thru 0xc240e3c data_size 0xc(0x5b98 bytes) 2019-12-16T22:45:21.421 INFO:teuthology.orchestra.run.smithi177.stdout:572 write 0xf0416 thru 0xf5de3 (0x59ce bytes) 2019-12-16T22:45:21.422 INFO:teuthology.orchestra.run.smithi177.stdout:527 trunc from 0xe9dd21e to 0xe3ffb3b 2019-12-16T22:45:21.430 INFO:teuthology.orchestra.run.smithi177.stdout:409 write 0x39ce2a3 thru 0x39d02f1 (0x204f bytes) 2019-12-16T22:45:21.430 INFO:teuthology.orchestra.run.smithi177.stdout:141 write 0xb232f8b thru 0xb23f19b (0xc211 bytes) 2019-12-16T22:45:21.431 INFO:teuthology.orchestra.run.smithi177.stdout:330 trunc from 0xc99dd70 to 0x1c7dd6c 2019-12-16T22:45:21.432 INFO:teuthology.orchestra.run.smithi177.stdout:573 read 0x9f5df04 thru 0x9f6b416 (0xd513 bytes) 2019-12-16T22:45:21.433 INFO:teuthology.orchestra.run.smithi177.stdout:574 writesame 0x27392e0 thru 0x27491ca data_size 0x9(0xfeeb bytes) 2019-12-16T22:45:21.440 INFO:teuthology.orchestra.run.smithi177.stdout:410 write 0x1e011ec thru 0x1e089c5 (0x77da bytes) 2019-12-16T22:45:21.447 INFO:teuthology.orchestra.run.smithi177.stdout:142 write 0x99a0eb1 thru 0x99b04af (0xf5ff bytes) 2019-12-16T22:45:21.452 INFO:teuthology.orchestra.run.smithi177.stdout:575 write 0x3021c49 thru 0x3027d63 (0x611b bytes) 2019-12-16T22:45:21.453 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.453 INFO:teuthology.orchestra.run.smithi177.stdout:412 punch from 0x93b367 to 0x940927, (0x55c0 bytes) 2019-12-16T22:45:21.453 INFO:teuthology.orchestra.run.smithi177.stdout:414 write 0xb8ece42 thru 0xb8f4e92 (0x8051 bytes) 2019-12-16T22:45:21.462 INFO:teuthology.orchestra.run.smithi177.stdout:529 write 0xb1b807 thru 0xb2359c (0x7d96 bytes) 2019-12-16T22:45:21.468 INFO:teuthology.orchestra.run.smithi177.stdout:143 read 0x63bfceb thru 0x63c0018 (0x32e bytes) 2019-12-16T22:45:21.468 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.468 INFO:teuthology.orchestra.run.smithi177.stdout:146 write 0x55a0efa thru 0x55abfdc (0xb0e3 bytes) 2019-12-16T22:45:21.469 INFO:teuthology.orchestra.run.smithi177.stdout:576 writesame 0x1e8b94b thru 0x1e99e93 data_size 0x1(0xe549 bytes) 2019-12-16T22:45:21.469 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #1, image image_cluster1.client.mirror.5-clone1 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent2 2019-12-16T22:45:21.472 INFO:teuthology.orchestra.run.smithi177.stdout:415 read 0x7203e59 thru 0x7207fea (0x4192 bytes) 2019-12-16T22:45:21.473 INFO:teuthology.orchestra.run.smithi177.stdout:417 read 0x33d9172 thru 0x33dd1e7 (0x4076 bytes) 2019-12-16T22:45:21.476 INFO:teuthology.orchestra.run.smithi177.stdout:418 trunc from 0xc5bb7f3 to 0xb51cd57 2019-12-16T22:45:21.478 INFO:teuthology.orchestra.run.smithi177.stdout:147 read 0x557dadf thru 0x5584411 (0x6933 bytes) 2019-12-16T22:45:21.478 INFO:teuthology.orchestra.run.smithi177.stdout:530 write 0x2e9c0c0 thru 0x2ea302e (0x6f6f bytes) 2019-12-16T22:45:21.479 INFO:teuthology.orchestra.run.smithi177.stdout:151 punch from 0x21a8950 to 0x21aa568, (0x1c18 bytes) 2019-12-16T22:45:21.498 INFO:teuthology.orchestra.run.smithi177.stdout:531 read 0x415895b thru 0x416377f (0xae25 bytes) 2019-12-16T22:45:21.513 INFO:teuthology.orchestra.run.smithi177.stdout:577 writesame 0x687388a thru 0x687a8cc data_size 0x1(0x7043 bytes) 2019-12-16T22:45:21.517 INFO:teuthology.orchestra.run.smithi177.stdout:532 write 0xe89c528 thru 0xe8aa97d (0xe456 bytes) 2019-12-16T22:45:21.523 INFO:teuthology.orchestra.run.smithi177.stdout:331 write 0xbf3f595 thru 0xbf43962 (0x43ce bytes) 2019-12-16T22:45:21.525 INFO:teuthology.orchestra.run.smithi177.stdout:152 writesame 0xdf257fa thru 0xdf28c38 data_size 0x5(0x343f bytes) 2019-12-16T22:45:21.537 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.538 INFO:teuthology.orchestra.run.smithi177.stdout:154 read 0x5235c0f thru 0x523cc5e (0x7050 bytes) 2019-12-16T22:45:21.538 INFO:teuthology.orchestra.run.smithi177.stdout:533 write 0x52db9a1 thru 0x52e82f9 (0xc959 bytes) 2019-12-16T22:45:21.538 INFO:teuthology.orchestra.run.smithi177.stdout:155 writesame 0xbb7c491 thru 0xbb89418 data_size 0x74(0xcf88 bytes) 2019-12-16T22:45:21.540 INFO:teuthology.orchestra.run.smithi177.stdout:419 trunc from 0xb51cd57 to 0x15ec89a 2019-12-16T22:45:21.543 INFO:teuthology.orchestra.run.smithi177.stdout:578 read 0x236505a thru 0x236d016 (0x7fbd bytes) 2019-12-16T22:45:21.544 INFO:teuthology.orchestra.run.smithi177.stdout:281 read 0x7084e76 thru 0x709167b (0xc806 bytes) 2019-12-16T22:45:21.545 INFO:teuthology.orchestra.run.smithi177.stdout:333 trunc from 0xbf43963 to 0xc99362a 2019-12-16T22:45:21.547 INFO:teuthology.orchestra.run.smithi177.stdout:579 trunc from 0xd6766bf to 0xbd334fb 2019-12-16T22:45:21.548 INFO:teuthology.orchestra.run.smithi177.stdout:156 punch from 0x5d93da3 to 0x5d9f7ad, (0xba0a bytes) 2019-12-16T22:45:21.548 INFO:teuthology.orchestra.run.smithi177.stdout:157 clone 4 order 22 su 2097152 sc 15 2019-12-16T22:45:21.548 INFO:teuthology.orchestra.run.smithi177.stdout:534 write 0xeb36ea thru 0xebc44c (0x8d63 bytes) 2019-12-16T22:45:21.557 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.557 INFO:teuthology.orchestra.run.smithi177.stdout:536 read 0x4e618bb thru 0x4e655e6 (0x3d2c bytes) 2019-12-16T22:45:21.557 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.557 INFO:teuthology.orchestra.run.smithi177.stdout:542 punch from 0xc565cf2 to 0xc571f22, (0xc230 bytes) 2019-12-16T22:45:21.558 INFO:teuthology.orchestra.run.smithi177.stdout:543 read 0x1c2b2fe thru 0x1c2bb9f (0x8a2 bytes) 2019-12-16T22:45:21.558 INFO:teuthology.orchestra.run.smithi177.stdout:545 write 0xd2ed32e thru 0xd2f9f8f (0xcc62 bytes) 2019-12-16T22:45:21.564 INFO:teuthology.orchestra.run.smithi177.stdout:282 writesame 0x8aa0881 thru 0x8aa6d89 data_size 0x7(0x6509 bytes) 2019-12-16T22:45:21.566 INFO:teuthology.orchestra.run.smithi177.stdout:546 read 0x645febb thru 0x646c6d1 (0xc817 bytes) 2019-12-16T22:45:21.566 INFO:teuthology.orchestra.run.smithi177.stdout:550 punch from 0xd8e642b to 0xd8f54a6, (0xf07b bytes) 2019-12-16T22:45:21.566 INFO:teuthology.orchestra.run.smithi177.stdout:551 writesame 0x52053a4 thru 0x521415a data_size 0x5(0xedb7 bytes) 2019-12-16T22:45:21.569 INFO:teuthology.orchestra.run.smithi177.stdout:334 writesame 0x7a60423 thru 0x7a60c45 data_size 0x1(0x823 bytes) 2019-12-16T22:45:21.573 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.573 INFO:teuthology.orchestra.run.smithi177.stdout:284 punch from 0x2e8ae29 to 0x2e9a5d6, (0xf7ad bytes) 2019-12-16T22:45:21.573 INFO:teuthology.orchestra.run.smithi177.stdout:285 punch from 0x104d172 to 0x105a63f, (0xd4cd bytes) 2019-12-16T22:45:21.573 INFO:teuthology.orchestra.run.smithi177.stdout:286 read 0x6f4a3ee thru 0x6f53631 (0x9244 bytes) 2019-12-16T22:45:21.581 INFO:teuthology.orchestra.run.smithi177.stdout:581 read 0x43047d5 thru 0x4304e23 (0x64f bytes) 2019-12-16T22:45:21.581 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.581 INFO:teuthology.orchestra.run.smithi177.stdout:587 write 0x8210999 thru 0x8217d85 (0x73ed bytes) 2019-12-16T22:45:21.581 INFO:teuthology.orchestra.run.smithi177.stdout:552 write 0x1f9bf51 thru 0x1f9eb30 (0x2be0 bytes) 2019-12-16T22:45:21.585 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.585 INFO:teuthology.orchestra.run.smithi177.stdout:337 punch from 0x86cade4 to 0x86cb79f, (0x9bb bytes) 2019-12-16T22:45:21.585 INFO:teuthology.orchestra.run.smithi177.stdout:338 read 0x7c46cc thru 0x7c90c8 (0x49fd bytes) 2019-12-16T22:45:21.587 INFO:teuthology.orchestra.run.smithi177.stdout:589 read 0x68c9bba thru 0x68d6de3 (0xd22a bytes) 2019-12-16T22:45:21.588 INFO:teuthology.orchestra.run.smithi177.stdout:590 write 0x98458dc thru 0x98505ae (0xacd3 bytes) 2019-12-16T22:45:21.589 INFO:teuthology.orchestra.run.smithi177.stdout:554 read 0x8102fbe thru 0x81072d1 (0x4314 bytes) 2019-12-16T22:45:21.590 INFO:teuthology.orchestra.run.smithi177.stdout:556 writesame 0x8462a5 thru 0x84adf8 data_size 0x6(0x4b54 bytes) 2019-12-16T22:45:21.593 INFO:teuthology.orchestra.run.smithi177.stdout:341 trunc from 0xc99362a to 0xa9556c8 2019-12-16T22:45:21.594 INFO:teuthology.orchestra.run.smithi177.stdout:591 read 0x1adfe09 thru 0x1aeca4c (0xcc44 bytes) 2019-12-16T22:45:21.595 INFO:teuthology.orchestra.run.smithi177.stdout:592 writesame 0x9b2aeac thru 0x9b3938e data_size 0x1(0xe4e3 bytes) 2019-12-16T22:45:21.595 INFO:teuthology.orchestra.run.smithi177.stdout:288 trunc from 0x9775065 to 0x3a3e52 2019-12-16T22:45:21.598 INFO:teuthology.orchestra.run.smithi177.stdout:557 read 0x67baf5d thru 0x67c3ffd (0x90a1 bytes) 2019-12-16T22:45:21.598 INFO:teuthology.orchestra.run.smithi177.stdout:558 read 0xd439dd5 thru 0xd43cc64 (0x2e90 bytes) 2019-12-16T22:45:21.598 INFO:teuthology.orchestra.run.smithi177.stdout:560 read 0x8dabaf3 thru 0x8db1e1a (0x6328 bytes) 2019-12-16T22:45:21.598 INFO:teuthology.orchestra.run.smithi177.stdout:421 trunc from 0x15ec89a to 0xc678604 2019-12-16T22:45:21.599 INFO:teuthology.orchestra.run.smithi177.stdout:561 write 0xa502f7 thru 0xa5a1d1 (0x9edb bytes) 2019-12-16T22:45:21.612 INFO:teuthology.orchestra.run.smithi177.stdout:562 punch from 0xe5b65a to 0xe6a0a0, (0xea46 bytes) 2019-12-16T22:45:21.613 INFO:teuthology.orchestra.run.smithi177.stdout:563 read 0x45644e thru 0x45b954 (0x5507 bytes) 2019-12-16T22:45:21.613 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.613 INFO:teuthology.orchestra.run.smithi177.stdout:567 punch from 0xe42d09b to 0xe432aa9, (0x5a0e bytes) 2019-12-16T22:45:21.613 INFO:teuthology.orchestra.run.smithi177.stdout:568 write 0xb4c7436 thru 0xb4cfa8c (0x8657 bytes) 2019-12-16T22:45:21.634 INFO:teuthology.orchestra.run.smithi177.stdout:569 write 0xe76f338 thru 0xe77a1ba (0xae83 bytes) 2019-12-16T22:45:21.637 INFO:teuthology.orchestra.run.smithi177.stdout:422 read 0x494166a thru 0x494a692 (0x9029 bytes) 2019-12-16T22:45:21.638 INFO:teuthology.orchestra.run.smithi177.stdout:423 write 0x2ffca4c thru 0x3009119 (0xc6ce bytes) 2019-12-16T22:45:21.644 INFO:teuthology.orchestra.run.smithi177.stdout:342 write 0x2590710 thru 0x259b844 (0xb135 bytes) 2019-12-16T22:45:21.645 INFO:teuthology.orchestra.run.smithi177.stdout:593 write 0x58baa0e thru 0x58bc30e (0x1901 bytes) 2019-12-16T22:45:21.647 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.648 INFO:teuthology.orchestra.run.smithi177.stdout:571 write 0x82333d1 thru 0x823f798 (0xc3c8 bytes) 2019-12-16T22:45:21.650 INFO:teuthology.orchestra.run.smithi177.stdout:424 writesame 0x95334ea thru 0x9535ffa data_size 0x4b(0x2b11 bytes) 2019-12-16T22:45:21.658 INFO:teuthology.orchestra.run.smithi177.stdout:595 read 0x81e61dc thru 0x81e7387 (0x11ac bytes) 2019-12-16T22:45:21.660 INFO:teuthology.orchestra.run.smithi177.stdout:573 punch from 0x2cbecde to 0x2cc7de5, (0x9107 bytes) 2019-12-16T22:45:21.660 INFO:teuthology.orchestra.run.smithi177.stdout:574 write 0x68bbc98 thru 0x68c4fcb (0x9334 bytes) 2019-12-16T22:45:21.669 INFO:teuthology.orchestra.run.smithi177.stdout:426 read 0x3b53bed thru 0x3b60ce0 (0xd0f4 bytes) 2019-12-16T22:45:21.669 INFO:teuthology.orchestra.run.smithi177.stdout:428 write 0x26d96e1 thru 0x26e4bf3 (0xb513 bytes) 2019-12-16T22:45:21.678 INFO:teuthology.orchestra.run.smithi177.stdout:576 read 0x6e3284f thru 0x6e350ae (0x2860 bytes) 2019-12-16T22:45:21.678 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.678 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.679 INFO:teuthology.orchestra.run.smithi177.stdout:580 read 0x4c54823 thru 0x4c5ab59 (0x6337 bytes) 2019-12-16T22:45:21.679 INFO:teuthology.orchestra.run.smithi177.stdout:582 punch from 0x67defa2 to 0x67edf4f, (0xefad bytes) 2019-12-16T22:45:21.679 INFO:teuthology.orchestra.run.smithi177.stdout:583 punch from 0xd4cecce to 0xd4d4a49, (0x5d7b bytes) 2019-12-16T22:45:21.679 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.679 INFO:teuthology.orchestra.run.smithi177.stdout:585 write 0x3db5f48 thru 0x3dc5b95 (0xfc4e bytes) 2019-12-16T22:45:21.679 INFO:teuthology.orchestra.run.smithi177.stdout:343 trunc from 0xa9556c8 to 0x100f650 2019-12-16T22:45:21.680 INFO:teuthology.orchestra.run.smithi177.stdout:596 trunc from 0xbd334fb to 0x2b7f252 2019-12-16T22:45:21.683 INFO:teuthology.orchestra.run.smithi177.stdout:429 writesame 0x66974f7 thru 0x66a1668 data_size 0x5(0xa172 bytes) 2019-12-16T22:45:21.690 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.696 INFO:teuthology.orchestra.run.smithi177.stdout:433 write 0x76804c4 thru 0x768b225 (0xad62 bytes) 2019-12-16T22:45:21.704 INFO:teuthology.orchestra.run.smithi177.stdout:434 writesame 0x9696420 thru 0x969d3c9 data_size 0x1(0x6faa bytes) 2019-12-16T22:45:21.708 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.709 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.712 INFO:teuthology.orchestra.run.smithi177.stdout:289 write 0x5d20fe9 thru 0x5d2d87f (0xc897 bytes) 2019-12-16T22:45:21.714 INFO:teuthology.orchestra.run.smithi177.stdout:588 trunc from 0xe8aa97e to 0x1296ac8 2019-12-16T22:45:21.731 INFO:teuthology.orchestra.run.smithi177.stdout:435 punch from 0xaca0080 to 0xacafe61, (0xfde1 bytes) 2019-12-16T22:45:21.731 INFO:teuthology.orchestra.run.smithi177.stdout:436 punch from 0x5bace8b to 0x5bb35ad, (0x6722 bytes) 2019-12-16T22:45:21.732 INFO:teuthology.orchestra.run.smithi177.stdout:438 read 0xb050990 thru 0xb0591b0 (0x8821 bytes) 2019-12-16T22:45:21.732 INFO:teuthology.orchestra.run.smithi177.stdout:439 punch from 0x59b69a9 to 0x59ba852, (0x3ea9 bytes) 2019-12-16T22:45:21.732 INFO:teuthology.orchestra.run.smithi177.stdout:440 read 0xc5c2042 thru 0xc5ccc74 (0xac33 bytes) 2019-12-16T22:45:21.732 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.732 INFO:teuthology.orchestra.run.smithi177.stdout:291 writesame 0x36a439 thru 0x372657 data_size 0x1(0x821f bytes) 2019-12-16T22:45:21.733 INFO:teuthology.orchestra.run.smithi177.stdout:597 punch from 0x10a8339 to 0x10b45f5, (0xc2bc bytes) 2019-12-16T22:45:21.733 INFO:teuthology.orchestra.run.smithi177.stdout:442 write 0x2f7bc08 thru 0x2f81c42 (0x603b bytes) 2019-12-16T22:45:21.755 INFO:teuthology.orchestra.run.smithi177.stdout:347 write 0xa6684e7 thru 0xa6746b4 (0xc1ce bytes) 2019-12-16T22:45:21.755 INFO:teuthology.orchestra.run.smithi177.stdout:443 read 0xc0b3303 thru 0xc0bf4c0 (0xc1be bytes) 2019-12-16T22:45:21.755 INFO:teuthology.orchestra.run.smithi177.stdout:446 punch from 0x1cd11f5 to 0x1cde44f, (0xd25a bytes) 2019-12-16T22:45:21.756 INFO:teuthology.orchestra.run.smithi177.stdout:447 read 0x870d898 thru 0x871d22d (0xf996 bytes) 2019-12-16T22:45:21.756 INFO:teuthology.orchestra.run.smithi177.stdout:292 write 0x452921 thru 0x45b3a5 (0x8a85 bytes) 2019-12-16T22:45:21.756 INFO:teuthology.orchestra.run.smithi177.stdout:448 punch from 0x40fd02f to 0x4106c08, (0x9bd9 bytes) 2019-12-16T22:45:21.757 INFO:teuthology.orchestra.run.smithi177.stdout:450 write 0x838ef15 thru 0x8392e83 (0x3f6f bytes) 2019-12-16T22:45:21.769 INFO:teuthology.orchestra.run.smithi177.stdout:452 writesame 0x63e5675 thru 0x63e8e02 data_size 0xd(0x378e bytes) 2019-12-16T22:45:21.772 INFO:teuthology.orchestra.run.smithi177.stdout:294 writesame 0x193c2b3 thru 0x193cddd data_size 0x1(0xb2b bytes) 2019-12-16T22:45:21.774 INFO:teuthology.orchestra.run.smithi177.stdout:453 punch from 0xb2c775b to 0xb2cbe92, (0x4737 bytes) 2019-12-16T22:45:21.774 INFO:teuthology.orchestra.run.smithi177.stdout:454 read 0xace660c thru 0xace7788 (0x117d bytes) 2019-12-16T22:45:21.774 INFO:teuthology.orchestra.run.smithi177.stdout:456 write 0xab7a55f thru 0xab822ae (0x7d50 bytes) 2019-12-16T22:45:21.781 INFO:teuthology.orchestra.run.smithi177.stdout:598 write 0x64e9204 thru 0x64f6e99 (0xdc96 bytes) 2019-12-16T22:45:21.781 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.782 INFO:teuthology.orchestra.run.smithi177.stdout:296 write 0x2f48234 thru 0x2f51c3a (0x9a07 bytes) 2019-12-16T22:45:21.785 INFO:teuthology.orchestra.run.smithi177.stdout:458 read 0x3c94e86 thru 0x3c9ddc6 (0x8f41 bytes) 2019-12-16T22:45:21.786 INFO:teuthology.orchestra.run.smithi177.stdout:459 write 0xc4fd066 thru 0xc506670 (0x960b bytes) 2019-12-16T22:45:21.795 INFO:teuthology.orchestra.run.smithi177.stdout:297 read 0x1c57011 thru 0x1c630f6 (0xc0e6 bytes) 2019-12-16T22:45:21.795 INFO:teuthology.orchestra.run.smithi177.stdout:299 write 0x297f628 thru 0x2980cea (0x16c3 bytes) 2019-12-16T22:45:21.797 INFO:teuthology.orchestra.run.smithi177.stdout:465 clone 4 order 23 su 262144 sc 3 2019-12-16T22:45:21.798 INFO:teuthology.orchestra.run.smithi177.stdout:600 punch from 0x1ec20e8 to 0x1ec3106, (0x101e bytes) 2019-12-16T22:45:21.799 INFO:teuthology.orchestra.run.smithi177.stdout:601 trunc from 0x64f6e9a to 0x68c729d 2019-12-16T22:45:21.801 INFO:teuthology.orchestra.run.smithi177.stdout:589 write 0x2880379 thru 0x2886d21 (0x69a9 bytes) 2019-12-16T22:45:21.801 INFO:teuthology.orchestra.run.smithi177.stdout:300 write 0x48294aa thru 0x483664f (0xd1a6 bytes) 2019-12-16T22:45:21.809 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.809 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.810 INFO:teuthology.orchestra.run.smithi177.stdout:593 punch from 0x11ed84 to 0x1250b0, (0x632c bytes) 2019-12-16T22:45:21.810 INFO:teuthology.orchestra.run.smithi177.stdout:301 writesame 0x1811137 thru 0x181c7a8 data_size 0x16(0xb672 bytes) 2019-12-16T22:45:21.810 INFO:teuthology.orchestra.run.smithi177.stdout:349 write 0xed27c64 thru 0xed2c579 (0x4916 bytes) 2019-12-16T22:45:21.815 INFO:teuthology.orchestra.run.smithi177.stdout:350 write 0xc9c81bc thru 0xc9d6a26 (0xe86b bytes) 2019-12-16T22:45:21.817 INFO:teuthology.orchestra.run.smithi177.stdout:303 punch from 0x50d4a7 to 0x51c640, (0xf199 bytes) 2019-12-16T22:45:21.817 INFO:teuthology.orchestra.run.smithi177.stdout:304 read 0x2557614 thru 0x256454e (0xcf3b bytes) 2019-12-16T22:45:21.820 INFO:teuthology.orchestra.run.smithi177.stdout:306 punch from 0x288aa05 to 0x288f9e6, (0x4fe1 bytes) 2019-12-16T22:45:21.820 INFO:teuthology.orchestra.run.smithi177.stdout:307 punch from 0x59557ed to 0x59570a7, (0x18ba bytes) 2019-12-16T22:45:21.820 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.820 INFO:teuthology.orchestra.run.smithi177.stdout:602 punch from 0x64b4c99 to 0x64bca89, (0x7df0 bytes) 2019-12-16T22:45:21.820 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.821 INFO:teuthology.orchestra.run.smithi177.stdout:604 punch from 0x5d86e0a to 0x5d91f78, (0xb16e bytes) 2019-12-16T22:45:21.824 INFO:teuthology.orchestra.run.smithi177.stdout:606 read 0x52b6e7a thru 0x52c3db6 (0xcf3d bytes) 2019-12-16T22:45:21.825 INFO:teuthology.orchestra.run.smithi177.stdout:311 trunc from 0x5d2d880 to 0x3690590 2019-12-16T22:45:21.825 INFO:teuthology.orchestra.run.smithi177.stdout:351 read 0x3b5dc39 thru 0x3b69ea8 (0xc270 bytes) 2019-12-16T22:45:21.826 INFO:teuthology.orchestra.run.smithi177.stdout:352 read 0xc2e0f35 thru 0xc2e9764 (0x8830 bytes) 2019-12-16T22:45:21.827 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.827 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.827 INFO:teuthology.orchestra.run.smithi177.stdout:355 read 0xe93edb4 thru 0xe943a65 (0x4cb2 bytes) 2019-12-16T22:45:21.827 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.831 INFO:teuthology.orchestra.run.smithi177.stdout:358 trunc from 0xed2c57a to 0xd5376aa 2019-12-16T22:45:21.848 INFO:teuthology.orchestra.run.smithi177.stdout:595 write 0x9ce502a thru 0x9ce9801 (0x47d8 bytes) 2019-12-16T22:45:21.850 INFO:teuthology.orchestra.run.smithi177.stdout:608 writesame 0xaafd507 thru 0xab04cc7 data_size 0xb(0x77c1 bytes) 2019-12-16T22:45:21.857 INFO:teuthology.orchestra.run.smithi177.stdout:312 write 0x2f3ccce thru 0x2f42dd7 (0x610a bytes) 2019-12-16T22:45:21.857 INFO:teuthology.orchestra.run.smithi177.stdout:609 writesame 0x3b717db thru 0x3b7873b data_size 0x1(0x6f61 bytes) 2019-12-16T22:45:21.860 INFO:teuthology.orchestra.run.smithi177.stdout:361 write 0xbbf34b thru 0xbc134d (0x2003 bytes) 2019-12-16T22:45:21.868 INFO:teuthology.orchestra.run.smithi177.stdout:362 write 0x3dd801e thru 0x3de4530 (0xc513 bytes) 2019-12-16T22:45:21.882 INFO:teuthology.orchestra.run.smithi177.stdout:363 read 0xd527 thru 0x16274 (0x8d4e bytes) 2019-12-16T22:45:21.890 INFO:teuthology.orchestra.run.smithi177.stdout:611 trunc from 0xab04cc8 to 0x6b7d350 2019-12-16T22:45:21.894 INFO:teuthology.orchestra.run.smithi177.stdout:596 write 0xbf4a9e6 thru 0xbf58726 (0xdd41 bytes) 2019-12-16T22:45:21.894 INFO:teuthology.orchestra.run.smithi177.stdout:365 trunc from 0xd5376aa to 0x858872e 2019-12-16T22:45:21.900 INFO:teuthology.orchestra.run.smithi177.stdout:315 writesame 0xd5919cd thru 0xd59c75d data_size 0x3(0xad91 bytes) 2019-12-16T22:45:21.901 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.902 INFO:teuthology.orchestra.run.smithi177.stdout:598 read 0xba4a785 thru 0xba56dad (0xc629 bytes) 2019-12-16T22:45:21.902 INFO:teuthology.orchestra.run.smithi177.stdout:599 write 0x461c992 thru 0x4625193 (0x8802 bytes) 2019-12-16T22:45:21.911 INFO:teuthology.orchestra.run.smithi177.stdout:613 punch from 0x1ab9362 to 0x1ac518c, (0xbe2a bytes) 2019-12-16T22:45:21.912 INFO:teuthology.orchestra.run.smithi177.stdout:614 read 0x4b91b62 thru 0x4b920f9 (0x598 bytes) 2019-12-16T22:45:21.912 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.912 INFO:teuthology.orchestra.run.smithi177.stdout:616 write 0x5d6bb1 thru 0x5dd29c (0x66ec bytes) 2019-12-16T22:45:21.915 INFO:teuthology.orchestra.run.smithi177.stdout:600 read 0x231072e thru 0x231f611 (0xeee4 bytes) 2019-12-16T22:45:21.915 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.915 INFO:teuthology.orchestra.run.smithi177.stdout:604 write 0x11a9645 thru 0x11a9e08 (0x7c4 bytes) 2019-12-16T22:45:21.920 INFO:teuthology.orchestra.run.smithi177.stdout:607 writesame 0x4e51195 thru 0x4e5a6b3 data_size 0x19(0x951f bytes) 2019-12-16T22:45:21.923 INFO:teuthology.orchestra.run.smithi177.stdout:617 read 0x5d012f2 thru 0x5d0c58b (0xb29a bytes) 2019-12-16T22:45:21.926 INFO:teuthology.orchestra.run.smithi177.stdout:608 read 0x753226 thru 0x75ec0a (0xb9e5 bytes) 2019-12-16T22:45:21.928 INFO:teuthology.orchestra.run.smithi177.stdout:366 writesame 0x16e28ec thru 0x16e5b5f data_size 0x2(0x3274 bytes) 2019-12-16T22:45:21.933 INFO:teuthology.orchestra.run.smithi177.stdout:316 write 0xe9dee08 thru 0xe9e5934 (0x6b2d bytes) 2019-12-16T22:45:21.935 INFO:teuthology.orchestra.run.smithi177.stdout:367 read 0x182bf74 thru 0x1835a68 (0x9af5 bytes) 2019-12-16T22:45:21.935 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.935 INFO:teuthology.orchestra.run.smithi177.stdout:369 writesame 0x20e38c9 thru 0x20f12cf data_size 0xf(0xda07 bytes) 2019-12-16T22:45:21.943 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.946 INFO:teuthology.orchestra.run.smithi177.stdout:317 writesame 0x1ad05e6 thru 0x1adf69f data_size 0x3(0xf0ba bytes) 2019-12-16T22:45:21.962 INFO:teuthology.orchestra.run.smithi177.stdout:609 write 0xe1db78f thru 0xe1eb546 (0xfdb8 bytes) 2019-12-16T22:45:21.963 INFO:teuthology.orchestra.run.smithi177.stdout:618 writesame 0xe43cf28 thru 0xe43d00d data_size 0x5(0xe6 bytes) 2019-12-16T22:45:21.966 INFO:teuthology.orchestra.run.smithi177.stdout:319 read 0x17181d3 thru 0x17255ff (0xd42d bytes) 2019-12-16T22:45:21.966 INFO:teuthology.orchestra.run.smithi177.stdout:321 read 0x3cd2062 thru 0x3cd7842 (0x57e1 bytes) 2019-12-16T22:45:21.967 INFO:teuthology.orchestra.run.smithi177.stdout:619 write 0x276249 thru 0x27c321 (0x60d9 bytes) 2019-12-16T22:45:21.976 INFO:teuthology.orchestra.run.smithi177.stdout:611 read 0xb7eeef7 thru 0xb7fa7fb (0xb905 bytes) 2019-12-16T22:45:21.976 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:21.980 INFO:teuthology.orchestra.run.smithi177.stdout:621 read 0x336af87 thru 0x3376b40 (0xbbba bytes) 2019-12-16T22:45:21.980 INFO:teuthology.orchestra.run.smithi177.stdout:623 read 0x2239ffb thru 0x2243a70 (0x9a76 bytes) 2019-12-16T22:45:21.981 INFO:teuthology.orchestra.run.smithi177.stdout:624 read 0x155b973 thru 0x156aa93 (0xf121 bytes) 2019-12-16T22:45:21.981 INFO:teuthology.orchestra.run.smithi177.stdout:625 read 0xb7ca052 thru 0xb7cd7d6 (0x3785 bytes) 2019-12-16T22:45:21.981 INFO:teuthology.orchestra.run.smithi177.stdout:629 read 0xe262d17 thru 0xe2674d0 (0x47ba bytes) 2019-12-16T22:45:21.981 INFO:teuthology.orchestra.run.smithi177.stdout:630 write 0xd1631bb thru 0xd17104c (0xde92 bytes) 2019-12-16T22:45:21.983 INFO:teuthology.orchestra.run.smithi177.stdout:322 trunc from 0xe9e5935 to 0x5ea74fd 2019-12-16T22:45:21.990 INFO:teuthology.orchestra.run.smithi177.stdout:374 writesame 0xbe10772 thru 0xbe10954 data_size 0x3(0x1e3 bytes) 2019-12-16T22:45:21.990 INFO:teuthology.orchestra.run.smithi177.stdout:631 write 0x8a35e1b thru 0x8a40658 (0xa83e bytes) 2019-12-16T22:45:21.994 INFO:teuthology.orchestra.run.smithi177.stdout:613 trunc from 0xe1eb547 to 0x523d64a 2019-12-16T22:45:22.009 INFO:teuthology.orchestra.run.smithi177.stdout:632 punch from 0x5f5ef36 to 0x5f67ee5, (0x8faf bytes) 2019-12-16T22:45:22.009 INFO:teuthology.orchestra.run.smithi177.stdout:634 write 0x905871b thru 0x906037f (0x7c65 bytes) 2019-12-16T22:45:22.019 INFO:teuthology.orchestra.run.smithi177.stdout:636 read 0x85ff22a thru 0x85ff353 (0x12a bytes) 2019-12-16T22:45:22.020 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.020 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.020 INFO:teuthology.orchestra.run.smithi177.stdout:641 write 0x55a820a thru 0x55b3d51 (0xbb48 bytes) 2019-12-16T22:45:22.021 INFO:teuthology.orchestra.run.smithi177.stdout:323 read 0x57e55aa thru 0x57ecc4b (0x76a2 bytes) 2019-12-16T22:45:22.032 INFO:teuthology.orchestra.run.smithi177.stdout:642 writesame 0x9132b19 thru 0x913b949 data_size 0x1(0x8e31 bytes) 2019-12-16T22:45:22.036 INFO:teuthology.orchestra.run.smithi177.stdout:375 writesame 0xe41c7f6 thru 0xe41fca2 data_size 0x57(0x34ad bytes) 2019-12-16T22:45:22.041 INFO:teuthology.orchestra.run.smithi177.stdout:614 punch from 0x3eb0a0b to 0x3eb347f, (0x2a74 bytes) 2019-12-16T22:45:22.042 INFO:teuthology.orchestra.run.smithi177.stdout:615 read 0x13ea3ff thru 0x13f9b3f (0xf741 bytes) 2019-12-16T22:45:22.042 INFO:teuthology.orchestra.run.smithi177.stdout:616 write 0x23a65cf thru 0x23b3aea (0xd51c bytes) 2019-12-16T22:45:22.044 INFO:teuthology.orchestra.run.smithi177.stdout:378 read 0x75d9c31 thru 0x75dc389 (0x2759 bytes) 2019-12-16T22:45:22.044 INFO:teuthology.orchestra.run.smithi177.stdout:379 punch from 0x77d7ed3 to 0x77de474, (0x65a1 bytes) 2019-12-16T22:45:22.044 INFO:teuthology.orchestra.run.smithi177.stdout:380 write 0x3e57a64 thru 0x3e66035 (0xe5d2 bytes) 2019-12-16T22:45:22.064 INFO:teuthology.orchestra.run.smithi177.stdout:643 read 0xd1ac78c thru 0xd1b5e26 (0x969b bytes) 2019-12-16T22:45:22.065 INFO:teuthology.orchestra.run.smithi177.stdout:644 read 0x94174d8 thru 0x941f623 (0x814c bytes) 2019-12-16T22:45:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:381 punch from 0x7ed60b6 to 0x7ed8efb, (0x2e45 bytes) 2019-12-16T22:45:22.066 INFO:teuthology.orchestra.run.smithi177.stdout:382 write 0x664077b thru 0x6645661 (0x4ee7 bytes) 2019-12-16T22:45:22.070 INFO:teuthology.orchestra.run.smithi177.stdout:617 punch from 0x44264af to 0x442d9b1, (0x7502 bytes) 2019-12-16T22:45:22.071 INFO:teuthology.orchestra.run.smithi177.stdout:618 writesame 0x12cf04 thru 0x138204 data_size 0x8d(0xb301 bytes) 2019-12-16T22:45:22.072 INFO:teuthology.orchestra.run.smithi177.stdout:325 write 0xdf7c32f thru 0xdf878d7 (0xb5a9 bytes) 2019-12-16T22:45:22.095 INFO:teuthology.orchestra.run.smithi177.stdout:326 read 0x2712553 thru 0x2713c30 (0x16de bytes) 2019-12-16T22:45:22.095 INFO:teuthology.orchestra.run.smithi177.stdout:328 write 0x8f65911 thru 0x8f73b8a (0xe27a bytes) 2019-12-16T22:45:22.095 INFO:teuthology.orchestra.run.smithi177.stdout:645 trunc from 0xe43d00e to 0x3fd83c3 2019-12-16T22:45:22.096 INFO:teuthology.orchestra.run.smithi177.stdout:619 write 0x5110461 thru 0x5110558 (0xf8 bytes) 2019-12-16T22:45:22.096 INFO:teuthology.orchestra.run.smithi177.stdout:620 read 0x3c5d60 thru 0x3cad0b (0x4fac bytes) 2019-12-16T22:45:22.096 INFO:teuthology.orchestra.run.smithi177.stdout:621 read 0x2919761 thru 0x291fb58 (0x63f8 bytes) 2019-12-16T22:45:22.112 INFO:teuthology.orchestra.run.smithi177.stdout:622 trunc from 0x523d64a to 0xe456e24 2019-12-16T22:45:22.113 INFO:teuthology.orchestra.run.smithi177.stdout:383 write 0xe894018 thru 0xe8a3acb (0xfab4 bytes) 2019-12-16T22:45:22.125 INFO:teuthology.orchestra.run.smithi177.stdout:384 write 0x5791331 thru 0x5796b3f (0x580f bytes) 2019-12-16T22:45:22.134 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.134 INFO:teuthology.orchestra.run.smithi177.stdout:387 writesame 0x2e17d2a thru 0x2e25799 data_size 0x28(0xda70 bytes) 2019-12-16T22:45:22.134 INFO:teuthology.orchestra.run.smithi177.stdout:329 writesame 0xe588fd4 thru 0xe597868 data_size 0x59(0xe895 bytes) 2019-12-16T22:45:22.142 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.143 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.143 INFO:teuthology.orchestra.run.smithi177.stdout:390 punch from 0x1045bb9 to 0x1053843, (0xdc8a bytes) 2019-12-16T22:45:22.143 INFO:teuthology.orchestra.run.smithi177.stdout:392 punch from 0x56f91bc to 0x5701afe, (0x8942 bytes) 2019-12-16T22:45:22.143 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.143 INFO:teuthology.orchestra.run.smithi177.stdout:395 write 0x2b9fd46 thru 0x2babb55 (0xbe10 bytes) 2019-12-16T22:45:22.146 INFO:teuthology.orchestra.run.smithi177.stdout:330 read 0xd1b2bc1 thru 0xd1ba06b (0x74ab bytes) 2019-12-16T22:45:22.146 INFO:teuthology.orchestra.run.smithi177.stdout:331 read 0x1b3876f thru 0x1b3ae6c (0x26fe bytes) 2019-12-16T22:45:22.146 INFO:teuthology.orchestra.run.smithi177.stdout:333 writesame 0x6090ee thru 0x6104af data_size 0x42(0x73c2 bytes) 2019-12-16T22:45:22.150 INFO:teuthology.orchestra.run.smithi177.stdout:623 read 0x3530cbf thru 0x353862b (0x796d bytes) 2019-12-16T22:45:22.155 INFO:teuthology.orchestra.run.smithi177.stdout:625 punch from 0x391df5c to 0x392266a, (0x470e bytes) 2019-12-16T22:45:22.156 INFO:teuthology.orchestra.run.smithi177.stdout:626 writesame 0x4abc7c3 thru 0x4abcb23 data_size 0x1(0x361 bytes) 2019-12-16T22:45:22.156 INFO:teuthology.orchestra.run.smithi177.stdout:396 writesame 0x6bd7f43 thru 0x6bd8f98 data_size 0x11(0x1056 bytes) 2019-12-16T22:45:22.159 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.161 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.161 INFO:teuthology.orchestra.run.smithi177.stdout:398 punch from 0xb0ba147 to 0xb0c8cf6, (0xebaf bytes) 2019-12-16T22:45:22.161 INFO:teuthology.orchestra.run.smithi177.stdout:399 write 0x7d4fa95 thru 0x7d5b4d5 (0xba41 bytes) 2019-12-16T22:45:22.161 INFO:teuthology.orchestra.run.smithi177.stdout:338 trunc from 0xe597869 to 0xa028aa7 2019-12-16T22:45:22.162 INFO:teuthology.orchestra.run.smithi177.stdout:627 writesame 0x6f41c34 thru 0x6f45ecd data_size 0x3e(0x429a bytes) 2019-12-16T22:45:22.168 INFO:teuthology.orchestra.run.smithi177.stdout:646 write 0x47a3dfa thru 0x47aa570 (0x6777 bytes) 2019-12-16T22:45:22.180 INFO:teuthology.orchestra.run.smithi177.stdout:401 writesame 0x4a30ce9 thru 0x4a3a3a1 data_size 0x1(0x96b9 bytes) 2019-12-16T22:45:22.181 INFO:teuthology.orchestra.run.smithi177.stdout:628 write 0xb129f6a thru 0xb1379fe (0xda95 bytes) 2019-12-16T22:45:22.195 INFO:teuthology.orchestra.run.smithi177.stdout:629 read 0x40e8ea4 thru 0x40f4b0d (0xbc6a bytes) 2019-12-16T22:45:22.195 INFO:teuthology.orchestra.run.smithi177.stdout:630 punch from 0xbfe349b to 0xbff3489, (0xffee bytes) 2019-12-16T22:45:22.195 INFO:teuthology.orchestra.run.smithi177.stdout:631 write 0xd556e06 thru 0xd559d9c (0x2f97 bytes) 2019-12-16T22:45:22.212 INFO:teuthology.orchestra.run.smithi177.stdout:632 read 0xabfb18 thru 0xacf2dd (0xf7c6 bytes) 2019-12-16T22:45:22.213 INFO:teuthology.orchestra.run.smithi177.stdout:633 write 0xaaee3e1 thru 0xaafa8cc (0xc4ec bytes) 2019-12-16T22:45:22.213 INFO:teuthology.orchestra.run.smithi177.stdout:403 read 0xa30c5c6 thru 0xa31473d (0x8178 bytes) 2019-12-16T22:45:22.214 INFO:teuthology.orchestra.run.smithi177.stdout:404 punch from 0xb1bf178 to 0xb1cdc1e, (0xeaa6 bytes) 2019-12-16T22:45:22.214 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.215 INFO:teuthology.orchestra.run.smithi177.stdout:406 write 0xe34dd61 thru 0xe34ecfd (0xf9d bytes) 2019-12-16T22:45:22.220 INFO:teuthology.orchestra.run.smithi177.stdout:407 read 0xb6637f1 thru 0xb66e5d7 (0xade7 bytes) 2019-12-16T22:45:22.221 INFO:teuthology.orchestra.run.smithi177.stdout:409 write 0x9c55754 thru 0x9c56a15 (0x12c2 bytes) 2019-12-16T22:45:22.221 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone3 from 0xdf28c39 (overlap 0x36c3fba) to 0x0 2019-12-16T22:45:22.228 INFO:teuthology.orchestra.run.smithi177.stdout:635 clone 4 order 22 su 262144 sc 9 2019-12-16T22:45:22.229 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.3-clone3 2019-12-16T22:45:22.229 INFO:teuthology.orchestra.run.smithi177.stdout:411 punch from 0xc022376 to 0xc023f75, (0x1bff bytes) 2019-12-16T22:45:22.229 INFO:teuthology.orchestra.run.smithi177.stdout:413 write 0x69b5648 thru 0x69c3a61 (0xe41a bytes) 2019-12-16T22:45:22.233 INFO:teuthology.orchestra.run.smithi177.stdout:647 write 0x51461f9 thru 0x5153c1e (0xda26 bytes) 2019-12-16T22:45:22.260 INFO:teuthology.orchestra.run.smithi177.stdout:648 trunc from 0x5153c1f to 0x8d6bfb5 2019-12-16T22:45:22.271 INFO:teuthology.orchestra.run.smithi177.stdout:416 write 0x6af492f thru 0x6afedbb (0xa48d bytes) 2019-12-16T22:45:22.272 INFO:teuthology.orchestra.run.smithi177.stdout:339 write 0xe7d4012 thru 0xe7d50b4 (0x10a3 bytes) 2019-12-16T22:45:22.278 INFO:teuthology.orchestra.run.smithi177.stdout:417 write 0x8928d6f thru 0x8933276 (0xa508 bytes) 2019-12-16T22:45:22.278 INFO:teuthology.orchestra.run.smithi177.stdout:341 read 0xb875bf thru 0xb96fe5 (0xfa27 bytes) 2019-12-16T22:45:22.278 INFO:teuthology.orchestra.run.smithi177.stdout:342 writesame 0x5b314b2 thru 0x5b3f822 data_size 0x19(0xe371 bytes) 2019-12-16T22:45:22.283 INFO:teuthology.orchestra.run.smithi177.stdout:649 punch from 0x10c576 to 0x10ffbc, (0x3a46 bytes) 2019-12-16T22:45:22.283 INFO:teuthology.orchestra.run.smithi177.stdout:650 write 0x5d23d8b thru 0x5d2507f (0x12f5 bytes) 2019-12-16T22:45:22.289 INFO:teuthology.orchestra.run.smithi177.stdout:651 read 0x1add0f0 thru 0x1aea63c (0xd54d bytes) 2019-12-16T22:45:22.290 INFO:teuthology.orchestra.run.smithi177.stdout:652 punch from 0x5401f2e to 0x5410cf8, (0xedca bytes) 2019-12-16T22:45:22.290 INFO:teuthology.orchestra.run.smithi177.stdout:653 clone 4 order 24 su 524288 sc 15 2019-12-16T22:45:22.301 INFO:teuthology.orchestra.run.smithi177.stdout:343 read 0x90a1591 thru 0x90a861c (0x708c bytes) 2019-12-16T22:45:22.302 INFO:teuthology.orchestra.run.smithi177.stdout:346 read 0x4eef54f thru 0x4ef5955 (0x6407 bytes) 2019-12-16T22:45:22.303 INFO:teuthology.orchestra.run.smithi177.stdout:347 trunc from 0xe7d50b5 to 0xd4eddc5 2019-12-16T22:45:22.337 INFO:teuthology.orchestra.run.smithi177.stdout:420 writesame 0x506658b thru 0x5069ff9 data_size 0x1(0x3a6f bytes) 2019-12-16T22:45:22.351 INFO:teuthology.orchestra.run.smithi177.stdout:423 read 0x60450d1 thru 0x6049c87 (0x4bb7 bytes) 2019-12-16T22:45:22.373 INFO:teuthology.orchestra.run.smithi177.stdout:424 trunc from 0xe8a3acc to 0x51d033d 2019-12-16T22:45:22.407 INFO:teuthology.orchestra.run.smithi177.stdout:348 trunc from 0xd4eddc5 to 0xa00a4a0 2019-12-16T22:45:22.422 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe8953ae 2019-12-16T22:45:22.436 INFO:teuthology.orchestra.run.smithi177.stdout:349 trunc from 0xa00a4a0 to 0xe8953ae 2019-12-16T22:45:22.447 INFO:teuthology.orchestra.run.smithi177.stdout:351 read 0x828e7a9 thru 0x82951f2 (0x6a4a bytes) 2019-12-16T22:45:22.447 INFO:teuthology.orchestra.run.smithi177.stdout:353 read 0x5ca6d92 thru 0x5cb6b52 (0xfdc1 bytes) 2019-12-16T22:45:22.448 INFO:teuthology.orchestra.run.smithi177.stdout:354 read 0xa3acb24 thru 0xa3ae680 (0x1b5d bytes) 2019-12-16T22:45:22.448 INFO:teuthology.orchestra.run.smithi177.stdout:356 write 0x1f24fbc thru 0x1f25104 (0x149 bytes) 2019-12-16T22:45:22.464 INFO:teuthology.orchestra.run.smithi177.stdout:357 read 0x434cb94 thru 0x4358668 (0xbad5 bytes) 2019-12-16T22:45:22.464 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.464 INFO:teuthology.orchestra.run.smithi177.stdout:359 read 0xd95d760 thru 0xd9641f3 (0x6a94 bytes) 2019-12-16T22:45:22.465 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #2, image image_cluster1.client.mirror.3-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent3 2019-12-16T22:45:22.480 INFO:teuthology.orchestra.run.smithi177.stdout:360 trunc from 0xe8953ae to 0x4b2b56a 2019-12-16T22:45:22.499 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.499 INFO:teuthology.orchestra.run.smithi177.stdout:426 write 0x223df97 thru 0x22494f3 (0xb55d bytes) 2019-12-16T22:45:22.503 INFO:teuthology.orchestra.run.smithi177.stdout:361 read 0x4a4e3a5 thru 0x4a51b50 (0x37ac bytes) 2019-12-16T22:45:22.503 INFO:teuthology.orchestra.run.smithi177.stdout:363 read 0x350369b thru 0x3510a41 (0xd3a7 bytes) 2019-12-16T22:45:22.504 INFO:teuthology.orchestra.run.smithi177.stdout:364 read 0x2e808fb thru 0x2e901dd (0xf8e3 bytes) 2019-12-16T22:45:22.522 INFO:teuthology.orchestra.run.smithi177.stdout:365 trunc from 0x4b2b56a to 0xcfc0644 2019-12-16T22:45:22.537 INFO:teuthology.orchestra.run.smithi177.stdout:366 writesame 0x2f044aa thru 0x2f06be4 data_size 0xb(0x273b bytes) 2019-12-16T22:45:22.542 INFO:teuthology.orchestra.run.smithi177.stdout:367 clone 4 order 21 su 32768 sc 11 2019-12-16T22:45:22.576 INFO:teuthology.orchestra.run.smithi177.stdout:427 write 0x94d17f5 thru 0x94d8a05 (0x7211 bytes) 2019-12-16T22:45:22.581 INFO:teuthology.orchestra.run.smithi177.stdout:428 writesame 0x5091c83 thru 0x5099fbc data_size 0x21(0x833a bytes) 2019-12-16T22:45:22.582 INFO:teuthology.orchestra.run.smithi177.stdout:467 writesame 0x685b45f thru 0x685cc6f data_size 0x1(0x1811 bytes) 2019-12-16T22:45:22.586 INFO:teuthology.orchestra.run.smithi177.stdout:429 write 0x4f4799c thru 0x4f4ad65 (0x33ca bytes) 2019-12-16T22:45:22.611 INFO:teuthology.orchestra.run.smithi177.stdout:468 punch from 0xb557228 to 0xb55cdd9, (0x5bb1 bytes) 2019-12-16T22:45:22.611 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.611 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.611 INFO:teuthology.orchestra.run.smithi177.stdout:474 punch from 0x1c257d7 to 0x1c27c6e, (0x2497 bytes) 2019-12-16T22:45:22.612 INFO:teuthology.orchestra.run.smithi177.stdout:476 write 0x739f583 thru 0x73acc5f (0xd6dd bytes) 2019-12-16T22:45:22.616 INFO:teuthology.orchestra.run.smithi177.stdout:477 writesame 0xbacd87f thru 0xbacf360 data_size 0x6(0x1ae2 bytes) 2019-12-16T22:45:22.628 INFO:teuthology.orchestra.run.smithi177.stdout:479 punch from 0x27fcdb0 to 0x280a0a0, (0xd2f0 bytes) 2019-12-16T22:45:22.628 INFO:teuthology.orchestra.run.smithi177.stdout:480 write 0x8277fe8 thru 0x8282178 (0xa191 bytes) 2019-12-16T22:45:22.644 INFO:teuthology.orchestra.run.smithi177.stdout:481 write 0x4debda6 thru 0x4df494d (0x8ba8 bytes) 2019-12-16T22:45:22.645 INFO:teuthology.orchestra.run.smithi177.stdout:430 write 0xd96894a thru 0xd972c66 (0xa31d bytes) 2019-12-16T22:45:22.657 INFO:teuthology.orchestra.run.smithi177.stdout:482 punch from 0x682df2c to 0x682f963, (0x1a37 bytes) 2019-12-16T22:45:22.658 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.660 INFO:teuthology.orchestra.run.smithi177.stdout:431 write 0x3f1a573 thru 0x3f2a249 (0xfcd7 bytes) 2019-12-16T22:45:22.668 INFO:teuthology.orchestra.run.smithi177.stdout:432 write 0x42e2fa8 thru 0x42edcaa (0xad03 bytes) 2019-12-16T22:45:22.679 INFO:teuthology.orchestra.run.smithi177.stdout:433 read 0xba98be7 thru 0xbaa6cd7 (0xe0f1 bytes) 2019-12-16T22:45:22.680 INFO:teuthology.orchestra.run.smithi177.stdout:434 read 0xaa31a16 thru 0xaa352cf (0x38ba bytes) 2019-12-16T22:45:22.680 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.680 INFO:teuthology.orchestra.run.smithi177.stdout:436 read 0x1b2f4fa thru 0x1b35cc8 (0x67cf bytes) 2019-12-16T22:45:22.680 INFO:teuthology.orchestra.run.smithi177.stdout:484 trunc from 0xc678604 to 0x575f8d3 2019-12-16T22:45:22.685 INFO:teuthology.orchestra.run.smithi177.stdout:438 trunc from 0xd972c67 to 0x9c1eeb2 2019-12-16T22:45:22.707 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.721 INFO:teuthology.orchestra.run.smithi177.stdout:440 trunc from 0x9c1eeb2 to 0x374a784 2019-12-16T22:45:22.737 INFO:teuthology.orchestra.run.smithi177.stdout:485 write 0xa79e8a2 thru 0xa79f435 (0xb94 bytes) 2019-12-16T22:45:22.743 INFO:teuthology.orchestra.run.smithi177.stdout:441 writesame 0x3371f5b thru 0x337f6a3 data_size 0x1(0xd749 bytes) 2019-12-16T22:45:22.745 INFO:teuthology.orchestra.run.smithi177.stdout:486 trunc from 0xa79f436 to 0xbee4d7c 2019-12-16T22:45:22.781 INFO:teuthology.orchestra.run.smithi177.stdout:487 read 0x20914ef thru 0x2095057 (0x3b69 bytes) 2019-12-16T22:45:22.782 INFO:teuthology.orchestra.run.smithi177.stdout:488 read 0xb403371 thru 0xb404477 (0x1107 bytes) 2019-12-16T22:45:22.782 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.782 INFO:teuthology.orchestra.run.smithi177.stdout:490 writesame 0xb761aaa thru 0xb76b18f data_size 0x5(0x96e6 bytes) 2019-12-16T22:45:22.783 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.783 INFO:teuthology.orchestra.run.smithi177.stdout:444 write 0x2806854 thru 0x280c646 (0x5df3 bytes) 2019-12-16T22:45:22.785 INFO:teuthology.orchestra.run.smithi177.stdout:445 read 0x204b7a thru 0x205cc5 (0x114c bytes) 2019-12-16T22:45:22.786 INFO:teuthology.orchestra.run.smithi177.stdout:446 punch from 0x225b426 to 0x225da2a, (0x2604 bytes) 2019-12-16T22:45:22.787 INFO:teuthology.orchestra.run.smithi177.stdout:447 read 0x26beadd thru 0x26c45e4 (0x5b08 bytes) 2019-12-16T22:45:22.787 INFO:teuthology.orchestra.run.smithi177.stdout:448 punch from 0x9909ab to 0x9936d1, (0x2d26 bytes) 2019-12-16T22:45:22.787 INFO:teuthology.orchestra.run.smithi177.stdout:449 punch from 0x145aba1 to 0x1464b4f, (0x9fae bytes) 2019-12-16T22:45:22.787 INFO:teuthology.orchestra.run.smithi177.stdout:451 read 0x16cf950 thru 0x16dc324 (0xc9d5 bytes) 2019-12-16T22:45:22.788 INFO:teuthology.orchestra.run.smithi177.stdout:453 punch from 0x27db5c0 to 0x27e993e, (0xe37e bytes) 2019-12-16T22:45:22.802 INFO:teuthology.orchestra.run.smithi177.stdout:491 trunc from 0xbee4d7c to 0x7875fad 2019-12-16T22:45:22.826 INFO:teuthology.orchestra.run.smithi177.stdout:454 writesame 0xcb69dd1 thru 0xcb7396a data_size 0x9(0x9b9a bytes) 2019-12-16T22:45:22.831 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.831 INFO:teuthology.orchestra.run.smithi177.stdout:458 read 0x9666703 thru 0x966dfa1 (0x789f bytes) 2019-12-16T22:45:22.831 INFO:teuthology.orchestra.run.smithi177.stdout:459 read 0xb59a284 thru 0xb59afe4 (0xd61 bytes) 2019-12-16T22:45:22.832 INFO:teuthology.orchestra.run.smithi177.stdout:492 trunc from 0x7875fad to 0x448801c 2019-12-16T22:45:22.900 INFO:teuthology.orchestra.run.smithi177.stdout:493 writesame 0xebb3dc7 thru 0xebb7e2b data_size 0x23(0x4065 bytes) 2019-12-16T22:45:22.902 INFO:teuthology.orchestra.run.smithi177.stdout:494 read 0x1a79a7e thru 0x1a8728e (0xd811 bytes) 2019-12-16T22:45:22.903 INFO:teuthology.orchestra.run.smithi177.stdout:495 read 0x464762a thru 0x4653b37 (0xc50e bytes) 2019-12-16T22:45:22.903 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.904 INFO:teuthology.orchestra.run.smithi177.stdout:498 punch from 0x3747b30 to 0x3754b66, (0xd036 bytes) 2019-12-16T22:45:22.904 INFO:teuthology.orchestra.run.smithi177.stdout:500 writesame 0x74f1ae8 thru 0x74f6667 data_size 0x40(0x4b80 bytes) 2019-12-16T22:45:22.911 INFO:teuthology.orchestra.run.smithi177.stdout:501 read 0x3625025 thru 0x362f311 (0xa2ed bytes) 2019-12-16T22:45:22.911 INFO:teuthology.orchestra.run.smithi177.stdout:502 punch from 0xbe7e167 to 0xbe84efb, (0x6d94 bytes) 2019-12-16T22:45:22.911 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.911 INFO:teuthology.orchestra.run.smithi177.stdout:504 write 0x2371f5f thru 0x2375bf0 (0x3c92 bytes) 2019-12-16T22:45:22.920 INFO:teuthology.orchestra.run.smithi177.stdout:505 write 0x6da0894 thru 0x6dae9e0 (0xe14d bytes) 2019-12-16T22:45:22.923 INFO:teuthology.orchestra.run.smithi177.stdout:460 writesame 0xe9ac89c thru 0xe9acd7c data_size 0x1(0x4e1 bytes) 2019-12-16T22:45:22.930 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.930 INFO:teuthology.orchestra.run.smithi177.stdout:462 read 0xa17316a thru 0xa176802 (0x3699 bytes) 2019-12-16T22:45:22.931 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:22.931 INFO:teuthology.orchestra.run.smithi177.stdout:464 punch from 0xb402c41 to 0xb40604e, (0x340d bytes) 2019-12-16T22:45:22.931 INFO:teuthology.orchestra.run.smithi177.stdout:466 read 0x1405c7b thru 0x1412b09 (0xce8f bytes) 2019-12-16T22:45:22.932 INFO:teuthology.orchestra.run.smithi177.stdout:506 read 0xe0e85f2 thru 0xe0ef7b2 (0x71c1 bytes) 2019-12-16T22:45:22.933 INFO:teuthology.orchestra.run.smithi177.stdout:509 writesame 0xb3656ab thru 0xb36d161 data_size 0x3d(0x7ab7 bytes) 2019-12-16T22:45:22.938 INFO:teuthology.orchestra.run.smithi177.stdout:510 trunc from 0xebb7e2c to 0xe6067cc 2019-12-16T22:45:22.951 INFO:teuthology.orchestra.run.smithi177.stdout:467 punch from 0x8e7021d to 0x8e73b0b, (0x38ee bytes) 2019-12-16T22:45:22.951 INFO:teuthology.orchestra.run.smithi177.stdout:468 clone 4 order 19 su 16384 sc 15 2019-12-16T22:45:22.955 INFO:teuthology.orchestra.run.smithi177.stdout:511 write 0x77d5b4 thru 0x78202d (0x4a7a bytes) 2019-12-16T22:45:23.005 INFO:teuthology.orchestra.run.smithi177.stdout:512 write 0x83c129a thru 0x83c5fd0 (0x4d37 bytes) 2019-12-16T22:45:23.076 INFO:teuthology.orchestra.run.smithi177.stdout:513 punch from 0x80c5a08 to 0x80cfe91, (0xa489 bytes) 2019-12-16T22:45:23.077 INFO:teuthology.orchestra.run.smithi177.stdout:514 write 0x53774cc thru 0x5383430 (0xbf65 bytes) 2019-12-16T22:45:23.108 INFO:teuthology.orchestra.run.smithi177.stdout:515 read 0xa906468 thru 0xa90ced0 (0x6a69 bytes) 2019-12-16T22:45:23.109 INFO:teuthology.orchestra.run.smithi177.stdout:516 read 0xe300393 thru 0xe30ef9d (0xec0b bytes) 2019-12-16T22:45:23.109 INFO:teuthology.orchestra.run.smithi177.stdout:517 punch from 0xbf2a82d to 0xbf314f8, (0x6ccb bytes) 2019-12-16T22:45:23.109 INFO:teuthology.orchestra.run.smithi177.stdout:519 punch from 0xc6eedc8 to 0xc6f146d, (0x26a5 bytes) 2019-12-16T22:45:23.109 INFO:teuthology.orchestra.run.smithi177.stdout:520 write 0xd0597a3 thru 0xd06265b (0x8eb9 bytes) 2019-12-16T22:45:23.134 INFO:teuthology.orchestra.run.smithi177.stdout:521 read 0x587c95d thru 0x58849ad (0x8051 bytes) 2019-12-16T22:45:23.140 INFO:teuthology.orchestra.run.smithi177.stdout:522 trunc from 0xe6067cc to 0xd037a90 2019-12-16T22:45:23.208 INFO:teuthology.orchestra.run.smithi177.stdout:523 write 0xeae176f thru 0xeae57c3 (0x4055 bytes) 2019-12-16T22:45:23.221 INFO:teuthology.orchestra.run.smithi177.stdout:524 write 0x5b45b58 thru 0x5b4f202 (0x96ab bytes) 2019-12-16T22:45:23.237 INFO:teuthology.orchestra.run.smithi177.stdout:525 read 0x44795d9 thru 0x448151a (0x7f42 bytes) 2019-12-16T22:45:23.238 INFO:teuthology.orchestra.run.smithi177.stdout:527 read 0x2abe119 thru 0x2ac457a (0x6462 bytes) 2019-12-16T22:45:23.239 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.239 INFO:teuthology.orchestra.run.smithi177.stdout:530 punch from 0xa5b65e4 to 0xa5c0acd, (0xa4e9 bytes) 2019-12-16T22:45:23.239 INFO:teuthology.orchestra.run.smithi177.stdout:531 read 0xe81a8fe thru 0xe81df39 (0x363c bytes) 2019-12-16T22:45:23.239 INFO:teuthology.orchestra.run.smithi177.stdout:532 write 0x9e5a7a5 thru 0x9e6120c (0x6a68 bytes) 2019-12-16T22:45:23.251 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone3 from 0xe456e24 (overlap 0x1296ac8) to 0x1dbde0 2019-12-16T22:45:23.252 INFO:teuthology.orchestra.run.smithi177.stdout:533 read 0x403a2ab thru 0x4046107 (0xbe5d bytes) 2019-12-16T22:45:23.252 INFO:teuthology.orchestra.run.smithi177.stdout:534 write 0xc165cac thru 0xc16b1b5 (0x550a bytes) 2019-12-16T22:45:23.255 INFO:teuthology.orchestra.run.smithi177.stdout:535 read 0x725f4df thru 0x725fb2a (0x64c bytes) 2019-12-16T22:45:23.256 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.256 INFO:teuthology.orchestra.run.smithi177.stdout:539 read 0x25fa88 thru 0x26bea5 (0xc41e bytes) 2019-12-16T22:45:23.257 INFO:teuthology.orchestra.run.smithi177.stdout:540 read 0x3d99a45 thru 0x3da91f3 (0xf7af bytes) 2019-12-16T22:45:23.257 INFO:teuthology.orchestra.run.smithi177.stdout:541 writesame 0xe69c93b thru 0xe6a3347 data_size 0x1(0x6a0d bytes) 2019-12-16T22:45:23.257 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone3 from 0xcfc0644 (overlap 0x3a3e52) to 0x0 2019-12-16T22:45:23.291 INFO:teuthology.orchestra.run.smithi177.stdout:543 punch from 0x144ff1d to 0x145210a, (0x21ed bytes) 2019-12-16T22:45:23.291 INFO:teuthology.orchestra.run.smithi177.stdout:544 read 0xcea785b thru 0xceaba28 (0x41ce bytes) 2019-12-16T22:45:23.318 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone3 from 0x8d6bfb5 (overlap 0x2b7f252) to 0xd0c8b2 2019-12-16T22:45:23.325 INFO:teuthology.orchestra.run.smithi177.stdout:546 writesame 0xed316bd thru 0xed3a085 data_size 0x1(0x89c9 bytes) 2019-12-16T22:45:23.335 INFO:teuthology.orchestra.run.smithi177.stdout:552 read 0x9051f2 thru 0x909f19 (0x4d28 bytes) 2019-12-16T22:45:23.335 INFO:teuthology.orchestra.run.smithi177.stdout:553 writesame 0x2a39cf0 thru 0x2a3c5d2 data_size 0x3(0x28e3 bytes) 2019-12-16T22:45:23.354 INFO:teuthology.orchestra.run.smithi177.stdout:554 read 0x18a9c92 thru 0x18ad94c (0x3cbb bytes) 2019-12-16T22:45:23.355 INFO:teuthology.orchestra.run.smithi177.stdout:555 write 0x5e941fe thru 0x5e994a2 (0x52a5 bytes) 2019-12-16T22:45:23.370 INFO:teuthology.orchestra.run.smithi177.stdout:557 write 0xc0d039 thru 0xc0eb1a (0x1ae2 bytes) 2019-12-16T22:45:23.378 INFO:teuthology.orchestra.run.smithi177.stdout:558 clone 5 order 24 su 2097152 sc 6 2019-12-16T22:45:23.436 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #2, image image_cluster1.client.mirror.5-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent3 2019-12-16T22:45:23.446 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #2, image image_cluster1.client.mirror.0-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent3 2019-12-16T22:45:23.467 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.468 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.468 INFO:teuthology.orchestra.run.smithi177.stdout:639 write 0x1269c93 thru 0x12711e8 (0x7556 bytes) 2019-12-16T22:45:23.488 INFO:teuthology.orchestra.run.smithi177.stdout:640 punch from 0xa8a91f7 to 0xa8b2beb, (0x99f4 bytes) 2019-12-16T22:45:23.496 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.31315741163) > weight (0.25) 2019-12-16T22:45:23.496 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2019-12-16T22:45:23.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2019-12-16T22:45:23.497 INFO:tasks.rbd_mirror_thrash:waiting for 3 secs before reviving daemons 2019-12-16T22:45:23.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:45:23.494+0000 7f184764c700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 14295) UID: 1000 2019-12-16T22:45:23.505 INFO:teuthology.orchestra.run.smithi177.stdout:642 trunc from 0xe456e24 to 0x537e039 2019-12-16T22:45:23.526 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #2, image image_cluster1.client.mirror.1-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent3 2019-12-16T22:45:23.580 INFO:teuthology.orchestra.run.smithi177.stdout:654 trunc from 0x8d6bfb5 to 0xe1834a6 2019-12-16T22:45:23.601 INFO:teuthology.orchestra.run.smithi177.stdout:643 trunc from 0x537e039 to 0xdfafa5e 2019-12-16T22:45:23.617 INFO:teuthology.orchestra.run.smithi177.stdout:655 read 0x549b06b thru 0x54a5099 (0xa02f bytes) 2019-12-16T22:45:23.617 INFO:teuthology.orchestra.run.smithi177.stdout:656 writesame 0x13f8beb thru 0x14006d2 data_size 0x26(0x7ae8 bytes) 2019-12-16T22:45:23.631 INFO:teuthology.orchestra.run.smithi177.stdout:644 trunc from 0xdfafa5e to 0x3d23f6e 2019-12-16T22:45:23.647 INFO:teuthology.orchestra.run.smithi177.stdout:657 write 0xd15ddc3 thru 0xd16231a (0x4558 bytes) 2019-12-16T22:45:23.674 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.681 INFO:teuthology.orchestra.run.smithi177.stdout:659 trunc from 0xe1834a6 to 0xa515517 2019-12-16T22:45:23.686 INFO:teuthology.orchestra.run.smithi177.stdout:646 punch from 0x366fc81 to 0x3679e6c, (0xa1eb bytes) 2019-12-16T22:45:23.701 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:daemon-helper: command failed with exit status 1 2019-12-16T22:45:23.719 INFO:teuthology.orchestra.run.smithi177.stdout:647 write 0x83bdcb5 thru 0x83bf4d4 (0x1820 bytes) 2019-12-16T22:45:23.756 INFO:teuthology.orchestra.run.smithi177.stdout:368 trunc from 0xcfc0644 to 0xb8a4e6d 2019-12-16T22:45:23.785 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.785 INFO:teuthology.orchestra.run.smithi177.stdout:663 punch from 0x9dda207 to 0x9de9fd6, (0xfdcf bytes) 2019-12-16T22:45:23.785 INFO:teuthology.orchestra.run.smithi177.stdout:664 read 0x2b34811 thru 0x2b3b09b (0x688b bytes) 2019-12-16T22:45:23.786 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.802 INFO:teuthology.orchestra.run.smithi177.stdout:648 writesame 0xda3760c thru 0xda37745 data_size 0x1(0x13a bytes) 2019-12-16T22:45:23.803 INFO:teuthology.orchestra.run.smithi177.stdout:666 trunc from 0xa515517 to 0x17fe2d3 2019-12-16T22:45:23.807 INFO:teuthology.orchestra.run.smithi177.stdout:649 write 0xb9ce6b2 thru 0xb9d8c99 (0xa5e8 bytes) 2019-12-16T22:45:23.830 INFO:teuthology.orchestra.run.smithi177.stdout:650 write 0x4d0f365 thru 0x4d11918 (0x25b4 bytes) 2019-12-16T22:45:23.838 INFO:teuthology.orchestra.run.smithi177.stdout:651 write 0xc656bda thru 0xc657a58 (0xe7f bytes) 2019-12-16T22:45:23.840 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.840 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.840 INFO:teuthology.orchestra.run.smithi177.stdout:669 read 0x7e9983 thru 0x7f41c9 (0xa847 bytes) 2019-12-16T22:45:23.842 INFO:teuthology.orchestra.run.smithi177.stdout:670 read 0x166510e thru 0x1667c6a (0x2b5d bytes) 2019-12-16T22:45:23.842 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.842 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.842 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.845 INFO:teuthology.orchestra.run.smithi177.stdout:652 write 0x3641b8d thru 0x3650c6d (0xf0e1 bytes) 2019-12-16T22:45:23.853 INFO:teuthology.orchestra.run.smithi177.stdout:653 write 0xd6f5f75 thru 0xd6f87f8 (0x2884 bytes) 2019-12-16T22:45:23.857 INFO:teuthology.orchestra.run.smithi177.stdout:370 write 0x83ad998 thru 0x83b56f3 (0x7d5c bytes) 2019-12-16T22:45:23.862 INFO:teuthology.orchestra.run.smithi177.stdout:655 read 0x9756f81 thru 0x9762496 (0xb516 bytes) 2019-12-16T22:45:23.863 INFO:teuthology.orchestra.run.smithi177.stdout:656 punch from 0x730678f to 0x730dd73, (0x75e4 bytes) 2019-12-16T22:45:23.863 INFO:teuthology.orchestra.run.smithi177.stdout:657 read 0xac6842b thru 0xac6b5c8 (0x319e bytes) 2019-12-16T22:45:23.863 INFO:teuthology.orchestra.run.smithi177.stdout:658 write 0x1f2a5cc thru 0x1f37c85 (0xd6ba bytes) 2019-12-16T22:45:23.867 INFO:teuthology.orchestra.run.smithi177.stdout:675 trunc from 0x17fe2d3 to 0xe216991 2019-12-16T22:45:23.874 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.875 INFO:teuthology.orchestra.run.smithi177.stdout:375 write 0xa3da9f8 thru 0xa3e2ffd (0x8606 bytes) 2019-12-16T22:45:23.881 INFO:teuthology.orchestra.run.smithi177.stdout:660 read 0xb53bcd2 thru 0xb543db7 (0x80e6 bytes) 2019-12-16T22:45:23.881 INFO:teuthology.orchestra.run.smithi177.stdout:661 read 0xa32f63 thru 0xa33b58 (0xbf6 bytes) 2019-12-16T22:45:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:662 read 0x2e67ccd thru 0x2e70bea (0x8f1e bytes) 2019-12-16T22:45:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:663 read 0x898b270 thru 0x89940e5 (0x8e76 bytes) 2019-12-16T22:45:23.883 INFO:teuthology.orchestra.run.smithi177.stdout:665 punch from 0x21fc929 to 0x21fd8d9, (0xfb0 bytes) 2019-12-16T22:45:23.887 INFO:teuthology.orchestra.run.smithi177.stdout:376 write 0x7ac778e thru 0x7acabb2 (0x3425 bytes) 2019-12-16T22:45:23.894 INFO:teuthology.orchestra.run.smithi177.stdout:377 write 0x523ccb8 thru 0x52452bf (0x8608 bytes) 2019-12-16T22:45:23.901 INFO:teuthology.orchestra.run.smithi177.stdout:666 trunc from 0xda37746 to 0x4e7f918 2019-12-16T22:45:23.904 INFO:teuthology.orchestra.run.smithi177.stdout:378 read 0x96745b4 thru 0x9681730 (0xd17d bytes) 2019-12-16T22:45:23.905 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:23.905 INFO:teuthology.orchestra.run.smithi177.stdout:380 write 0x800628d thru 0x8007f20 (0x1c94 bytes) 2019-12-16T22:45:23.906 INFO:teuthology.orchestra.run.smithi177.stdout:676 trunc from 0xe216991 to 0x443c7f0 2019-12-16T22:45:23.917 INFO:teuthology.orchestra.run.smithi177.stdout:381 read 0x123c7fe thru 0x124984d (0xd050 bytes) 2019-12-16T22:45:23.918 INFO:teuthology.orchestra.run.smithi177.stdout:383 read 0xb01e45d thru 0xb02e281 (0xfe25 bytes) 2019-12-16T22:45:23.918 INFO:teuthology.orchestra.run.smithi177.stdout:384 read 0x66ea561 thru 0x66f728e (0xcd2e bytes) 2019-12-16T22:45:23.928 INFO:teuthology.orchestra.run.smithi177.stdout:677 writesame 0x2f39e25 thru 0x2f3f300 data_size 0x2(0x54dc bytes) 2019-12-16T22:45:23.934 INFO:teuthology.orchestra.run.smithi177.stdout:386 trunc from 0xb8a4e6d to 0x1bf4816 2019-12-16T22:45:23.937 INFO:teuthology.orchestra.run.smithi177.stdout:668 writesame 0x70fbe0 thru 0x71bebc data_size 0xb(0xc2dd bytes) 2019-12-16T22:45:24.093 INFO:teuthology.orchestra.run.smithi177.stdout:672 write 0x7446ab8 thru 0x7452536 (0xba7f bytes) 2019-12-16T22:45:24.094 INFO:teuthology.orchestra.run.smithi177.stdout:678 write 0xac623f5 thru 0xac6e841 (0xc44d bytes) 2019-12-16T22:45:24.113 INFO:teuthology.orchestra.run.smithi177.stdout:679 read 0x7b5185c thru 0x7b523a5 (0xb4a bytes) 2019-12-16T22:45:24.113 INFO:teuthology.orchestra.run.smithi177.stdout:673 punch from 0x1aa6d3 to 0x1b384e, (0x917b bytes) 2019-12-16T22:45:24.114 INFO:teuthology.orchestra.run.smithi177.stdout:674 read 0x567c925 thru 0x567f56d (0x2c49 bytes) 2019-12-16T22:45:24.146 INFO:teuthology.orchestra.run.smithi177.stdout:681 write 0xd4016dd thru 0xd408771 (0x7095 bytes) 2019-12-16T22:45:24.153 INFO:teuthology.orchestra.run.smithi177.stdout:682 write 0xb95fad9 thru 0xb96f206 (0xf72e bytes) 2019-12-16T22:45:24.166 INFO:teuthology.orchestra.run.smithi177.stdout:683 writesame 0x6845506 thru 0x684911a data_size 0x3(0x3c15 bytes) 2019-12-16T22:45:24.170 INFO:teuthology.orchestra.run.smithi177.stdout:675 write 0xeab3447 thru 0xeabe6e2 (0xb29c bytes) 2019-12-16T22:45:24.175 INFO:teuthology.orchestra.run.smithi177.stdout:684 writesame 0xd04349f thru 0xd046f1e data_size 0x27(0x3a80 bytes) 2019-12-16T22:45:24.185 INFO:teuthology.orchestra.run.smithi177.stdout:387 writesame 0x4bfecb3 thru 0x4c05d11 data_size 0x2b(0x705f bytes) 2019-12-16T22:45:24.185 INFO:teuthology.orchestra.run.smithi177.stdout:388 punch from 0x453cc78 to 0x453eb97, (0x1f1f bytes) 2019-12-16T22:45:24.185 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.185 INFO:teuthology.orchestra.run.smithi177.stdout:390 read 0x12626a thru 0x1309d2 (0xa769 bytes) 2019-12-16T22:45:24.185 INFO:teuthology.orchestra.run.smithi177.stdout:391 write 0x334c181 thru 0x33573d0 (0xb250 bytes) 2019-12-16T22:45:24.185 INFO:teuthology.orchestra.run.smithi177.stdout:685 write 0x19b89a2 thru 0x19c1530 (0x8b8f bytes) 2019-12-16T22:45:24.186 INFO:teuthology.orchestra.run.smithi177.stdout:676 write 0xa59f6ae thru 0xa5a7eeb (0x883e bytes) 2019-12-16T22:45:24.189 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.190 INFO:teuthology.orchestra.run.smithi177.stdout:687 write 0x73e9878 thru 0x73f767d (0xde06 bytes) 2019-12-16T22:45:24.196 INFO:teuthology.orchestra.run.smithi177.stdout:688 read 0x98ea492 thru 0x98f4a3a (0xa5a9 bytes) 2019-12-16T22:45:24.198 INFO:teuthology.orchestra.run.smithi177.stdout:677 write 0x8e8a7ea thru 0x8e8f727 (0x4f3e bytes) 2019-12-16T22:45:24.201 INFO:teuthology.orchestra.run.smithi177.stdout:392 writesame 0x2e83817 thru 0x2e8fe96 data_size 0x20(0xc680 bytes) 2019-12-16T22:45:24.206 INFO:teuthology.orchestra.run.smithi177.stdout:679 punch from 0xaf988c9 to 0xafa7f54, (0xf68b bytes) 2019-12-16T22:45:24.206 INFO:teuthology.orchestra.run.smithi177.stdout:680 punch from 0x7847700 to 0x7856dcc, (0xf6cc bytes) 2019-12-16T22:45:24.206 INFO:teuthology.orchestra.run.smithi177.stdout:682 write 0x437aa65 thru 0x437ea08 (0x3fa4 bytes) 2019-12-16T22:45:24.210 INFO:teuthology.orchestra.run.smithi177.stdout:394 read 0xb06361 thru 0xb09fd5 (0x3c75 bytes) 2019-12-16T22:45:24.211 INFO:teuthology.orchestra.run.smithi177.stdout:683 punch from 0x85c907e to 0x85d168a, (0x860c bytes) 2019-12-16T22:45:24.211 INFO:teuthology.orchestra.run.smithi177.stdout:684 write 0x5fa1f08 thru 0x5fa9254 (0x734d bytes) 2019-12-16T22:45:24.218 INFO:teuthology.orchestra.run.smithi177.stdout:686 write 0x209a6ab thru 0x209ba82 (0x13d8 bytes) 2019-12-16T22:45:24.239 INFO:teuthology.orchestra.run.smithi177.stdout:691 trunc from 0xd408772 to 0x16f1de6 2019-12-16T22:45:24.239 INFO:teuthology.orchestra.run.smithi177.stdout:687 write 0x57cfd58 thru 0x57dc8c6 (0xcb6f bytes) 2019-12-16T22:45:24.250 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.250 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.250 INFO:teuthology.orchestra.run.smithi177.stdout:694 write 0xc1b2631 thru 0xc1b3530 (0xf00 bytes) 2019-12-16T22:45:24.258 INFO:teuthology.orchestra.run.smithi177.stdout:697 read 0x409c6a3 thru 0x40a8525 (0xbe83 bytes) 2019-12-16T22:45:24.258 INFO:teuthology.orchestra.run.smithi177.stdout:698 punch from 0x2823d9e to 0x2825eb0, (0x2112 bytes) 2019-12-16T22:45:24.258 INFO:teuthology.orchestra.run.smithi177.stdout:699 punch from 0x4ee3f4f to 0x4eee3aa, (0xa45b bytes) 2019-12-16T22:45:24.258 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.258 INFO:teuthology.orchestra.run.smithi177.stdout:703 write 0xcc832d2 thru 0xcc88425 (0x5154 bytes) 2019-12-16T22:45:24.260 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.3-clone4 intact 2019-12-16T22:45:24.261 INFO:teuthology.orchestra.run.smithi177.stdout:396 write 0x9bc787c thru 0x9bcc456 (0x4bdb bytes) 2019-12-16T22:45:24.268 INFO:teuthology.orchestra.run.smithi177.stdout:705 punch from 0x6351e94 to 0x63565ff, (0x476b bytes) 2019-12-16T22:45:24.269 INFO:teuthology.orchestra.run.smithi177.stdout:706 read 0xa85c11 thru 0xa8fe46 (0xa236 bytes) 2019-12-16T22:45:24.269 INFO:teuthology.orchestra.run.smithi177.stdout:708 read 0x515bee5 thru 0x515f95d (0x3a79 bytes) 2019-12-16T22:45:24.269 INFO:teuthology.orchestra.run.smithi177.stdout:709 writesame 0x55a4241 thru 0x55a6929 data_size 0x1(0x26e9 bytes) 2019-12-16T22:45:24.274 INFO:teuthology.orchestra.run.smithi177.stdout:397 read 0x1d56db5 thru 0x1d6546b (0xe6b7 bytes) 2019-12-16T22:45:24.274 INFO:teuthology.orchestra.run.smithi177.stdout:399 writesame 0x82cba23 thru 0x82da8a8 data_size 0x3(0xee86 bytes) 2019-12-16T22:45:24.279 INFO:teuthology.orchestra.run.smithi177.stdout:710 read 0x2b67f0f thru 0x2b712f2 (0x93e4 bytes) 2019-12-16T22:45:24.280 INFO:teuthology.orchestra.run.smithi177.stdout:712 writesame 0x45f7f02 thru 0x4605669 data_size 0x8(0xd768 bytes) 2019-12-16T22:45:24.287 INFO:teuthology.orchestra.run.smithi177.stdout:713 write 0x297e3d5 thru 0x2985d03 (0x792f bytes) 2019-12-16T22:45:24.292 INFO:teuthology.orchestra.run.smithi177.stdout:400 punch from 0x46d8d7b to 0x46dafc0, (0x2245 bytes) 2019-12-16T22:45:24.292 INFO:teuthology.orchestra.run.smithi177.stdout:401 punch from 0x44b892 to 0x44dbb6, (0x2324 bytes) 2019-12-16T22:45:24.293 INFO:teuthology.orchestra.run.smithi177.stdout:714 writesame 0xa6b5947 thru 0xa6c571a data_size 0xb4(0xfdd4 bytes) 2019-12-16T22:45:24.295 INFO:teuthology.orchestra.run.smithi177.stdout:692 write 0xca51665 thru 0xca54f3c (0x38d8 bytes) 2019-12-16T22:45:24.299 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.300 INFO:teuthology.orchestra.run.smithi177.stdout:694 punch from 0xb77979 to 0xb85ee6, (0xe56d bytes) 2019-12-16T22:45:24.300 INFO:teuthology.orchestra.run.smithi177.stdout:695 punch from 0x37642f6 to 0x376e6a6, (0xa3b0 bytes) 2019-12-16T22:45:24.300 INFO:teuthology.orchestra.run.smithi177.stdout:697 write 0x367a052 thru 0x367b207 (0x11b6 bytes) 2019-12-16T22:45:24.305 INFO:teuthology.orchestra.run.smithi177.stdout:715 trunc from 0xeabe6e3 to 0xcb78c02 2019-12-16T22:45:24.312 INFO:teuthology.orchestra.run.smithi177.stdout:699 trunc from 0xca54f3d to 0x9900561 2019-12-16T22:45:24.316 INFO:teuthology.orchestra.run.smithi177.stdout:402 write 0xc1bdee8 thru 0xc1c5d76 (0x7e8f bytes) 2019-12-16T22:45:24.328 INFO:teuthology.orchestra.run.smithi177.stdout:403 write 0x1f8ff5 thru 0x207164 (0xe170 bytes) 2019-12-16T22:45:24.339 INFO:teuthology.orchestra.run.smithi177.stdout:716 trunc from 0xcb78c02 to 0xa8c808d 2019-12-16T22:45:24.340 INFO:teuthology.orchestra.run.smithi177.stdout:700 punch from 0x34fd972 to 0x34feb55, (0x11e3 bytes) 2019-12-16T22:45:24.341 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.341 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.341 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #2, image image_cluster1.client.mirror.2-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent3 2019-12-16T22:45:24.348 INFO:teuthology.orchestra.run.smithi177.stdout:406 write 0xb85083b thru 0xb85dfad (0xd773 bytes) 2019-12-16T22:45:24.357 INFO:teuthology.orchestra.run.smithi177.stdout:409 read 0x16051d3 thru 0x160757b (0x23a9 bytes) 2019-12-16T22:45:24.357 INFO:teuthology.orchestra.run.smithi177.stdout:705 trunc from 0x9900561 to 0x13ca1f1 2019-12-16T22:45:24.358 INFO:teuthology.orchestra.run.smithi177.stdout:410 writesame 0x7b1e7c3 thru 0x7b1f29b data_size 0x1(0xad9 bytes) 2019-12-16T22:45:24.366 INFO:teuthology.orchestra.run.smithi177.stdout:411 read 0x552907a thru 0x552e57d (0x5504 bytes) 2019-12-16T22:45:24.366 INFO:teuthology.orchestra.run.smithi177.stdout:717 write 0x9fecc86 thru 0x9ff91d5 (0xc550 bytes) 2019-12-16T22:45:24.372 INFO:teuthology.orchestra.run.smithi177.stdout:718 read 0x3b55109 thru 0x3b59efe (0x4df6 bytes) 2019-12-16T22:45:24.373 INFO:teuthology.orchestra.run.smithi177.stdout:719 write 0x2409b57 thru 0x240c4f5 (0x299f bytes) 2019-12-16T22:45:24.376 INFO:teuthology.orchestra.run.smithi177.stdout:720 punch from 0x85b3327 to 0x85be295, (0xaf6e bytes) 2019-12-16T22:45:24.377 INFO:teuthology.orchestra.run.smithi177.stdout:721 read 0x85ac8c thru 0x85ed8c (0x4101 bytes) 2019-12-16T22:45:24.377 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.378 INFO:teuthology.orchestra.run.smithi177.stdout:724 read 0x6ff0efb thru 0x6ff5a48 (0x4b4e bytes) 2019-12-16T22:45:24.378 INFO:teuthology.orchestra.run.smithi177.stdout:726 writesame 0x5dd8cf8 thru 0x5de3c5f data_size 0xc(0xaf68 bytes) 2019-12-16T22:45:24.383 INFO:teuthology.orchestra.run.smithi177.stdout:707 read 0xd3a912 thru 0xd4693e (0xc02d bytes) 2019-12-16T22:45:24.384 INFO:teuthology.orchestra.run.smithi177.stdout:708 read 0xea6656 thru 0xeab3b7 (0x4d62 bytes) 2019-12-16T22:45:24.386 INFO:teuthology.orchestra.run.smithi177.stdout:727 punch from 0x8413d7 to 0x844fe2, (0x3c0b bytes) 2019-12-16T22:45:24.387 INFO:teuthology.orchestra.run.smithi177.stdout:728 read 0x7da5681 thru 0x7db5508 (0xfe88 bytes) 2019-12-16T22:45:24.387 INFO:teuthology.orchestra.run.smithi177.stdout:729 read 0x6639cb3 thru 0x6644f93 (0xb2e1 bytes) 2019-12-16T22:45:24.387 INFO:teuthology.orchestra.run.smithi177.stdout:412 writesame 0xc8917fc thru 0xc89843f data_size 0x52(0x6c44 bytes) 2019-12-16T22:45:24.388 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.388 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.398 INFO:teuthology.orchestra.run.smithi177.stdout:730 trunc from 0xa8c808d to 0x67f045c 2019-12-16T22:45:24.402 INFO:teuthology.orchestra.run.smithi177.stdout:415 trunc from 0xc898440 to 0x7075aad 2019-12-16T22:45:24.452 INFO:teuthology.orchestra.run.smithi177.stdout:709 write 0xbafaf53 thru 0xbb01b85 (0x6c33 bytes) 2019-12-16T22:45:24.464 INFO:teuthology.orchestra.run.smithi177.stdout:710 trunc from 0xbb01b86 to 0xe5a2222 2019-12-16T22:45:24.473 INFO:teuthology.orchestra.run.smithi177.stdout:731 writesame 0x51d98f7 thru 0x51e4953 data_size 0x17(0xb05d bytes) 2019-12-16T22:45:24.497 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.497 INFO:teuthology.orchestra.run.smithi177.stdout:712 read 0x6e88b60 thru 0x6e8ce9c (0x433d bytes) 2019-12-16T22:45:24.498 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.498 INFO:teuthology.orchestra.run.smithi177.stdout:716 writesame 0xae2b62d thru 0xae3ab52 data_size 0x1(0xf526 bytes) 2019-12-16T22:45:24.530 INFO:teuthology.orchestra.run.smithi177.stdout:417 read 0x17c6efe thru 0x17ce365 (0x7468 bytes) 2019-12-16T22:45:24.531 INFO:teuthology.orchestra.run.smithi177.stdout:419 flatten 2019-12-16T22:45:24.535 INFO:teuthology.orchestra.run.smithi177.stdout:732 write 0x7b7e6c3 thru 0x7b84be6 (0x6524 bytes) 2019-12-16T22:45:24.565 INFO:teuthology.orchestra.run.smithi177.stdout:717 punch from 0x1561b62 to 0x1569f7e, (0x841c bytes) 2019-12-16T22:45:24.574 INFO:teuthology.orchestra.run.smithi177.stdout:734 read 0x331d038 thru 0x331d635 (0x5fe bytes) 2019-12-16T22:45:24.575 INFO:teuthology.orchestra.run.smithi177.stdout:735 punch from 0x50dc37d to 0x50e3dab, (0x7a2e bytes) 2019-12-16T22:45:24.575 INFO:teuthology.orchestra.run.smithi177.stdout:737 read 0x416b76a thru 0x416f52e (0x3dc5 bytes) 2019-12-16T22:45:24.579 INFO:teuthology.orchestra.run.smithi177.stdout:738 trunc from 0x7b84be7 to 0x5b328d1 2019-12-16T22:45:24.582 INFO:teuthology.orchestra.run.smithi177.stdout:718 trunc from 0xe5a2222 to 0x5201dc1 2019-12-16T22:45:24.591 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #3, image image_cluster1.client.mirror.3-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent4 2019-12-16T22:45:24.612 INFO:teuthology.orchestra.run.smithi177.stdout:420 read 0x2a8bf43 thru 0x2a90262 (0x4320 bytes) 2019-12-16T22:45:24.612 INFO:teuthology.orchestra.run.smithi177.stdout:422 writesame 0x21ff3df thru 0x220c854 data_size 0xb9(0xd476 bytes) 2019-12-16T22:45:24.635 INFO:teuthology.orchestra.run.smithi177.stdout:739 punch from 0x1d604c1 to 0x1d652ff, (0x4e3e bytes) 2019-12-16T22:45:24.635 INFO:teuthology.orchestra.run.smithi177.stdout:742 read 0x4583612 thru 0x459004e (0xca3d bytes) 2019-12-16T22:45:24.647 INFO:teuthology.orchestra.run.smithi177.stdout:423 read 0xdb98a2 thru 0xdc392d (0xa08c bytes) 2019-12-16T22:45:24.648 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.649 INFO:teuthology.orchestra.run.smithi177.stdout:426 punch from 0x43ad616 to 0x43b6af2, (0x94dc bytes) 2019-12-16T22:45:24.649 INFO:teuthology.orchestra.run.smithi177.stdout:427 read 0x446f6a9 thru 0x44784e1 (0x8e39 bytes) 2019-12-16T22:45:24.661 INFO:teuthology.orchestra.run.smithi177.stdout:719 write 0x688d65c thru 0x6893f77 (0x691c bytes) 2019-12-16T22:45:24.663 INFO:teuthology.orchestra.run.smithi177.stdout:428 trunc from 0x7075aad to 0xad09ef 2019-12-16T22:45:24.664 INFO:teuthology.orchestra.run.smithi177.stdout:743 writesame 0x607ea7c thru 0x6085f9c data_size 0x5(0x7521 bytes) 2019-12-16T22:45:24.666 INFO:teuthology.orchestra.run.smithi177.stdout:745 read 0x52525d2 thru 0x5252737 (0x166 bytes) 2019-12-16T22:45:24.667 INFO:teuthology.orchestra.run.smithi177.stdout:721 read 0x27dcea5 thru 0x27e539e (0x84fa bytes) 2019-12-16T22:45:24.667 INFO:teuthology.orchestra.run.smithi177.stdout:722 read 0x19f048d thru 0x19fcde6 (0xc95a bytes) 2019-12-16T22:45:24.681 INFO:teuthology.orchestra.run.smithi177.stdout:747 trunc from 0x6085f9d to 0xd46b0f4 2019-12-16T22:45:24.681 INFO:teuthology.orchestra.run.smithi177.stdout:723 trunc from 0x6893f78 to 0xbd217e 2019-12-16T22:45:24.733 INFO:teuthology.orchestra.run.smithi177.stdout:748 trunc from 0xd46b0f4 to 0xd04855b 2019-12-16T22:45:24.742 INFO:teuthology.orchestra.run.smithi177.stdout:724 read 0x46e081 thru 0x47721b (0x919b bytes) 2019-12-16T22:45:24.743 INFO:teuthology.orchestra.run.smithi177.stdout:726 read 0xa4d755 thru 0xa55ae4 (0x8390 bytes) 2019-12-16T22:45:24.744 INFO:teuthology.orchestra.run.smithi177.stdout:727 read 0x75e69a thru 0x768b95 (0xa4fc bytes) 2019-12-16T22:45:24.746 INFO:teuthology.orchestra.run.smithi177.stdout:728 read 0x8d3ca7 thru 0x8d7e10 (0x416a bytes) 2019-12-16T22:45:24.769 INFO:teuthology.orchestra.run.smithi177.stdout:729 write 0x2415ee2 thru 0x24169c4 (0xae3 bytes) 2019-12-16T22:45:24.774 INFO:teuthology.orchestra.run.smithi177.stdout:749 writesame 0x80b1962 thru 0x80b95fe data_size 0x17(0x7c9d bytes) 2019-12-16T22:45:24.787 INFO:teuthology.orchestra.run.smithi177.stdout:750 trunc from 0xd04855b to 0xa5a4b48 2019-12-16T22:45:24.792 INFO:teuthology.orchestra.run.smithi177.stdout:731 read 0x15d4bc7 thru 0x15df17a (0xa5b4 bytes) 2019-12-16T22:45:24.793 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.809 INFO:teuthology.orchestra.run.smithi177.stdout:752 write 0xa15d0b4 thru 0xa16c697 (0xf5e4 bytes) 2019-12-16T22:45:24.822 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.822 INFO:teuthology.orchestra.run.smithi177.stdout:754 writesame 0x7dfc892 thru 0x7e00a70 data_size 0x21(0x41df bytes) 2019-12-16T22:45:24.832 INFO:teuthology.orchestra.run.smithi177.stdout:734 write 0x8fc7bf5 thru 0x8fd175e (0x9b6a bytes) 2019-12-16T22:45:24.834 INFO:teuthology.orchestra.run.smithi177.stdout:755 read 0x821c71d thru 0x8225c6c (0x9550 bytes) 2019-12-16T22:45:24.844 INFO:teuthology.orchestra.run.smithi177.stdout:429 write 0xb1e053d thru 0xb1e532c (0x4df0 bytes) 2019-12-16T22:45:24.858 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.873 INFO:teuthology.orchestra.run.smithi177.stdout:757 write 0xe84aaa2 thru 0xe8534d4 (0x8a33 bytes) 2019-12-16T22:45:24.882 INFO:teuthology.orchestra.run.smithi177.stdout:760 write 0xa6ef709 thru 0xa6fa671 (0xaf69 bytes) 2019-12-16T22:45:24.887 INFO:teuthology.orchestra.run.smithi177.stdout:430 writesame 0xc723e82 thru 0xc73136d data_size 0x2(0xd4ec bytes) 2019-12-16T22:45:24.887 INFO:teuthology.orchestra.run.smithi177.stdout:736 write 0xd9e9174 thru 0xd9f4212 (0xb09f bytes) 2019-12-16T22:45:24.890 INFO:teuthology.orchestra.run.smithi177.stdout:431 write 0x872d5cc thru 0x8736cc6 (0x96fb bytes) 2019-12-16T22:45:24.892 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.893 INFO:teuthology.orchestra.run.smithi177.stdout:762 punch from 0xdd5c2a6 to 0xdd67be9, (0xb943 bytes) 2019-12-16T22:45:24.898 INFO:teuthology.orchestra.run.smithi177.stdout:737 trunc from 0xd9f4213 to 0xe456065 2019-12-16T22:45:24.900 INFO:teuthology.orchestra.run.smithi177.stdout:763 trunc from 0xe8534d5 to 0xab24660 2019-12-16T22:45:24.936 INFO:teuthology.orchestra.run.smithi177.stdout:432 clone 5 order 22 su 524288 sc 13 2019-12-16T22:45:24.947 INFO:teuthology.orchestra.run.smithi177.stdout:738 write 0x5c050d8 thru 0x5c11862 (0xc78b bytes) 2019-12-16T22:45:24.971 INFO:teuthology.orchestra.run.smithi177.stdout:739 punch from 0x279a8c8 to 0x27a7a0e, (0xd146 bytes) 2019-12-16T22:45:24.971 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.971 INFO:teuthology.orchestra.run.smithi177.stdout:742 read 0x773a35f thru 0x77472e9 (0xcf8b bytes) 2019-12-16T22:45:24.972 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.972 INFO:teuthology.orchestra.run.smithi177.stdout:745 punch from 0x42663f1 to 0x42724cc, (0xc0db bytes) 2019-12-16T22:45:24.972 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:24.973 INFO:teuthology.orchestra.run.smithi177.stdout:747 read 0x232a31d thru 0x232a7d6 (0x4ba bytes) 2019-12-16T22:45:24.973 INFO:teuthology.orchestra.run.smithi177.stdout:748 write 0x156ce58 thru 0x156dcf9 (0xea2 bytes) 2019-12-16T22:45:24.976 INFO:teuthology.orchestra.run.smithi177.stdout:560 write 0x58348d9 thru 0x5843d3a (0xf462 bytes) 2019-12-16T22:45:24.991 INFO:teuthology.orchestra.run.smithi177.stdout:749 read 0x1ad145e thru 0x1ad1b3d (0x6e0 bytes) 2019-12-16T22:45:24.991 INFO:teuthology.orchestra.run.smithi177.stdout:750 read 0x2b39d4 thru 0x2beff8 (0xb625 bytes) 2019-12-16T22:45:24.992 INFO:teuthology.orchestra.run.smithi177.stdout:751 punch from 0x21f8bb3 to 0x21fe4c3, (0x5910 bytes) 2019-12-16T22:45:24.998 INFO:teuthology.orchestra.run.smithi177.stdout:752 trunc from 0xe456065 to 0xc794e7b 2019-12-16T22:45:25.000 INFO:teuthology.orchestra.run.smithi177.stdout:764 punch from 0x5ca6bf8 to 0x5ca9420, (0x2828 bytes) 2019-12-16T22:45:25.025 INFO:teuthology.orchestra.run.smithi177.stdout:766 trunc from 0xab24660 to 0x148cea 2019-12-16T22:45:25.056 INFO:teuthology.orchestra.run.smithi177.stdout:561 write 0xbc494bf thru 0xbc4ffa3 (0x6ae5 bytes) 2019-12-16T22:45:25.074 INFO:teuthology.orchestra.run.smithi177.stdout:563 read 0x1188a08 thru 0x11968bf (0xdeb8 bytes) 2019-12-16T22:45:25.075 INFO:teuthology.orchestra.run.smithi177.stdout:565 writesame 0x5f7b5b1 thru 0x5f8af46 data_size 0x2e(0xf996 bytes) 2019-12-16T22:45:25.080 INFO:teuthology.orchestra.run.smithi177.stdout:753 write 0xdb9003 thru 0xdbcbc1 (0x3bbf bytes) 2019-12-16T22:45:25.096 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.123 INFO:teuthology.orchestra.run.smithi177.stdout:755 trunc from 0xc794e7b to 0x1c32e51 2019-12-16T22:45:25.129 INFO:teuthology.orchestra.run.smithi177.stdout:567 punch from 0xec2d2af to 0xec2d65e, (0x3af bytes) 2019-12-16T22:45:25.148 INFO:teuthology.orchestra.run.smithi177.stdout:568 trunc from 0xed3a086 to 0x3e255f0 2019-12-16T22:45:25.163 INFO:teuthology.orchestra.run.smithi177.stdout:767 trunc from 0x148cea to 0x5ce9570 2019-12-16T22:45:25.167 INFO:teuthology.orchestra.run.smithi177.stdout:756 trunc from 0x1c32e51 to 0xa227764 2019-12-16T22:45:25.231 INFO:teuthology.orchestra.run.smithi177.stdout:768 read 0x279fa74 thru 0x27a544b (0x59d8 bytes) 2019-12-16T22:45:25.232 INFO:teuthology.orchestra.run.smithi177.stdout:757 read 0x62ab582 thru 0x62b41b4 (0x8c33 bytes) 2019-12-16T22:45:25.232 INFO:teuthology.orchestra.run.smithi177.stdout:758 writesame 0x9ebbffb thru 0x9ecbf27 data_size 0xc3(0xff2d bytes) 2019-12-16T22:45:25.242 INFO:teuthology.orchestra.run.smithi177.stdout:769 trunc from 0x5ce9570 to 0xaa59e5a 2019-12-16T22:45:25.266 INFO:teuthology.orchestra.run.smithi177.stdout:569 trunc from 0x3e255f0 to 0x6f3bb9d 2019-12-16T22:45:25.269 INFO:teuthology.orchestra.run.smithi177.stdout:762 read 0x8f21420 thru 0x8f254d3 (0x40b4 bytes) 2019-12-16T22:45:25.287 INFO:teuthology.orchestra.run.smithi177.stdout:572 read 0x3794568 thru 0x379ee22 (0xa8bb bytes) 2019-12-16T22:45:25.293 INFO:teuthology.orchestra.run.smithi177.stdout:573 trunc from 0x6f3bb9d to 0xa52c30e 2019-12-16T22:45:25.296 INFO:teuthology.orchestra.run.smithi177.stdout:763 write 0xcf67970 thru 0xcf6cf29 (0x55ba bytes) 2019-12-16T22:45:25.312 INFO:teuthology.orchestra.run.smithi177.stdout:574 read 0x4e2f9f8 thru 0x4e3d13e (0xd747 bytes) 2019-12-16T22:45:25.315 INFO:teuthology.orchestra.run.smithi177.stdout:764 write 0x113fe81 thru 0x114f734 (0xf8b4 bytes) 2019-12-16T22:45:25.321 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #2, image image_cluster1.client.mirror.4-clone2 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent3 2019-12-16T22:45:25.321 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.323 INFO:teuthology.orchestra.run.smithi177.stdout:770 read 0x5fa5115 thru 0x5faa96c (0x5858 bytes) 2019-12-16T22:45:25.331 INFO:teuthology.orchestra.run.smithi177.stdout:769 trunc from 0xcf6cf2a to 0x8a2671a 2019-12-16T22:45:25.351 INFO:teuthology.orchestra.run.smithi177.stdout:575 write 0xecdef46 thru 0xece1206 (0x22c1 bytes) 2019-12-16T22:45:25.355 INFO:teuthology.orchestra.run.smithi177.stdout:771 write 0xe70f9dc thru 0xe715b41 (0x6166 bytes) 2019-12-16T22:45:25.361 INFO:teuthology.orchestra.run.smithi177.stdout:576 writesame 0x4f51b3d thru 0x4f5eab2 data_size 0x5e(0xcf76 bytes) 2019-12-16T22:45:25.363 INFO:teuthology.orchestra.run.smithi177.stdout:772 read 0xe2423a thru 0xe2e856 (0xa61d bytes) 2019-12-16T22:45:25.364 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.365 INFO:teuthology.orchestra.run.smithi177.stdout:577 punch from 0x424a00f to 0x424bab5, (0x1aa6 bytes) 2019-12-16T22:45:25.368 INFO:teuthology.orchestra.run.smithi177.stdout:772 read 0xb600e78 thru 0xb60c4a2 (0xb62b bytes) 2019-12-16T22:45:25.369 INFO:teuthology.orchestra.run.smithi177.stdout:774 punch from 0x70b149d to 0x70b5924, (0x4487 bytes) 2019-12-16T22:45:25.369 INFO:teuthology.orchestra.run.smithi177.stdout:775 write 0x820ce26 thru 0x820ebcd (0x1da8 bytes) 2019-12-16T22:45:25.372 INFO:teuthology.orchestra.run.smithi177.stdout:469 write 0xa055d77 thru 0xa05fdd8 (0xa062 bytes) 2019-12-16T22:45:25.375 INFO:teuthology.orchestra.run.smithi177.stdout:776 read 0xd2fd860 thru 0xd30b23c (0xd9dd bytes) 2019-12-16T22:45:25.378 INFO:teuthology.orchestra.run.smithi177.stdout:578 trunc from 0xece1207 to 0x8c8fe2f 2019-12-16T22:45:25.383 INFO:teuthology.orchestra.run.smithi177.stdout:778 write 0x9ec40ee thru 0x9ec67c0 (0x26d3 bytes) 2019-12-16T22:45:25.395 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.395 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.395 INFO:teuthology.orchestra.run.smithi177.stdout:783 write 0x4c6d2ca thru 0x4c74256 (0x6f8d bytes) 2019-12-16T22:45:25.409 INFO:teuthology.orchestra.run.smithi177.stdout:785 read 0x767365e thru 0x767e133 (0xaad6 bytes) 2019-12-16T22:45:25.409 INFO:teuthology.orchestra.run.smithi177.stdout:786 read 0x9961681 thru 0x996e914 (0xd294 bytes) 2019-12-16T22:45:25.410 INFO:teuthology.orchestra.run.smithi177.stdout:787 read 0x38c3db1 thru 0x38c9009 (0x5259 bytes) 2019-12-16T22:45:25.411 INFO:teuthology.orchestra.run.smithi177.stdout:788 punch from 0x57fc17e to 0x580a0cf, (0xdf51 bytes) 2019-12-16T22:45:25.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.411 INFO:teuthology.orchestra.run.smithi177.stdout:791 writesame 0x99dc248 thru 0x99dd22f data_size 0x4(0xfe8 bytes) 2019-12-16T22:45:25.416 INFO:teuthology.orchestra.run.smithi177.stdout:793 write 0x39fbe8f thru 0x3a02d68 (0x6eda bytes) 2019-12-16T22:45:25.421 INFO:teuthology.orchestra.run.smithi177.stdout:579 read 0x4ee615 thru 0x4f8343 (0x9d2f bytes) 2019-12-16T22:45:25.422 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.422 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.423 INFO:teuthology.orchestra.run.smithi177.stdout:585 write 0xac49a9 thru 0xad40c1 (0xf719 bytes) 2019-12-16T22:45:25.424 INFO:teuthology.orchestra.run.smithi177.stdout:777 writesame 0xe99d3d3 thru 0xe99f8e5 data_size 0x1(0x2513 bytes) 2019-12-16T22:45:25.437 INFO:teuthology.orchestra.run.smithi177.stdout:778 write 0xa0b13d8 thru 0xa0b4d91 (0x39ba bytes) 2019-12-16T22:45:25.442 INFO:teuthology.orchestra.run.smithi177.stdout:470 write 0x7960dd6 thru 0x7970af6 (0xfd21 bytes) 2019-12-16T22:45:25.445 INFO:teuthology.orchestra.run.smithi177.stdout:586 trunc from 0x8c8fe2f to 0xb400062 2019-12-16T22:45:25.460 INFO:teuthology.orchestra.run.smithi177.stdout:779 write 0xb4937fe thru 0xb499795 (0x5f98 bytes) 2019-12-16T22:45:25.460 INFO:teuthology.orchestra.run.smithi177.stdout:794 write 0xb4169f9 thru 0xb424872 (0xde7a bytes) 2019-12-16T22:45:25.470 INFO:teuthology.orchestra.run.smithi177.stdout:784 read 0x3a933f5 thru 0x3a9844c (0x5058 bytes) 2019-12-16T22:45:25.470 INFO:teuthology.orchestra.run.smithi177.stdout:786 writesame 0xcd6627e thru 0xcd686ac data_size 0x1(0x242f bytes) 2019-12-16T22:45:25.479 INFO:teuthology.orchestra.run.smithi177.stdout:471 read 0x2769089 thru 0x2777e4c (0xedc4 bytes) 2019-12-16T22:45:25.479 INFO:teuthology.orchestra.run.smithi177.stdout:587 writesame 0x5677e7f thru 0x56802b6 data_size 0x4(0x8438 bytes) 2019-12-16T22:45:25.481 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.481 INFO:teuthology.orchestra.run.smithi177.stdout:474 punch from 0xe26260a to 0xe26707b, (0x4a71 bytes) 2019-12-16T22:45:25.481 INFO:teuthology.orchestra.run.smithi177.stdout:478 read 0x2754cda thru 0x275f696 (0xa9bd bytes) 2019-12-16T22:45:25.482 INFO:teuthology.orchestra.run.smithi177.stdout:482 write 0x83c0832 thru 0x83c920f (0x89de bytes) 2019-12-16T22:45:25.496 INFO:teuthology.orchestra.run.smithi177.stdout:787 trunc from 0xe99f8e6 to 0x64e4934 2019-12-16T22:45:25.501 INFO:teuthology.orchestra.run.smithi177.stdout:588 read 0x12908b7 thru 0x129ecb0 (0xe3fa bytes) 2019-12-16T22:45:25.510 INFO:teuthology.orchestra.run.smithi177.stdout:483 write 0xc2fd45e thru 0xc307606 (0xa1a9 bytes) 2019-12-16T22:45:25.517 INFO:teuthology.orchestra.run.smithi177.stdout:795 writesame 0xd5c0ec6 thru 0xd5c9f41 data_size 0xe(0x907c bytes) 2019-12-16T22:45:25.529 INFO:teuthology.orchestra.run.smithi177.stdout:796 read 0x4a5b4bb thru 0x4a5ba85 (0x5cb bytes) 2019-12-16T22:45:25.529 INFO:teuthology.orchestra.run.smithi177.stdout:797 read 0x4aa296f thru 0x4aabeed (0x957f bytes) 2019-12-16T22:45:25.530 INFO:teuthology.orchestra.run.smithi177.stdout:798 write 0x576edb6 thru 0x577260c (0x3857 bytes) 2019-12-16T22:45:25.535 INFO:teuthology.orchestra.run.smithi177.stdout:788 read 0x50ac5e4 thru 0x50b3944 (0x7361 bytes) 2019-12-16T22:45:25.536 INFO:teuthology.orchestra.run.smithi177.stdout:789 writesame 0x6256071 thru 0x6262c83 data_size 0x1(0xcc13 bytes) 2019-12-16T22:45:25.536 INFO:teuthology.orchestra.run.smithi177.stdout:799 write 0x4c2d7af thru 0x4c331a4 (0x59f6 bytes) 2019-12-16T22:45:25.537 INFO:teuthology.orchestra.run.smithi177.stdout:484 writesame 0x2277606 thru 0x22830c6 data_size 0x1(0xbac1 bytes) 2019-12-16T22:45:25.547 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.547 INFO:teuthology.orchestra.run.smithi177.stdout:801 read 0x7c7aa95 thru 0x7c88d98 (0xe304 bytes) 2019-12-16T22:45:25.547 INFO:teuthology.orchestra.run.smithi177.stdout:802 punch from 0x53162c5 to 0x531fd66, (0x9aa1 bytes) 2019-12-16T22:45:25.547 INFO:teuthology.orchestra.run.smithi177.stdout:803 read 0x71c77b7 thru 0x71ca34e (0x2b98 bytes) 2019-12-16T22:45:25.548 INFO:teuthology.orchestra.run.smithi177.stdout:589 write 0xcacef3a thru 0xcacf518 (0x5df bytes) 2019-12-16T22:45:25.564 INFO:teuthology.orchestra.run.smithi177.stdout:804 trunc from 0xd5c9f42 to 0x529bb8c 2019-12-16T22:45:25.587 INFO:teuthology.orchestra.run.smithi177.stdout:591 write 0x87d2184 thru 0x87dea4b (0xc8c8 bytes) 2019-12-16T22:45:25.601 INFO:teuthology.orchestra.run.smithi177.stdout:790 trunc from 0x64e4934 to 0xc88622b 2019-12-16T22:45:25.613 INFO:teuthology.orchestra.run.smithi177.stdout:486 read 0x2f3250b thru 0x2f3a1d9 (0x7ccf bytes) 2019-12-16T22:45:25.617 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.617 INFO:teuthology.orchestra.run.smithi177.stdout:488 read 0x55d0911 thru 0x55d60fd (0x57ed bytes) 2019-12-16T22:45:25.618 INFO:teuthology.orchestra.run.smithi177.stdout:490 read 0x411c967 thru 0x412b625 (0xecbf bytes) 2019-12-16T22:45:25.618 INFO:teuthology.orchestra.run.smithi177.stdout:491 read 0xd4e7ae1 thru 0xd4e81e7 (0x707 bytes) 2019-12-16T22:45:25.618 INFO:teuthology.orchestra.run.smithi177.stdout:593 punch from 0x5c13e6c to 0x5c176d1, (0x3865 bytes) 2019-12-16T22:45:25.618 INFO:teuthology.orchestra.run.smithi177.stdout:594 read 0x90cd095 thru 0x90da256 (0xd1c2 bytes) 2019-12-16T22:45:25.618 INFO:teuthology.orchestra.run.smithi177.stdout:595 write 0x36ed9bc thru 0x36edbb0 (0x1f5 bytes) 2019-12-16T22:45:25.619 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.619 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.619 INFO:teuthology.orchestra.run.smithi177.stdout:596 writesame 0xb70382d thru 0xb70b772 data_size 0xb(0x7f46 bytes) 2019-12-16T22:45:25.625 INFO:teuthology.orchestra.run.smithi177.stdout:597 read 0xbef21e9 thru 0xbef749b (0x52b3 bytes) 2019-12-16T22:45:25.625 INFO:teuthology.orchestra.run.smithi177.stdout:598 writesame 0x18706f thru 0x192766 data_size 0x14(0xb6f8 bytes) 2019-12-16T22:45:25.631 INFO:teuthology.orchestra.run.smithi177.stdout:805 punch from 0x3f2423c to 0x3f2e3d7, (0xa19b bytes) 2019-12-16T22:45:25.632 INFO:teuthology.orchestra.run.smithi177.stdout:807 write 0x2027c33 thru 0x202ca7a (0x4e48 bytes) 2019-12-16T22:45:25.632 INFO:teuthology.orchestra.run.smithi177.stdout:791 write 0xfa410a thru 0xfa622a (0x2121 bytes) 2019-12-16T22:45:25.632 INFO:teuthology.orchestra.run.smithi177.stdout:494 trunc from 0xe9acd7d to 0x8cb21fe 2019-12-16T22:45:25.632 INFO:teuthology.orchestra.run.smithi177.stdout:600 write 0xc000df9 thru 0xc0016fb (0x903 bytes) 2019-12-16T22:45:25.635 INFO:teuthology.orchestra.run.smithi177.stdout:809 read 0xf704f thru 0x105bf7 (0xeba9 bytes) 2019-12-16T22:45:25.636 INFO:teuthology.orchestra.run.smithi177.stdout:812 read 0x116a533 thru 0x1173feb (0x9ab9 bytes) 2019-12-16T22:45:25.637 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.637 INFO:teuthology.orchestra.run.smithi177.stdout:814 read 0x5bab9f thru 0x5c28a0 (0x7d02 bytes) 2019-12-16T22:45:25.638 INFO:teuthology.orchestra.run.smithi177.stdout:792 punch from 0x9b7ba70 to 0x9b84a8e, (0x901e bytes) 2019-12-16T22:45:25.638 INFO:teuthology.orchestra.run.smithi177.stdout:793 write 0x83773b3 thru 0x8377786 (0x3d4 bytes) 2019-12-16T22:45:25.638 INFO:teuthology.orchestra.run.smithi177.stdout:601 clone 6 order 22 su 16384 sc 5 2019-12-16T22:45:25.645 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.645 INFO:teuthology.orchestra.run.smithi177.stdout:797 write 0xb27fed9 thru 0xb28c9e7 (0xcb0f bytes) 2019-12-16T22:45:25.687 INFO:teuthology.orchestra.run.smithi177.stdout:815 write 0x9512cda thru 0x9514eab (0x21d2 bytes) 2019-12-16T22:45:25.692 INFO:teuthology.orchestra.run.smithi177.stdout:817 read 0x6c07fac thru 0x6c0d4ca (0x551f bytes) 2019-12-16T22:45:25.692 INFO:teuthology.orchestra.run.smithi177.stdout:818 punch from 0x52605c to 0x5322cb, (0xc26f bytes) 2019-12-16T22:45:25.693 INFO:teuthology.orchestra.run.smithi177.stdout:819 read 0x6a9fef8 thru 0x6aa0741 (0x84a bytes) 2019-12-16T22:45:25.693 INFO:teuthology.orchestra.run.smithi177.stdout:820 punch from 0x5950859 to 0x59512b2, (0xa59 bytes) 2019-12-16T22:45:25.694 INFO:teuthology.orchestra.run.smithi177.stdout:821 write 0x1f99dfa thru 0x1fa210a (0x8311 bytes) 2019-12-16T22:45:25.697 INFO:teuthology.orchestra.run.smithi177.stdout:799 trunc from 0xc88622b to 0x2107d4e 2019-12-16T22:45:25.721 INFO:teuthology.orchestra.run.smithi177.stdout:822 punch from 0x3f60edc to 0x3f6a29e, (0x93c2 bytes) 2019-12-16T22:45:25.721 INFO:teuthology.orchestra.run.smithi177.stdout:823 write 0x415db79 thru 0x415f784 (0x1c0c bytes) 2019-12-16T22:45:25.723 INFO:teuthology.orchestra.run.smithi177.stdout:824 read 0x8a64e47 thru 0x8a6593e (0xaf8 bytes) 2019-12-16T22:45:25.724 INFO:teuthology.orchestra.run.smithi177.stdout:825 punch from 0x31d0cfb to 0x31e03c2, (0xf6c7 bytes) 2019-12-16T22:45:25.734 INFO:teuthology.orchestra.run.smithi177.stdout:495 read 0x70a2da5 thru 0x70a42ac (0x1508 bytes) 2019-12-16T22:45:25.734 INFO:teuthology.orchestra.run.smithi177.stdout:496 read 0xce1aac thru 0xcf1a87 (0xffdc bytes) 2019-12-16T22:45:25.736 INFO:teuthology.orchestra.run.smithi177.stdout:497 read 0x8540ba thru 0x86303f (0xef86 bytes) 2019-12-16T22:45:25.737 INFO:teuthology.orchestra.run.smithi177.stdout:499 write 0xe60b10 thru 0xe655ed (0x4ade bytes) 2019-12-16T22:45:25.745 INFO:teuthology.orchestra.run.smithi177.stdout:800 trunc from 0x2107d4e to 0x511685d 2019-12-16T22:45:25.759 INFO:teuthology.orchestra.run.smithi177.stdout:500 read 0x6eb1672 thru 0x6eb5f7b (0x490a bytes) 2019-12-16T22:45:25.767 INFO:teuthology.orchestra.run.smithi177.stdout:828 write 0xe58d3d5 thru 0xe59d02f (0xfc5b bytes) 2019-12-16T22:45:25.769 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.770 INFO:teuthology.orchestra.run.smithi177.stdout:803 punch from 0x963d0b to 0x972682, (0xe977 bytes) 2019-12-16T22:45:25.770 INFO:teuthology.orchestra.run.smithi177.stdout:806 clone 5 order 18 su 65536 sc 7 2019-12-16T22:45:25.774 INFO:teuthology.orchestra.run.smithi177.stdout:829 write 0x8bc3ec0 thru 0x8bc4e95 (0xfd6 bytes) 2019-12-16T22:45:25.781 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.781 INFO:teuthology.orchestra.run.smithi177.stdout:831 read 0x31ac635 thru 0x31b9cf8 (0xd6c4 bytes) 2019-12-16T22:45:25.782 INFO:teuthology.orchestra.run.smithi177.stdout:833 write 0x79c083c thru 0x79ce0da (0xd89f bytes) 2019-12-16T22:45:25.798 INFO:teuthology.orchestra.run.smithi177.stdout:501 write 0xebbc09f thru 0xebc3581 (0x74e3 bytes) 2019-12-16T22:45:25.808 INFO:teuthology.orchestra.run.smithi177.stdout:502 write 0x1820f72 thru 0x18277eb (0x687a bytes) 2019-12-16T22:45:25.825 INFO:teuthology.orchestra.run.smithi177.stdout:834 trunc from 0xe59d030 to 0x6c137e 2019-12-16T22:45:25.844 INFO:teuthology.orchestra.run.smithi177.stdout:503 trunc from 0xebc3582 to 0x36d0dc5 2019-12-16T22:45:25.873 INFO:teuthology.orchestra.run.smithi177.stdout:835 trunc from 0x6c137e to 0xd40b59c 2019-12-16T22:45:25.907 INFO:teuthology.orchestra.run.smithi177.stdout:837 write 0x8f8a438 thru 0x8f8ad1d (0x8e6 bytes) 2019-12-16T22:45:25.914 INFO:teuthology.orchestra.run.smithi177.stdout:838 punch from 0x8d8cbb2 to 0x8d9a566, (0xd9b4 bytes) 2019-12-16T22:45:25.916 INFO:teuthology.orchestra.run.smithi177.stdout:839 trunc from 0xd40b59c to 0xe83dcd9 2019-12-16T22:45:25.933 INFO:teuthology.orchestra.run.smithi177.stdout:504 punch from 0x1823403 to 0x182f901, (0xc4fe bytes) 2019-12-16T22:45:25.933 INFO:teuthology.orchestra.run.smithi177.stdout:505 read 0x13bb658 thru 0x13c4eb1 (0x985a bytes) 2019-12-16T22:45:25.934 INFO:teuthology.orchestra.run.smithi177.stdout:840 write 0x3336da9 thru 0x333b35d (0x45b5 bytes) 2019-12-16T22:45:25.934 INFO:teuthology.orchestra.run.smithi177.stdout:509 read 0x2612eeb thru 0x2613d63 (0xe79 bytes) 2019-12-16T22:45:25.934 INFO:teuthology.orchestra.run.smithi177.stdout:510 read 0x10d1e9f thru 0x10d25e7 (0x749 bytes) 2019-12-16T22:45:25.935 INFO:teuthology.orchestra.run.smithi177.stdout:511 read 0x1bf8834 thru 0x1c0209f (0x986c bytes) 2019-12-16T22:45:25.936 INFO:teuthology.orchestra.run.smithi177.stdout:512 punch from 0x2ba578b to 0x2baee82, (0x96f7 bytes) 2019-12-16T22:45:25.936 INFO:teuthology.orchestra.run.smithi177.stdout:513 punch from 0x72decf to 0x72e56c, (0x69d bytes) 2019-12-16T22:45:25.937 INFO:teuthology.orchestra.run.smithi177.stdout:515 punch from 0x34f670e to 0x34fd44b, (0x6d3d bytes) 2019-12-16T22:45:25.937 INFO:teuthology.orchestra.run.smithi177.stdout:516 write 0xd261ac thru 0xd30de7 (0xac3c bytes) 2019-12-16T22:45:25.938 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.938 INFO:teuthology.orchestra.run.smithi177.stdout:846 writesame 0x223c35 thru 0x2254c7 data_size 0x9(0x1893 bytes) 2019-12-16T22:45:25.943 INFO:teuthology.orchestra.run.smithi177.stdout:847 read 0x5ef08e2 thru 0x5efa893 (0x9fb2 bytes) 2019-12-16T22:45:25.943 INFO:teuthology.orchestra.run.smithi177.stdout:848 read 0xb9d3cca thru 0xb9df302 (0xb639 bytes) 2019-12-16T22:45:25.944 INFO:teuthology.orchestra.run.smithi177.stdout:849 write 0x7920d04 thru 0x7923c25 (0x2f22 bytes) 2019-12-16T22:45:25.954 INFO:teuthology.orchestra.run.smithi177.stdout:158 write 0xb5592a0 thru 0xb5592b5 (0x16 bytes) 2019-12-16T22:45:25.955 INFO:teuthology.orchestra.run.smithi177.stdout:850 write 0xe2e3af8 thru 0xe2f0353 (0xc85c bytes) 2019-12-16T22:45:25.961 INFO:teuthology.orchestra.run.smithi177.stdout:851 read 0x61beb90 thru 0x61bf54f (0x9c0 bytes) 2019-12-16T22:45:25.964 INFO:teuthology.orchestra.run.smithi177.stdout:519 punch from 0x19f610a to 0x1a0337c, (0xd272 bytes) 2019-12-16T22:45:25.965 INFO:teuthology.orchestra.run.smithi177.stdout:521 read 0x234d3f3 thru 0x2359273 (0xbe81 bytes) 2019-12-16T22:45:25.966 INFO:teuthology.orchestra.run.smithi177.stdout:852 trunc from 0xe83dcd9 to 0xbe0992c 2019-12-16T22:45:25.973 INFO:teuthology.orchestra.run.smithi177.stdout:160 punch from 0x520cc86 to 0x521a668, (0xd9e2 bytes) 2019-12-16T22:45:25.973 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:25.974 INFO:teuthology.orchestra.run.smithi177.stdout:163 punch from 0xaaa1c9c to 0xaaad900, (0xbc64 bytes) 2019-12-16T22:45:25.974 INFO:teuthology.orchestra.run.smithi177.stdout:164 read 0x8afc354 thru 0x8b04211 (0x7ebe bytes) 2019-12-16T22:45:25.974 INFO:teuthology.orchestra.run.smithi177.stdout:165 punch from 0x9b7c695 to 0x9b7f056, (0x29c1 bytes) 2019-12-16T22:45:25.991 INFO:teuthology.orchestra.run.smithi177.stdout:855 read 0x7224d17 thru 0x7226f78 (0x2262 bytes) 2019-12-16T22:45:25.991 INFO:teuthology.orchestra.run.smithi177.stdout:856 read 0x9a74919 thru 0x9a82d54 (0xe43c bytes) 2019-12-16T22:45:25.991 INFO:teuthology.orchestra.run.smithi177.stdout:857 read 0xa8a9787 thru 0xa8b1ade (0x8358 bytes) 2019-12-16T22:45:25.991 INFO:teuthology.orchestra.run.smithi177.stdout:166 trunc from 0xdf28c39 to 0x62e8e21 2019-12-16T22:45:25.999 INFO:teuthology.orchestra.run.smithi177.stdout:858 trunc from 0xbe0992c to 0x5d81788 2019-12-16T22:45:26.010 INFO:teuthology.orchestra.run.smithi177.stdout:522 write 0xe014e82 thru 0xe0166c3 (0x1842 bytes) 2019-12-16T22:45:26.017 INFO:teuthology.orchestra.run.smithi177.stdout:523 write 0x93bfe2e thru 0x93c31ee (0x33c1 bytes) 2019-12-16T22:45:26.042 INFO:teuthology.orchestra.run.smithi177.stdout:526 write 0x47d74d2 thru 0x47e527a (0xdda9 bytes) 2019-12-16T22:45:26.068 INFO:teuthology.orchestra.run.smithi177.stdout:861 write 0x6520c75 thru 0x652b732 (0xaabe bytes) 2019-12-16T22:45:26.079 INFO:teuthology.orchestra.run.smithi177.stdout:863 trunc from 0x652b733 to 0x8d70f42 2019-12-16T22:45:26.096 INFO:teuthology.orchestra.run.smithi177.stdout:529 trunc from 0xe0166c4 to 0x1ec5890 2019-12-16T22:45:26.097 INFO:teuthology.orchestra.run.smithi177.stdout:864 punch from 0x5f130a7 to 0x5f18098, (0x4ff1 bytes) 2019-12-16T22:45:26.112 INFO:teuthology.orchestra.run.smithi177.stdout:168 writesame 0xd40448e thru 0xd41275a data_size 0x1(0xe2cd bytes) 2019-12-16T22:45:26.112 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #3, image image_cluster1.client.mirror.5-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent4 2019-12-16T22:45:26.115 INFO:teuthology.orchestra.run.smithi177.stdout:169 write 0x4613ac8 thru 0x4621831 (0xdd6a bytes) 2019-12-16T22:45:26.127 INFO:teuthology.orchestra.run.smithi177.stdout:170 read 0x88804d9 thru 0x8881aae (0x15d6 bytes) 2019-12-16T22:45:26.127 INFO:teuthology.orchestra.run.smithi177.stdout:171 writesame 0xc894eec thru 0xc89e424 data_size 0x1(0x9539 bytes) 2019-12-16T22:45:26.139 INFO:teuthology.orchestra.run.smithi177.stdout:865 write 0xa673c84 thru 0xa67d524 (0x98a1 bytes) 2019-12-16T22:45:26.181 INFO:teuthology.orchestra.run.smithi177.stdout:173 write 0x457a2cb thru 0x457c4a8 (0x21de bytes) 2019-12-16T22:45:26.181 INFO:teuthology.orchestra.run.smithi177.stdout:866 trunc from 0xa67d525 to 0x2aa3626 2019-12-16T22:45:26.188 INFO:teuthology.orchestra.run.smithi177.stdout:174 read 0x486a7c7 thru 0x486abfd (0x437 bytes) 2019-12-16T22:45:26.189 INFO:teuthology.orchestra.run.smithi177.stdout:176 read 0x49f38d4 thru 0x49f9e29 (0x6556 bytes) 2019-12-16T22:45:26.190 INFO:teuthology.orchestra.run.smithi177.stdout:177 write 0xa6daa54 thru 0xa6e6549 (0xbaf6 bytes) 2019-12-16T22:45:26.210 INFO:teuthology.orchestra.run.smithi177.stdout:178 write 0x4d92757 thru 0x4d96628 (0x3ed2 bytes) 2019-12-16T22:45:26.216 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:26.216 INFO:teuthology.orchestra.run.smithi177.stdout:434 writesame 0xbf5a499 thru 0xbf6a1a7 data_size 0x1(0xfd0f bytes) 2019-12-16T22:45:26.216 INFO:teuthology.orchestra.run.smithi177.stdout:179 read 0xc7c09e8 thru 0xc7c92d5 (0x88ee bytes) 2019-12-16T22:45:26.221 INFO:teuthology.orchestra.run.smithi177.stdout:181 trunc from 0xd41275b to 0xa325b4d 2019-12-16T22:45:26.233 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone5 from 0xcacf519 (overlap 0x3e255f0) to 0x0 2019-12-16T22:45:26.253 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:26.250+0000 7f884a7b2700 -1 reset not still connected to 0x560112dd0f20 2019-12-16T22:45:26.253 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:26.250+0000 7f884a7b2700 -1 reset not still connected to 0x5601137e8750 2019-12-16T22:45:26.253 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:26.250+0000 7f884a7b2700 -1 reset not still connected to 0x5601137e8d00 2019-12-16T22:45:26.258 INFO:teuthology.orchestra.run.smithi177.stdout:867 writesame 0x3bc8b96 thru 0x3bd2a10 data_size 0x1(0x9e7b bytes) 2019-12-16T22:45:26.297 INFO:teuthology.orchestra.run.smithi177.stdout:870 trunc from 0x3bd2a11 to 0x22b3c21 2019-12-16T22:45:26.297 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.0-clone4 intact 2019-12-16T22:45:26.297 INFO:teuthology.orchestra.run.smithi177.stdout:436 writesame 0xa0565c1 thru 0xa05d998 data_size 0xb(0x73d8 bytes) 2019-12-16T22:45:26.303 INFO:teuthology.orchestra.run.smithi177.stdout:530 write 0xab33247 thru 0xab333bc (0x176 bytes) 2019-12-16T22:45:26.304 INFO:teuthology.orchestra.run.smithi177.stdout:438 write 0x9b3cc42 thru 0x9b3decf (0x128e bytes) 2019-12-16T22:45:26.307 INFO:teuthology.orchestra.run.smithi177.stdout:182 write 0xdfe226 thru 0xe07deb (0x9bc6 bytes) 2019-12-16T22:45:26.317 INFO:teuthology.orchestra.run.smithi177.stdout:871 read 0x1a52d29 thru 0x1a5f9e3 (0xccbb bytes) 2019-12-16T22:45:26.322 INFO:teuthology.orchestra.run.smithi177.stdout:439 writesame 0x6d651b2 thru 0x6d713fd data_size 0x1e(0xc24c bytes) 2019-12-16T22:45:26.335 INFO:teuthology.orchestra.run.smithi177.stdout:440 read 0x1345379 thru 0x1346fbf (0x1c47 bytes) 2019-12-16T22:45:26.335 INFO:teuthology.orchestra.run.smithi177.stdout:441 punch from 0x240fef to 0x24505c, (0x406d bytes) 2019-12-16T22:45:26.335 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:26.335 INFO:teuthology.orchestra.run.smithi177.stdout:443 writesame 0xc25d700 thru 0xc2632ea data_size 0x1(0x5beb bytes) 2019-12-16T22:45:26.339 INFO:teuthology.orchestra.run.smithi177.stdout:531 trunc from 0xab333bd to 0x9ba9f 2019-12-16T22:45:26.343 INFO:teuthology.orchestra.run.smithi177.stdout:872 trunc from 0x22b3c21 to 0xd065c10 2019-12-16T22:45:26.361 INFO:teuthology.orchestra.run.smithi177.stdout:444 read 0x258a1ed thru 0x259567d (0xb491 bytes) 2019-12-16T22:45:26.361 INFO:teuthology.orchestra.run.smithi177.stdout:445 punch from 0x7029e09 to 0x703676f, (0xc966 bytes) 2019-12-16T22:45:26.361 INFO:teuthology.orchestra.run.smithi177.stdout:448 read 0x11d1dea thru 0x11de902 (0xcb19 bytes) 2019-12-16T22:45:26.361 INFO:teuthology.orchestra.run.smithi177.stdout:450 write 0x5cc34c thru 0x5cca88 (0x73d bytes) 2019-12-16T22:45:26.396 INFO:teuthology.orchestra.run.smithi177.stdout:874 read 0x1ecf920 thru 0x1ed9a0e (0xa0ef bytes) 2019-12-16T22:45:26.396 INFO:teuthology.orchestra.run.smithi177.stdout:875 write 0x54f816e thru 0x5500f61 (0x8df4 bytes) 2019-12-16T22:45:26.405 INFO:teuthology.orchestra.run.smithi177.stdout:451 read 0xaa48fcf thru 0xaa56e12 (0xde44 bytes) 2019-12-16T22:45:26.405 INFO:teuthology.orchestra.run.smithi177.stdout:452 read 0x561b989 thru 0x561ed79 (0x33f1 bytes) 2019-12-16T22:45:26.405 INFO:teuthology.orchestra.run.smithi177.stdout:453 writesame 0x31a5986 thru 0x31b2ec6 data_size 0xb(0xd541 bytes) 2019-12-16T22:45:26.406 INFO:teuthology.orchestra.run.smithi177.stdout:183 trunc from 0xa325b4d to 0xdc5f59f 2019-12-16T22:45:26.408 INFO:teuthology.orchestra.run.smithi177.stdout:876 write 0x8b2020d thru 0x8b2b672 (0xb466 bytes) 2019-12-16T22:45:26.415 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:26.416 INFO:teuthology.orchestra.run.smithi177.stdout:456 write 0xac8d543 thru 0xac99d5e (0xc81c bytes) 2019-12-16T22:45:26.429 INFO:teuthology.orchestra.run.smithi177.stdout:877 write 0x55fd22d thru 0x5603d1a (0x6aee bytes) 2019-12-16T22:45:26.437 INFO:teuthology.orchestra.run.smithi177.stdout:457 punch from 0x8c2f265 to 0x8c39e0b, (0xaba6 bytes) 2019-12-16T22:45:26.437 INFO:teuthology.orchestra.run.smithi177.stdout:879 write 0x763e738 thru 0x7646635 (0x7efe bytes) 2019-12-16T22:45:26.439 INFO:teuthology.orchestra.run.smithi177.stdout:184 write 0xcb137ab thru 0xcb16173 (0x29c9 bytes) 2019-12-16T22:45:26.446 INFO:teuthology.orchestra.run.smithi177.stdout:880 write 0x8144acc thru 0x8149073 (0x45a8 bytes) 2019-12-16T22:45:26.449 INFO:teuthology.orchestra.run.smithi177.stdout:185 writesame 0x5921e1c thru 0x592c412 data_size 0x1(0xa5f7 bytes) 2019-12-16T22:45:26.457 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #4, image image_cluster1.client.mirror.3-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent5 2019-12-16T22:45:26.457 INFO:teuthology.orchestra.run.smithi177.stdout:458 trunc from 0xc73136e to 0x474c7d8 2019-12-16T22:45:26.457 INFO:teuthology.orchestra.run.smithi177.stdout:533 read 0x2286 thru 0x10214 (0xdf8f bytes) 2019-12-16T22:45:26.476 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #3, image image_cluster1.client.mirror.0-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent4 2019-12-16T22:45:26.484 INFO:teuthology.orchestra.run.smithi177.stdout:186 write 0x5273e2d thru 0x528239f (0xe573 bytes) 2019-12-16T22:45:26.491 INFO:teuthology.orchestra.run.smithi177.stdout:187 writesame 0xab62e12 thru 0xab7177e data_size 0x1(0xe96d bytes) 2019-12-16T22:45:26.498 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2019-12-16T22:45:26.498 INFO:teuthology.orchestra.run:waiting for 600 2019-12-16T22:45:26.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:45:26.498 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2019-12-16T22:45:26.499 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2019-12-16T22:45:26.499 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2019-12-16T22:45:26.500 INFO:teuthology.orchestra.run.smithi177.stdout:881 writesame 0xdc09e73 thru 0xdc1036a data_size 0x24(0x64f8 bytes) 2019-12-16T22:45:26.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2019-12-16T22:45:26.502 INFO:tasks.rbd_mirror_thrash:waiting for 85 secs before thrashing 2019-12-16T22:45:26.502 INFO:teuthology.orchestra.run.smithi177.stdout:534 write 0xd809297 thru 0xd814c66 (0xb9d0 bytes) 2019-12-16T22:45:26.506 INFO:teuthology.orchestra.run.smithi177.stdout:882 punch from 0xaac5d51 to 0xaaceb6a, (0x8e19 bytes) 2019-12-16T22:45:26.506 INFO:teuthology.orchestra.run.smithi177.stdout:883 read 0x9e58df2 thru 0x9e5f9e9 (0x6bf8 bytes) 2019-12-16T22:45:26.508 INFO:teuthology.orchestra.run.smithi177.stdout:884 punch from 0xcb0e2f4 to 0xcb1ce7c, (0xeb88 bytes) 2019-12-16T22:45:26.508 INFO:teuthology.orchestra.run.smithi177.stdout:886 writesame 0x3d0945f thru 0x3d09a7c data_size 0x1b(0x61e bytes) 2019-12-16T22:45:26.514 INFO:teuthology.orchestra.run.smithi177.stdout:807 clone 6 order 18 su 16384 sc 8 2019-12-16T22:45:26.535 INFO:teuthology.orchestra.run.smithi177.stdout:888 write 0x3765c77 thru 0x3771625 (0xb9af bytes) 2019-12-16T22:45:26.551 INFO:teuthology.orchestra.run.smithi177.stdout:536 write 0x86a6c33 thru 0x86b122b (0xa5f9 bytes) 2019-12-16T22:45:26.551 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:26.551 INFO:teuthology.orchestra.run.smithi177.stdout:892 write 0x1bc8799 thru 0x1bd2e17 (0xa67f bytes) 2019-12-16T22:45:26.566 INFO:teuthology.orchestra.run.smithi177.stdout:537 writesame 0x3c5c7c9 thru 0x3c6b7ec data_size 0xbc(0xf024 bytes) 2019-12-16T22:45:26.568 INFO:teuthology.orchestra.run.smithi177.stdout:189 trunc from 0xdc5f59f to 0x15f2133 2019-12-16T22:45:26.582 INFO:teuthology.orchestra.run.smithi177.stdout:893 trunc from 0xdc1036b to 0x1f3b618 2019-12-16T22:45:26.590 INFO:teuthology.orchestra.run.smithi177.stdout:538 trunc from 0xd814c67 to 0x58fa5b4 2019-12-16T22:45:26.626 INFO:teuthology.orchestra.run.smithi177.stdout:460 write 0xacc4e13 thru 0xacd1495 (0xc683 bytes) 2019-12-16T22:45:26.652 INFO:teuthology.orchestra.run.smithi177.stdout:894 read 0x1eef9b8 thru 0x1ef5e7f (0x64c8 bytes) 2019-12-16T22:45:26.652 INFO:teuthology.orchestra.run.smithi177.stdout:895 read 0x1de93 thru 0x2dc08 (0xfd76 bytes) 2019-12-16T22:45:26.653 INFO:teuthology.orchestra.run.smithi177.stdout:896 punch from 0x4b8008 to 0x4baf37, (0x2f2f bytes) 2019-12-16T22:45:26.653 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:26.653 INFO:teuthology.orchestra.run.smithi177.stdout:461 punch from 0x237b523 to 0x23832ed, (0x7dca bytes) 2019-12-16T22:45:26.653 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:26.654 INFO:teuthology.orchestra.run.smithi177.stdout:463 punch from 0x4746adc to 0x4755df4, (0xf318 bytes) 2019-12-16T22:45:26.654 INFO:teuthology.orchestra.run.smithi177.stdout:470 read 0xfc9a58 thru 0xfd34fe (0x9aa7 bytes) 2019-12-16T22:45:26.654 INFO:teuthology.orchestra.run.smithi177.stdout:472 write 0x3a08840 thru 0x3a1764d (0xee0e bytes) 2019-12-16T22:45:26.659 INFO:teuthology.orchestra.run.smithi177.stdout:539 clone 5 order 23 su 32768 sc 6 2019-12-16T22:45:26.670 INFO:teuthology.orchestra.run.smithi177.stdout:898 writesame 0x559f97d thru 0x55acec1 data_size 0x1(0xd545 bytes) 2019-12-16T22:45:26.673 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:26.687 INFO:teuthology.orchestra.run.smithi177.stdout:474 writesame 0xb7f2a14 thru 0xb7f9d18 data_size 0x5(0x7305 bytes) 2019-12-16T22:45:26.687 INFO:teuthology.orchestra.run.smithi177.stdout:475 trunc from 0xb7f9d19 to 0xc9bafed 2019-12-16T22:45:26.705 INFO:teuthology.orchestra.run.smithi177.stdout:900 writesame 0x740e0b0 thru 0x741277a data_size 0x7(0x46cb bytes) 2019-12-16T22:45:26.705 INFO:teuthology.orchestra.run.smithi177.stdout:476 read 0x7983a7b thru 0x7990bdf (0xd165 bytes) 2019-12-16T22:45:26.719 INFO:teuthology.orchestra.run.smithi177.stdout:477 write 0xd194fba thru 0xd1a3e1c (0xee63 bytes) 2019-12-16T22:45:26.726 INFO:teuthology.orchestra.run.smithi177.stdout:902 writesame 0xcc1decc thru 0xcc2b472 data_size 0x1(0xd5a7 bytes) 2019-12-16T22:45:26.727 INFO:teuthology.orchestra.run.smithi177.stdout:478 write 0x6980d56 thru 0x6982573 (0x181e bytes) 2019-12-16T22:45:26.747 INFO:teuthology.orchestra.run.smithi177.stdout:903 trunc from 0xcc2b473 to 0x478eb95 2019-12-16T22:45:26.754 INFO:teuthology.orchestra.run.smithi177.stdout:479 trunc from 0xd1a3e1d to 0x1d55561 2019-12-16T22:45:26.775 INFO:teuthology.orchestra.run.smithi177.stdout:905 read 0x2a03827 thru 0x2a0e6d1 (0xaeab bytes) 2019-12-16T22:45:26.779 INFO:teuthology.orchestra.run.smithi177.stdout:906 trunc from 0x478eb95 to 0x77dd476 2019-12-16T22:45:26.797 INFO:teuthology.orchestra.run.smithi177.stdout:907 read 0x4f0bdca thru 0x4f15dd2 (0xa009 bytes) 2019-12-16T22:45:26.808 INFO:teuthology.orchestra.run.smithi177.stdout:908 trunc from 0x77dd476 to 0x1333e6b 2019-12-16T22:45:26.861 INFO:teuthology.orchestra.run.smithi177.stdout:909 punch from 0x73cbb3 to 0x74b924, (0xed71 bytes) 2019-12-16T22:45:26.885 INFO:teuthology.orchestra.run.smithi177.stdout:910 write 0x611fcec thru 0x612882b (0x8b40 bytes) 2019-12-16T22:45:26.906 INFO:teuthology.orchestra.run.smithi177.stdout:480 trunc from 0x1d55561 to 0xb9a1f9f 2019-12-16T22:45:26.910 INFO:teuthology.orchestra.run.smithi177.stdout:602 trunc from 0xcacf519 to 0x3f12c2f 2019-12-16T22:45:26.925 INFO:teuthology.orchestra.run.smithi177.stdout:911 writesame 0xad99d15 thru 0xada27a4 data_size 0x18(0x8a90 bytes) 2019-12-16T22:45:26.926 INFO:teuthology.orchestra.run.smithi177.stdout:481 writesame 0x70a77a5 thru 0x70b32b7 data_size 0x1(0xbb13 bytes) 2019-12-16T22:45:26.947 INFO:teuthology.orchestra.run.smithi177.stdout:912 punch from 0x830b93b to 0x8315038, (0x96fd bytes) 2019-12-16T22:45:26.947 INFO:teuthology.orchestra.run.smithi177.stdout:913 writesame 0x1537b39 thru 0x153c423 data_size 0x1(0x48eb bytes) 2019-12-16T22:45:27.006 INFO:teuthology.orchestra.run.smithi177.stdout:482 punch from 0x18e87ff to 0x18f58ff, (0xd100 bytes) 2019-12-16T22:45:27.007 INFO:teuthology.orchestra.run.smithi177.stdout:483 read 0x6a4e7c5 thru 0x6a5b6b9 (0xcef5 bytes) 2019-12-16T22:45:27.007 INFO:teuthology.orchestra.run.smithi177.stdout:484 writesame 0x56afea8 thru 0x56b3d74 data_size 0x3(0x3ecd bytes) 2019-12-16T22:45:27.043 INFO:teuthology.orchestra.run.smithi177.stdout:915 clone 5 order 19 su 4096 sc 7 2019-12-16T22:45:27.246 INFO:teuthology.orchestra.run.smithi177.stdout:603 read 0x34d484b thru 0x34e0d5d (0xc513 bytes) 2019-12-16T22:45:27.250 INFO:teuthology.orchestra.run.smithi177.stdout:485 write 0xddf892b thru 0xde00bf5 (0x82cb bytes) 2019-12-16T22:45:27.267 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.267 INFO:teuthology.orchestra.run.smithi177.stdout:487 writesame 0x18fc66e thru 0x19051c3 data_size 0x3a(0x8b56 bytes) 2019-12-16T22:45:27.274 INFO:teuthology.orchestra.run.smithi177.stdout:489 read 0x830f758 thru 0x831a258 (0xab01 bytes) 2019-12-16T22:45:27.278 INFO:teuthology.orchestra.run.smithi177.stdout:490 trunc from 0xde00bf6 to 0xc1769e4 2019-12-16T22:45:27.281 INFO:teuthology.orchestra.run.smithi177.stdout:604 write 0x99e12d8 thru 0x99e90af (0x7dd8 bytes) 2019-12-16T22:45:27.300 INFO:teuthology.orchestra.run.smithi177.stdout:605 punch from 0x82cc247 to 0x82cf09b, (0x2e54 bytes) 2019-12-16T22:45:27.305 INFO:teuthology.orchestra.run.smithi177.stdout:606 trunc from 0x99e90b0 to 0xbd455d2 2019-12-16T22:45:27.327 INFO:teuthology.orchestra.run.smithi177.stdout:608 punch from 0xdb30c6 to 0xdb4bb7, (0x1af1 bytes) 2019-12-16T22:45:27.349 INFO:teuthology.orchestra.run.smithi177.stdout:609 trunc from 0xbd455d2 to 0x5cc68b 2019-12-16T22:45:27.352 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone5 from 0x511685d (overlap 0x511685d) to 0x81bda2 2019-12-16T22:45:27.352 INFO:teuthology.orchestra.run.smithi177.stdout:491 writesame 0xe352693 thru 0xe35ce20 data_size 0x9(0xa78e bytes) 2019-12-16T22:45:27.356 INFO:teuthology.orchestra.run.smithi177.stdout:492 read 0xc950dbb thru 0xc95567a (0x48c0 bytes) 2019-12-16T22:45:27.356 INFO:teuthology.orchestra.run.smithi177.stdout:493 punch from 0x5e3b6e to 0x5ea8ac, (0x6d3e bytes) 2019-12-16T22:45:27.356 INFO:teuthology.orchestra.run.smithi177.stdout:494 write 0x1c91e83 thru 0x1c99a55 (0x7bd3 bytes) 2019-12-16T22:45:27.381 INFO:teuthology.orchestra.run.smithi177.stdout:496 read 0x9fbf9a2 thru 0x9fc8340 (0x899f bytes) 2019-12-16T22:45:27.381 INFO:teuthology.orchestra.run.smithi177.stdout:498 write 0x51e69d1 thru 0x51f18d5 (0xaf05 bytes) 2019-12-16T22:45:27.436 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone4 from 0x58fa5b4 (overlap 0x9ba9f) to 0x3e43f 2019-12-16T22:45:27.496 INFO:teuthology.orchestra.run.smithi177.stdout:500 write 0xa33d8ed thru 0xa3462a0 (0x89b4 bytes) 2019-12-16T22:45:27.525 INFO:teuthology.orchestra.run.smithi177.stdout:501 write 0x46f1d3a thru 0x46f8c41 (0x6f08 bytes) 2019-12-16T22:45:27.545 INFO:teuthology.orchestra.run.smithi177.stdout:502 write 0xd706dcd thru 0xd70aa1e (0x3c52 bytes) 2019-12-16T22:45:27.567 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.567 INFO:teuthology.orchestra.run.smithi177.stdout:504 writesame 0x76aaa5f thru 0x76b5e0d data_size 0x39(0xb3af bytes) 2019-12-16T22:45:27.582 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.583 INFO:teuthology.orchestra.run.smithi177.stdout:507 trunc from 0xe35ce21 to 0xdbc57bb 2019-12-16T22:45:27.638 INFO:teuthology.orchestra.run.smithi177.stdout:508 write 0x384f78 thru 0x38a51d (0x55a6 bytes) 2019-12-16T22:45:27.666 INFO:teuthology.orchestra.run.smithi177.stdout:510 read 0x1e4dc03 thru 0x1e4f91f (0x1d1d bytes) 2019-12-16T22:45:27.667 INFO:teuthology.orchestra.run.smithi177.stdout:511 writesame 0x3e101c1 thru 0x3e17ae7 data_size 0x1(0x7927 bytes) 2019-12-16T22:45:27.700 INFO:teuthology.orchestra.run.smithi177.stdout:513 read 0x510e62b thru 0x511cebd (0xe893 bytes) 2019-12-16T22:45:27.701 INFO:teuthology.orchestra.run.smithi177.stdout:514 read 0x8cee0 thru 0x9ab41 (0xdc62 bytes) 2019-12-16T22:45:27.702 INFO:teuthology.orchestra.run.smithi177.stdout:515 punch from 0xcddafe1 to 0xcddd1e1, (0x2200 bytes) 2019-12-16T22:45:27.702 INFO:teuthology.orchestra.run.smithi177.stdout:516 read 0x9d60bec thru 0x9d6ab39 (0x9f4e bytes) 2019-12-16T22:45:27.702 INFO:teuthology.orchestra.run.smithi177.stdout:519 write 0x721dba thru 0x730b42 (0xed89 bytes) 2019-12-16T22:45:27.729 INFO:teuthology.orchestra.run.smithi177.stdout:520 punch from 0xa4a54c7 to 0xa4a9198, (0x3cd1 bytes) 2019-12-16T22:45:27.730 INFO:teuthology.orchestra.run.smithi177.stdout:521 punch from 0x19c5bcb to 0x19c67b8, (0xbed bytes) 2019-12-16T22:45:27.730 INFO:teuthology.orchestra.run.smithi177.stdout:522 write 0x769f541 thru 0x76ab480 (0xbf40 bytes) 2019-12-16T22:45:27.754 INFO:teuthology.orchestra.run.smithi177.stdout:523 trunc from 0xdbc57bb to 0x645d274 2019-12-16T22:45:27.806 INFO:teuthology.orchestra.run.smithi177.stdout:610 write 0xd8d8420 thru 0xd8dfacf (0x76b0 bytes) 2019-12-16T22:45:27.806 INFO:teuthology.orchestra.run.smithi177.stdout:524 punch from 0x8f59bb to 0x8fc892, (0x6ed7 bytes) 2019-12-16T22:45:27.812 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #3, image image_cluster1.client.mirror.4-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent4 2019-12-16T22:45:27.820 INFO:teuthology.orchestra.run.smithi177.stdout:611 read 0x4468e15 thru 0x446dea3 (0x508f bytes) 2019-12-16T22:45:27.821 INFO:teuthology.orchestra.run.smithi177.stdout:612 read 0xa62aff thru 0xa72804 (0xfd06 bytes) 2019-12-16T22:45:27.821 INFO:teuthology.orchestra.run.smithi177.stdout:613 writesame 0xadc31c1 thru 0xadcbda2 data_size 0x5(0x8be2 bytes) 2019-12-16T22:45:27.838 INFO:teuthology.orchestra.run.smithi177.stdout:617 write 0x76c9631 thru 0x76d0511 (0x6ee1 bytes) 2019-12-16T22:45:27.838 INFO:teuthology.orchestra.run.smithi177.stdout:525 writesame 0x9f0a4ec thru 0x9f11670 data_size 0x3(0x7185 bytes) 2019-12-16T22:45:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.841 INFO:teuthology.orchestra.run.smithi177.stdout:529 trunc from 0x9f11671 to 0x9d63eaf 2019-12-16T22:45:27.850 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.850 INFO:teuthology.orchestra.run.smithi177.stdout:619 read 0xeb9fb7 thru 0xec29b5 (0x89ff bytes) 2019-12-16T22:45:27.850 INFO:teuthology.orchestra.run.smithi177.stdout:620 write 0x3192c7a thru 0x31a27c3 (0xfb4a bytes) 2019-12-16T22:45:27.866 INFO:teuthology.orchestra.run.smithi177.stdout:530 read 0x5139653 thru 0x5143762 (0xa110 bytes) 2019-12-16T22:45:27.867 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.867 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.867 INFO:teuthology.orchestra.run.smithi177.stdout:534 read 0x65ed6b9 thru 0x65f989e (0xc1e6 bytes) 2019-12-16T22:45:27.867 INFO:teuthology.orchestra.run.smithi177.stdout:535 read 0x7232ee1 thru 0x72357b4 (0x28d4 bytes) 2019-12-16T22:45:27.867 INFO:teuthology.orchestra.run.smithi177.stdout:536 read 0x6f4d372 thru 0x6f5c3e0 (0xf06f bytes) 2019-12-16T22:45:27.868 INFO:teuthology.orchestra.run.smithi177.stdout:538 punch from 0x7f685f6 to 0x7f6db73, (0x557d bytes) 2019-12-16T22:45:27.868 INFO:teuthology.orchestra.run.smithi177.stdout:539 punch from 0x7cca6e0 to 0x7cd7feb, (0xd90b bytes) 2019-12-16T22:45:27.871 INFO:teuthology.orchestra.run.smithi177.stdout:540 trunc from 0x9d63eaf to 0x75c8cac 2019-12-16T22:45:27.910 INFO:teuthology.orchestra.run.smithi177.stdout:622 write 0xbbb5b2c thru 0xbbbfe37 (0xa30c bytes) 2019-12-16T22:45:27.922 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.923 INFO:teuthology.orchestra.run.smithi177.stdout:543 writesame 0x5100302 thru 0x510fdd8 data_size 0xf(0xfad7 bytes) 2019-12-16T22:45:27.928 INFO:teuthology.orchestra.run.smithi177.stdout:623 write 0x5130950 thru 0x5137cee (0x739f bytes) 2019-12-16T22:45:27.934 INFO:teuthology.orchestra.run.smithi177.stdout:544 punch from 0x3740654 to 0x374d6b6, (0xd062 bytes) 2019-12-16T22:45:27.934 INFO:teuthology.orchestra.run.smithi177.stdout:545 read 0x42c68b6 thru 0x42c9318 (0x2a63 bytes) 2019-12-16T22:45:27.934 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.935 INFO:teuthology.orchestra.run.smithi177.stdout:548 read 0x39f54a9 thru 0x39fb81c (0x6374 bytes) 2019-12-16T22:45:27.935 INFO:teuthology.orchestra.run.smithi177.stdout:549 read 0x1d04ad1 thru 0x1d0cff9 (0x8529 bytes) 2019-12-16T22:45:27.935 INFO:teuthology.orchestra.run.smithi177.stdout:550 punch from 0x450d93f to 0x450f731, (0x1df2 bytes) 2019-12-16T22:45:27.940 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:27.940 INFO:teuthology.orchestra.run.smithi177.stdout:625 write 0xb2a616f thru 0xb2a8a7a (0x290c bytes) 2019-12-16T22:45:27.951 INFO:teuthology.orchestra.run.smithi177.stdout:626 read 0xe557d8 thru 0xe63f4a (0xe773 bytes) 2019-12-16T22:45:27.951 INFO:teuthology.orchestra.run.smithi177.stdout:627 write 0x4b73ed9 thru 0x4b758dd (0x1a05 bytes) 2019-12-16T22:45:27.984 INFO:teuthology.orchestra.run.smithi177.stdout:628 write 0x14e3bdd thru 0x14e8369 (0x478d bytes) 2019-12-16T22:45:28.022 INFO:teuthology.orchestra.run.smithi177.stdout:551 writesame 0x9a3eff0 thru 0x9a440ba data_size 0x25(0x50cb bytes) 2019-12-16T22:45:28.024 INFO:teuthology.orchestra.run.smithi177.stdout:630 read 0x711547e thru 0x71245f5 (0xf178 bytes) 2019-12-16T22:45:28.025 INFO:teuthology.orchestra.run.smithi177.stdout:552 read 0xf1e4ae thru 0xf27ddc (0x992f bytes) 2019-12-16T22:45:28.025 INFO:teuthology.orchestra.run.smithi177.stdout:632 write 0x8607b5f thru 0x861770e (0xfbb0 bytes) 2019-12-16T22:45:28.026 INFO:teuthology.orchestra.run.smithi177.stdout:553 write 0x8be6d0b thru 0x8beda74 (0x6d6a bytes) 2019-12-16T22:45:28.058 INFO:teuthology.orchestra.run.smithi177.stdout:554 writesame 0x56c55f6 thru 0x56c5b9e data_size 0x15(0x5a9 bytes) 2019-12-16T22:45:28.088 INFO:teuthology.orchestra.run.smithi177.stdout:555 punch from 0xb18b3 to 0xbbb24, (0xa271 bytes) 2019-12-16T22:45:28.088 INFO:teuthology.orchestra.run.smithi177.stdout:556 read 0x86fe7f3 thru 0x87096db (0xaee9 bytes) 2019-12-16T22:45:28.089 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.089 INFO:teuthology.orchestra.run.smithi177.stdout:559 write 0x993610c thru 0x993e714 (0x8609 bytes) 2019-12-16T22:45:28.089 INFO:teuthology.orchestra.run.smithi177.stdout:633 writesame 0x4020fbd thru 0x402143f data_size 0x1(0x483 bytes) 2019-12-16T22:45:28.093 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.104 INFO:teuthology.orchestra.run.smithi177.stdout:639 trunc from 0xd8dfad0 to 0x8e3eb41 2019-12-16T22:45:28.159 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #4, image image_cluster1.client.mirror.0-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent5 2019-12-16T22:45:28.169 INFO:teuthology.orchestra.run.smithi177.stdout:560 write 0xacacd11 thru 0xacb15f7 (0x48e7 bytes) 2019-12-16T22:45:28.177 INFO:teuthology.orchestra.run.smithi177.stdout:561 read 0x198c234 thru 0x1998c7c (0xca49 bytes) 2019-12-16T22:45:28.178 INFO:teuthology.orchestra.run.smithi177.stdout:562 write 0x8b1a2ea thru 0x8b26efa (0xcc11 bytes) 2019-12-16T22:45:28.203 INFO:teuthology.orchestra.run.smithi177.stdout:640 trunc from 0x8e3eb41 to 0x29b23a1 2019-12-16T22:45:28.233 INFO:teuthology.orchestra.run.smithi177.stdout:563 writesame 0xebc54b8 thru 0xebc9afe data_size 0x3(0x4647 bytes) 2019-12-16T22:45:28.238 INFO:teuthology.orchestra.run.smithi177.stdout:564 write 0xa441dc2 thru 0xa44f6ee (0xd92d bytes) 2019-12-16T22:45:28.243 INFO:teuthology.orchestra.run.smithi177.stdout:641 punch from 0xdc0a6 to 0xe5d11, (0x9c6b bytes) 2019-12-16T22:45:28.244 INFO:teuthology.orchestra.run.smithi177.stdout:643 read 0xe4d75 thru 0xee4c6 (0x9752 bytes) 2019-12-16T22:45:28.248 INFO:teuthology.orchestra.run.smithi177.stdout:644 read 0x26a1e18 thru 0x26a69cb (0x4bb4 bytes) 2019-12-16T22:45:28.249 INFO:teuthology.orchestra.run.smithi177.stdout:646 read 0x15a8bc2 thru 0x15a9817 (0xc56 bytes) 2019-12-16T22:45:28.249 INFO:teuthology.orchestra.run.smithi177.stdout:647 read 0x136230d thru 0x13663f1 (0x40e5 bytes) 2019-12-16T22:45:28.251 INFO:teuthology.orchestra.run.smithi177.stdout:648 read 0x280c096 thru 0x281af47 (0xeeb2 bytes) 2019-12-16T22:45:28.252 INFO:teuthology.orchestra.run.smithi177.stdout:649 read 0xa5db99 thru 0xa5f3fa (0x1862 bytes) 2019-12-16T22:45:28.266 INFO:teuthology.orchestra.run.smithi177.stdout:650 trunc from 0x29b23a1 to 0x6b65ecd 2019-12-16T22:45:28.282 INFO:teuthology.orchestra.run.smithi177.stdout:566 trunc from 0xebc9aff to 0x44d463 2019-12-16T22:45:28.284 INFO:teuthology.orchestra.run.smithi177.stdout:651 write 0x4961799 thru 0x496f873 (0xe0db bytes) 2019-12-16T22:45:28.295 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone4 from 0xada27a5 (overlap 0x6c137e) to 0x159d7f 2019-12-16T22:45:28.303 INFO:teuthology.orchestra.run.smithi177.stdout:652 punch from 0x1a4c380 to 0x1a53e7d, (0x7afd bytes) 2019-12-16T22:45:28.303 INFO:teuthology.orchestra.run.smithi177.stdout:653 read 0x24f24f8 thru 0x24f2683 (0x18c bytes) 2019-12-16T22:45:28.303 INFO:teuthology.orchestra.run.smithi177.stdout:654 read 0x446099d thru 0x4462a6e (0x20d2 bytes) 2019-12-16T22:45:28.339 INFO:teuthology.orchestra.run.smithi177.stdout:656 writesame 0xa4099ee thru 0xa4157b8 data_size 0xb(0xbdcb bytes) 2019-12-16T22:45:28.355 INFO:teuthology.orchestra.run.smithi177.stdout:567 read 0x31342d thru 0x31e358 (0xaf2c bytes) 2019-12-16T22:45:28.356 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.360 INFO:teuthology.orchestra.run.smithi177.stdout:808 trunc from 0x511685d to 0xc5b913 2019-12-16T22:45:28.370 INFO:teuthology.orchestra.run.smithi177.stdout:657 write 0xe146aef thru 0xe152a03 (0xbf15 bytes) 2019-12-16T22:45:28.387 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.387 INFO:teuthology.orchestra.run.smithi177.stdout:542 read 0x2ba13fd thru 0x2ba5efa (0x4afe bytes) 2019-12-16T22:45:28.394 INFO:teuthology.orchestra.run.smithi177.stdout:570 write 0x439c2ae thru 0x43a38bc (0x760f bytes) 2019-12-16T22:45:28.398 INFO:teuthology.orchestra.run.smithi177.stdout:658 read 0x56c9f06 thru 0x56d2248 (0x8343 bytes) 2019-12-16T22:45:28.398 INFO:teuthology.orchestra.run.smithi177.stdout:659 read 0x42de7de thru 0x42ed0b2 (0xe8d5 bytes) 2019-12-16T22:45:28.399 INFO:teuthology.orchestra.run.smithi177.stdout:661 read 0x13b2fc thru 0x1426c4 (0x73c9 bytes) 2019-12-16T22:45:28.408 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.429 INFO:teuthology.orchestra.run.smithi177.stdout:663 trunc from 0xe152a04 to 0x42ab1f 2019-12-16T22:45:28.432 INFO:teuthology.orchestra.run.smithi177.stdout:810 read 0x6f2303 thru 0x6fd9dc (0xb6da bytes) 2019-12-16T22:45:28.445 INFO:teuthology.orchestra.run.smithi177.stdout:543 read 0x188afb5 thru 0x1896a64 (0xbab0 bytes) 2019-12-16T22:45:28.447 INFO:teuthology.orchestra.run.smithi177.stdout:572 writesame 0x81b51b4 thru 0x81c12f3 data_size 0x20(0xc140 bytes) 2019-12-16T22:45:28.467 INFO:teuthology.orchestra.run.smithi177.stdout:812 trunc from 0xc5b913 to 0xd3f686f 2019-12-16T22:45:28.488 INFO:teuthology.orchestra.run.smithi177.stdout:544 write 0xb897635 thru 0xb89ddc4 (0x6790 bytes) 2019-12-16T22:45:28.489 INFO:teuthology.orchestra.run.smithi177.stdout:575 write 0xd370178 thru 0xd3747ab (0x4634 bytes) 2019-12-16T22:45:28.493 INFO:teuthology.orchestra.run.smithi177.stdout:664 write 0x47aa4d7 thru 0x47b5d99 (0xb8c3 bytes) 2019-12-16T22:45:28.501 INFO:teuthology.orchestra.run.smithi177.stdout:576 read 0x5f7dafc thru 0x5f817fc (0x3d01 bytes) 2019-12-16T22:45:28.501 INFO:teuthology.orchestra.run.smithi177.stdout:577 read 0x6f1074 thru 0x6f20f5 (0x1082 bytes) 2019-12-16T22:45:28.502 INFO:teuthology.orchestra.run.smithi177.stdout:579 writesame 0xb95a26b thru 0xb95fd17 data_size 0x1(0x5aad bytes) 2019-12-16T22:45:28.511 INFO:teuthology.orchestra.run.smithi177.stdout:665 read 0x2b1e473 thru 0x2b1f639 (0x11c7 bytes) 2019-12-16T22:45:28.511 INFO:teuthology.orchestra.run.smithi177.stdout:666 punch from 0x3e937d0 to 0x3ea01e3, (0xca13 bytes) 2019-12-16T22:45:28.511 INFO:teuthology.orchestra.run.smithi177.stdout:813 trunc from 0xd3f686f to 0x2bfe0b9 2019-12-16T22:45:28.530 INFO:teuthology.orchestra.run.smithi177.stdout:580 read 0x9839330 thru 0x983d072 (0x3d43 bytes) 2019-12-16T22:45:28.530 INFO:teuthology.orchestra.run.smithi177.stdout:581 write 0xc600f3d thru 0xc60b4ff (0xa5c3 bytes) 2019-12-16T22:45:28.533 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.534 INFO:teuthology.orchestra.run.smithi177.stdout:583 read 0x602032a thru 0x60214c4 (0x119b bytes) 2019-12-16T22:45:28.534 INFO:teuthology.orchestra.run.smithi177.stdout:584 write 0x3913ecc thru 0x391cc9a (0x8dcf bytes) 2019-12-16T22:45:28.542 INFO:teuthology.orchestra.run.smithi177.stdout:585 read 0x44ed6d7 thru 0x44ef75d (0x2087 bytes) 2019-12-16T22:45:28.542 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.542 INFO:teuthology.orchestra.run.smithi177.stdout:588 write 0x656f7e9 thru 0x657506c (0x5884 bytes) 2019-12-16T22:45:28.544 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.544 INFO:teuthology.orchestra.run.smithi177.stdout:667 write 0x7f22006 thru 0x7f27af3 (0x5aee bytes) 2019-12-16T22:45:28.549 INFO:teuthology.orchestra.run.smithi177.stdout:545 read 0xa0bcbfb thru 0xa0c3d42 (0x7148 bytes) 2019-12-16T22:45:28.550 INFO:teuthology.orchestra.run.smithi177.stdout:589 read 0x3329cf9 thru 0x332e86e (0x4b76 bytes) 2019-12-16T22:45:28.550 INFO:teuthology.orchestra.run.smithi177.stdout:590 read 0x96e9a0f thru 0x96f66e4 (0xccd6 bytes) 2019-12-16T22:45:28.551 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.551 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.555 INFO:teuthology.orchestra.run.smithi177.stdout:668 write 0x45d5523 thru 0x45e47c2 (0xf2a0 bytes) 2019-12-16T22:45:28.572 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.573 INFO:teuthology.orchestra.run.smithi177.stdout:670 writesame 0x322df57 thru 0x323aeb0 data_size 0x1b(0xcf5a bytes) 2019-12-16T22:45:28.573 INFO:teuthology.orchestra.run.smithi177.stdout:547 trunc from 0xb89ddc5 to 0xaca0bb 2019-12-16T22:45:28.575 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #3, image image_cluster1.client.mirror.1-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent4 2019-12-16T22:45:28.577 INFO:teuthology.orchestra.run.smithi177.stdout:594 trunc from 0xd3747ac to 0xec4983 2019-12-16T22:45:28.587 INFO:teuthology.orchestra.run.smithi177.stdout:815 write 0x7506ac8 thru 0x75113b2 (0xa8eb bytes) 2019-12-16T22:45:28.645 INFO:teuthology.orchestra.run.smithi177.stdout:816 read 0x49e553c thru 0x49e74a8 (0x1f6d bytes) 2019-12-16T22:45:28.646 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.646 INFO:teuthology.orchestra.run.smithi177.stdout:818 read 0x56312fe thru 0x5634812 (0x3515 bytes) 2019-12-16T22:45:28.646 INFO:teuthology.orchestra.run.smithi177.stdout:819 punch from 0x62f0629 to 0x62f85f8, (0x7fcf bytes) 2019-12-16T22:45:28.646 INFO:teuthology.orchestra.run.smithi177.stdout:820 read 0x6f74983 thru 0x6f81570 (0xcbee bytes) 2019-12-16T22:45:28.647 INFO:teuthology.orchestra.run.smithi177.stdout:671 writesame 0x8b2d84b thru 0x8b2eada data_size 0x21(0x1290 bytes) 2019-12-16T22:45:28.651 INFO:teuthology.orchestra.run.smithi177.stdout:672 writesame 0x5359a43 thru 0x536607a data_size 0x4(0xc638 bytes) 2019-12-16T22:45:28.662 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.669 INFO:teuthology.orchestra.run.smithi177.stdout:673 write 0x70642fa thru 0x70648b8 (0x5bf bytes) 2019-12-16T22:45:28.677 INFO:teuthology.orchestra.run.smithi177.stdout:916 read 0x2c4774d thru 0x2c54da2 (0xd656 bytes) 2019-12-16T22:45:28.677 INFO:teuthology.orchestra.run.smithi177.stdout:821 writesame 0xa82b1f9 thru 0xa83986f data_size 0x1(0xe677 bytes) 2019-12-16T22:45:28.679 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.679 INFO:teuthology.orchestra.run.smithi177.stdout:675 writesame 0x6c0647a thru 0x6c0ac57 data_size 0x1(0x47de bytes) 2019-12-16T22:45:28.679 INFO:teuthology.orchestra.run.smithi177.stdout:822 write 0x21d4e5a thru 0x21df6c2 (0xa869 bytes) 2019-12-16T22:45:28.700 INFO:teuthology.orchestra.run.smithi177.stdout:598 writesame 0x25e429a thru 0x25ec055 data_size 0x1a(0x7dbc bytes) 2019-12-16T22:45:28.701 INFO:teuthology.orchestra.run.smithi177.stdout:599 punch from 0xb589ce to 0xb5e0d9, (0x570b bytes) 2019-12-16T22:45:28.701 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.703 INFO:teuthology.orchestra.run.smithi177.stdout:917 read 0x23529ac thru 0x235fb29 (0xd17e bytes) 2019-12-16T22:45:28.704 INFO:teuthology.orchestra.run.smithi177.stdout:823 read 0xf154e thru 0x1000dc (0xeb8f bytes) 2019-12-16T22:45:28.707 INFO:teuthology.orchestra.run.smithi177.stdout:824 punch from 0xa1f0e3f to 0xa200d90, (0xff51 bytes) 2019-12-16T22:45:28.707 INFO:teuthology.orchestra.run.smithi177.stdout:825 punch from 0xa5e462c to 0xa5e65cb, (0x1f9f bytes) 2019-12-16T22:45:28.715 INFO:teuthology.orchestra.run.smithi177.stdout:676 trunc from 0x8b2eadb to 0x7e313f 2019-12-16T22:45:28.731 INFO:teuthology.orchestra.run.smithi177.stdout:548 write 0x85188ee thru 0x851dc08 (0x531b bytes) 2019-12-16T22:45:28.731 INFO:teuthology.orchestra.run.smithi177.stdout:826 write 0xa8c519e thru 0xa8ca207 (0x506a bytes) 2019-12-16T22:45:28.737 INFO:teuthology.orchestra.run.smithi177.stdout:602 writesame 0x41b6776 thru 0x41c516f data_size 0x6(0xe9fa bytes) 2019-12-16T22:45:28.740 INFO:teuthology.orchestra.run.smithi177.stdout:603 read 0x136478f thru 0x136f508 (0xad7a bytes) 2019-12-16T22:45:28.742 INFO:teuthology.orchestra.run.smithi177.stdout:920 write 0xed6e508 thru 0xed7be0a (0xd903 bytes) 2019-12-16T22:45:28.743 INFO:teuthology.orchestra.run.smithi177.stdout:549 write 0x24cfeda thru 0x24d5bde (0x5d05 bytes) 2019-12-16T22:45:28.757 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.757 INFO:teuthology.orchestra.run.smithi177.stdout:551 write 0x15c4637 thru 0x15c7730 (0x30fa bytes) 2019-12-16T22:45:28.779 INFO:teuthology.orchestra.run.smithi177.stdout:553 trunc from 0x851dc09 to 0x46196fa 2019-12-16T22:45:28.780 INFO:teuthology.orchestra.run.smithi177.stdout:677 read 0x355bb thru 0x3a76d (0x51b3 bytes) 2019-12-16T22:45:28.782 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.782 INFO:teuthology.orchestra.run.smithi177.stdout:921 write 0x8929876 thru 0x8935008 (0xb793 bytes) 2019-12-16T22:45:28.788 INFO:teuthology.orchestra.run.smithi177.stdout:604 writesame 0x51462e6 thru 0x5147157 data_size 0x2(0xe72 bytes) 2019-12-16T22:45:28.794 INFO:teuthology.orchestra.run.smithi177.stdout:827 writesame 0xbc1312c thru 0xbc1559e data_size 0x7(0x2473 bytes) 2019-12-16T22:45:28.841 INFO:teuthology.orchestra.run.smithi177.stdout:679 write 0xba0f4c0 thru 0xba14dec (0x592d bytes) 2019-12-16T22:45:28.846 INFO:teuthology.orchestra.run.smithi177.stdout:606 writesame 0x5dc4931 thru 0x5dd1fd7 data_size 0xd(0xd6a7 bytes) 2019-12-16T22:45:28.848 INFO:teuthology.orchestra.run.smithi177.stdout:829 write 0xde64c04 thru 0xde7304a (0xe447 bytes) 2019-12-16T22:45:28.849 INFO:teuthology.orchestra.run.smithi177.stdout:607 trunc from 0x5dd1fd8 to 0x5499c85 2019-12-16T22:45:28.871 INFO:teuthology.orchestra.run.smithi177.stdout:830 write 0xbd70ebe thru 0xbd75be1 (0x4d24 bytes) 2019-12-16T22:45:28.872 INFO:teuthology.orchestra.run.smithi177.stdout:682 punch from 0xb83fdb9 to 0xb84c2c7, (0xc50e bytes) 2019-12-16T22:45:28.872 INFO:teuthology.orchestra.run.smithi177.stdout:683 read 0xb19713d thru 0xb1a1f52 (0xae16 bytes) 2019-12-16T22:45:28.881 INFO:teuthology.orchestra.run.smithi177.stdout:831 write 0xa588d9e thru 0xa58f1bf (0x6422 bytes) 2019-12-16T22:45:28.886 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.886 INFO:teuthology.orchestra.run.smithi177.stdout:610 write 0x4db23ba thru 0x4dbd0b7 (0xacfe bytes) 2019-12-16T22:45:28.895 INFO:teuthology.orchestra.run.smithi177.stdout:611 writesame 0x509991c thru 0x50a5206 data_size 0x1(0xb8eb bytes) 2019-12-16T22:45:28.901 INFO:teuthology.orchestra.run.smithi177.stdout:684 writesame 0xe1cb71d thru 0xe1cc9d8 data_size 0x16(0x12bc bytes) 2019-12-16T22:45:28.901 INFO:teuthology.orchestra.run.smithi177.stdout:554 writesame 0x72a4861 thru 0x72a635a data_size 0x1(0x1afa bytes) 2019-12-16T22:45:28.902 INFO:teuthology.orchestra.run.smithi177.stdout:832 trunc from 0xde7304b to 0x794f8c6 2019-12-16T22:45:28.903 INFO:teuthology.orchestra.run.smithi177.stdout:685 writesame 0xce5f026 thru 0xce68c34 data_size 0x45(0x9c0f bytes) 2019-12-16T22:45:28.903 INFO:teuthology.orchestra.run.smithi177.stdout:556 punch from 0x5fbf95c to 0x5fc6199, (0x683d bytes) 2019-12-16T22:45:28.903 INFO:teuthology.orchestra.run.smithi177.stdout:557 read 0x68f890c thru 0x690460b (0xbd00 bytes) 2019-12-16T22:45:28.945 INFO:teuthology.orchestra.run.smithi177.stdout:686 write 0xb1e99c6 thru 0xb1efdf3 (0x642e bytes) 2019-12-16T22:45:28.950 INFO:teuthology.orchestra.run.smithi177.stdout:558 write 0x86ab0e9 thru 0x86b0f64 (0x5e7c bytes) 2019-12-16T22:45:28.957 INFO:teuthology.orchestra.run.smithi177.stdout:833 read 0x353d5a3 thru 0x3542c56 (0x56b4 bytes) 2019-12-16T22:45:28.958 INFO:teuthology.orchestra.run.smithi177.stdout:834 writesame 0x294ef58 thru 0x2952f70 data_size 0x1(0x4019 bytes) 2019-12-16T22:45:28.963 INFO:teuthology.orchestra.run.smithi177.stdout:687 write 0x6ff3d5c thru 0x6ff40be (0x363 bytes) 2019-12-16T22:45:28.965 INFO:teuthology.orchestra.run.smithi177.stdout:923 writesame 0x81afca2 thru 0x81b7317 data_size 0x1(0x7676 bytes) 2019-12-16T22:45:28.978 INFO:teuthology.orchestra.run.smithi177.stdout:689 writesame 0xbd0d34 thru 0xbdce4c data_size 0x1(0xc119 bytes) 2019-12-16T22:45:28.995 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.996 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:28.996 INFO:teuthology.orchestra.run.smithi177.stdout:839 read 0x4c02a31 thru 0x4c048da (0x1eaa bytes) 2019-12-16T22:45:29.022 INFO:teuthology.orchestra.run.smithi177.stdout:693 write 0x2ad6792 thru 0x2ae1e2a (0xb699 bytes) 2019-12-16T22:45:29.023 INFO:teuthology.orchestra.run.smithi177.stdout:612 writesame 0xbf418c9 thru 0xbf478d7 data_size 0x7(0x600f bytes) 2019-12-16T22:45:29.045 INFO:teuthology.orchestra.run.smithi177.stdout:614 trunc from 0xbf478d8 to 0x27cc3c 2019-12-16T22:45:29.052 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.052 INFO:teuthology.orchestra.run.smithi177.stdout:695 read 0xa7f4227 thru 0xa7f55ba (0x1394 bytes) 2019-12-16T22:45:29.053 INFO:teuthology.orchestra.run.smithi177.stdout:696 punch from 0x47a70f4 to 0x47b2035, (0xaf41 bytes) 2019-12-16T22:45:29.053 INFO:teuthology.orchestra.run.smithi177.stdout:697 write 0x275ca65 thru 0x2763501 (0x6a9d bytes) 2019-12-16T22:45:29.054 INFO:teuthology.orchestra.run.smithi177.stdout:840 write 0xe911b1a thru 0xe91cb2f (0xb016 bytes) 2019-12-16T22:45:29.211 INFO:teuthology.orchestra.run.smithi177.stdout:698 punch from 0xc17584f to 0xc17eb96, (0x9347 bytes) 2019-12-16T22:45:29.225 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.226 INFO:teuthology.orchestra.run.smithi177.stdout:843 read 0x30a24ae thru 0x30a2eb5 (0xa08 bytes) 2019-12-16T22:45:29.226 INFO:teuthology.orchestra.run.smithi177.stdout:845 write 0x1b5a900 thru 0x1b60e4e (0x654f bytes) 2019-12-16T22:45:29.226 INFO:teuthology.orchestra.run.smithi177.stdout:699 trunc from 0xe1cc9d9 to 0x6c0c7dd 2019-12-16T22:45:29.232 INFO:teuthology.orchestra.run.smithi177.stdout:925 trunc from 0xed7be0b to 0x35a3cd0 2019-12-16T22:45:29.238 INFO:teuthology.orchestra.run.smithi177.stdout:559 write 0xb93ba5b thru 0xb949909 (0xdeaf bytes) 2019-12-16T22:45:29.243 INFO:teuthology.orchestra.run.smithi177.stdout:846 read 0x230d6cb thru 0x230e2db (0xc11 bytes) 2019-12-16T22:45:29.243 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.243 INFO:teuthology.orchestra.run.smithi177.stdout:848 read 0x53dff68 thru 0x53e6878 (0x6911 bytes) 2019-12-16T22:45:29.243 INFO:teuthology.orchestra.run.smithi177.stdout:851 read 0xa8b323e thru 0xa8c2f0e (0xfcd1 bytes) 2019-12-16T22:45:29.243 INFO:teuthology.orchestra.run.smithi177.stdout:854 read 0x1d3da4b thru 0x1d4b01a (0xd5d0 bytes) 2019-12-16T22:45:29.244 INFO:teuthology.orchestra.run.smithi177.stdout:855 read 0x396cdec thru 0x397930d (0xc522 bytes) 2019-12-16T22:45:29.244 INFO:teuthology.orchestra.run.smithi177.stdout:856 read 0x3457815 thru 0x345b485 (0x3c71 bytes) 2019-12-16T22:45:29.244 INFO:teuthology.orchestra.run.smithi177.stdout:858 read 0xc878bfb thru 0xc887079 (0xe47f bytes) 2019-12-16T22:45:29.244 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.244 INFO:teuthology.orchestra.run.smithi177.stdout:860 punch from 0xbc85880 to 0xbc92aec, (0xd26c bytes) 2019-12-16T22:45:29.244 INFO:teuthology.orchestra.run.smithi177.stdout:861 write 0x14581a7 thru 0x1466a13 (0xe86d bytes) 2019-12-16T22:45:29.270 INFO:teuthology.orchestra.run.smithi177.stdout:560 writesame 0x948c08c thru 0x948efd1 data_size 0x3(0x2f46 bytes) 2019-12-16T22:45:29.271 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.271 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.271 INFO:teuthology.orchestra.run.smithi177.stdout:195 clone 5 order 24 su 65536 sc 2 2019-12-16T22:45:29.282 INFO:teuthology.orchestra.run.smithi177.stdout:862 write 0x76cd023 thru 0x76d9b4b (0xcb29 bytes) 2019-12-16T22:45:29.294 INFO:teuthology.orchestra.run.smithi177.stdout:561 write 0x20243eb thru 0x2025e7c (0x1a92 bytes) 2019-12-16T22:45:29.329 INFO:teuthology.orchestra.run.smithi177.stdout:703 write 0xf7bfca thru 0xf87480 (0xb4b7 bytes) 2019-12-16T22:45:29.343 INFO:teuthology.orchestra.run.smithi177.stdout:866 punch from 0x33d1215 to 0x33ddbc3, (0xc9ae bytes) 2019-12-16T22:45:29.343 INFO:teuthology.orchestra.run.smithi177.stdout:868 write 0x843cc05 thru 0x8443d17 (0x7113 bytes) 2019-12-16T22:45:29.348 INFO:teuthology.orchestra.run.smithi177.stdout:704 read 0xcf2013 thru 0xcfc155 (0xa143 bytes) 2019-12-16T22:45:29.349 INFO:teuthology.orchestra.run.smithi177.stdout:705 read 0x3ec5701 thru 0x3ed2b80 (0xd480 bytes) 2019-12-16T22:45:29.349 INFO:teuthology.orchestra.run.smithi177.stdout:706 writesame 0x6809a0e thru 0x6812581 data_size 0x77(0x8b74 bytes) 2019-12-16T22:45:29.352 INFO:teuthology.orchestra.run.smithi177.stdout:615 writesame 0x86d7b2e thru 0x86e4eeb data_size 0x1(0xd3be bytes) 2019-12-16T22:45:29.356 INFO:teuthology.orchestra.run.smithi177.stdout:616 punch from 0x39655de to 0x39711e7, (0xbc09 bytes) 2019-12-16T22:45:29.356 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.375 INFO:teuthology.orchestra.run.smithi177.stdout:562 writesame 0xe9196cd thru 0xe919b5a data_size 0xb(0x48e bytes) 2019-12-16T22:45:29.376 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.376 INFO:teuthology.orchestra.run.smithi177.stdout:564 write 0xd0d8a6c thru 0xd0db19c (0x2731 bytes) 2019-12-16T22:45:29.376 INFO:teuthology.orchestra.run.smithi177.stdout:870 write 0xc210a9e thru 0xc213898 (0x2dfb bytes) 2019-12-16T22:45:29.378 INFO:teuthology.orchestra.run.smithi177.stdout:926 trunc from 0x35a3cd0 to 0x802b6a9 2019-12-16T22:45:29.383 INFO:teuthology.orchestra.run.smithi177.stdout:565 punch from 0x6cfb7a6 to 0x6cfe05d, (0x28b7 bytes) 2019-12-16T22:45:29.383 INFO:teuthology.orchestra.run.smithi177.stdout:566 read 0x835a1e6 thru 0x835a9e6 (0x801 bytes) 2019-12-16T22:45:29.384 INFO:teuthology.orchestra.run.smithi177.stdout:567 read 0xe4ded50 thru 0xe4dee8f (0x140 bytes) 2019-12-16T22:45:29.384 INFO:teuthology.orchestra.run.smithi177.stdout:568 write 0x66e235a thru 0x66ee00d (0xbcb4 bytes) 2019-12-16T22:45:29.384 INFO:teuthology.orchestra.run.smithi177.stdout:871 trunc from 0xe91cb30 to 0xcbdd185 2019-12-16T22:45:29.385 INFO:teuthology.orchestra.run.smithi177.stdout:618 write 0xc7c209e thru 0xc7cbf81 (0x9ee4 bytes) 2019-12-16T22:45:29.398 INFO:teuthology.orchestra.run.smithi177.stdout:707 write 0xcc0d6cc thru 0xcc16a0c (0x9341 bytes) 2019-12-16T22:45:29.398 INFO:teuthology.orchestra.run.smithi177.stdout:619 trunc from 0xc7cbf82 to 0xb203c07 2019-12-16T22:45:29.401 INFO:teuthology.orchestra.run.smithi177.stdout:569 punch from 0xe55c9a1 to 0xe569398, (0xc9f7 bytes) 2019-12-16T22:45:29.402 INFO:teuthology.orchestra.run.smithi177.stdout:572 read 0x10cc8fe thru 0x10db066 (0xe769 bytes) 2019-12-16T22:45:29.413 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.413 INFO:teuthology.orchestra.run.smithi177.stdout:710 read 0x1198a46 thru 0x119e164 (0x571f bytes) 2019-12-16T22:45:29.414 INFO:teuthology.orchestra.run.smithi177.stdout:927 trunc from 0x802b6a9 to 0x479acfe 2019-12-16T22:45:29.415 INFO:teuthology.orchestra.run.smithi177.stdout:711 write 0x524b0cf thru 0x52555f8 (0xa52a bytes) 2019-12-16T22:45:29.420 INFO:teuthology.orchestra.run.smithi177.stdout:872 writesame 0xae8f1d2 thru 0xae9d597 data_size 0x77(0xe3c6 bytes) 2019-12-16T22:45:29.426 INFO:teuthology.orchestra.run.smithi177.stdout:621 read 0x40c33e8 thru 0x40c6d21 (0x393a bytes) 2019-12-16T22:45:29.428 INFO:teuthology.orchestra.run.smithi177.stdout:573 trunc from 0xe919b5b to 0x32549e2 2019-12-16T22:45:29.429 INFO:teuthology.orchestra.run.smithi177.stdout:623 trunc from 0xb203c07 to 0xc814cf8 2019-12-16T22:45:29.430 INFO:teuthology.orchestra.run.smithi177.stdout:713 writesame 0x8b93364 thru 0x8b949c8 data_size 0x3(0x1665 bytes) 2019-12-16T22:45:29.440 INFO:teuthology.orchestra.run.smithi177.stdout:873 read 0x8848b33 thru 0x884ccca (0x4198 bytes) 2019-12-16T22:45:29.440 INFO:teuthology.orchestra.run.smithi177.stdout:876 read 0xb1a76c8 thru 0xb1ad0a0 (0x59d9 bytes) 2019-12-16T22:45:29.440 INFO:teuthology.orchestra.run.smithi177.stdout:877 read 0x7de575d thru 0x7decb20 (0x73c4 bytes) 2019-12-16T22:45:29.441 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.441 INFO:teuthology.orchestra.run.smithi177.stdout:879 read 0x83296fa thru 0x833819d (0xeaa4 bytes) 2019-12-16T22:45:29.441 INFO:teuthology.orchestra.run.smithi177.stdout:880 read 0x89d290 thru 0x8a9403 (0xc174 bytes) 2019-12-16T22:45:29.442 INFO:teuthology.orchestra.run.smithi177.stdout:882 read 0xac8babb thru 0xac8bbac (0xf2 bytes) 2019-12-16T22:45:29.442 INFO:teuthology.orchestra.run.smithi177.stdout:883 read 0x3503176 thru 0x3504836 (0x16c1 bytes) 2019-12-16T22:45:29.451 INFO:teuthology.orchestra.run.smithi177.stdout:714 write 0xa2a85f2 thru 0xa2b0f19 (0x8928 bytes) 2019-12-16T22:45:29.451 INFO:teuthology.orchestra.run.smithi177.stdout:928 trunc from 0x479acfe to 0xa85783 2019-12-16T22:45:29.452 INFO:teuthology.orchestra.run.smithi177.stdout:885 trunc from 0xcbdd185 to 0x5b9e0d4 2019-12-16T22:45:29.474 INFO:teuthology.orchestra.run.smithi177.stdout:715 trunc from 0xcc16a0d to 0x82990e2 2019-12-16T22:45:29.476 INFO:teuthology.orchestra.run.smithi177.stdout:627 trunc from 0xc814cf8 to 0x2d4dbd1 2019-12-16T22:45:29.488 INFO:teuthology.orchestra.run.smithi177.stdout:575 read 0x2ab7fed thru 0x2abd9ae (0x59c2 bytes) 2019-12-16T22:45:29.515 INFO:teuthology.orchestra.run.smithi177.stdout:576 read 0xc283c2 thru 0xc36a48 (0xe687 bytes) 2019-12-16T22:45:29.535 INFO:teuthology.orchestra.run.smithi177.stdout:886 read 0x4836232 thru 0x48443ca (0xe199 bytes) 2019-12-16T22:45:29.544 INFO:teuthology.orchestra.run.smithi177.stdout:717 write 0x4011458 thru 0x4014716 (0x32bf bytes) 2019-12-16T22:45:29.552 INFO:teuthology.orchestra.run.smithi177.stdout:930 punch from 0x6862d5 to 0x692a30, (0xc75b bytes) 2019-12-16T22:45:29.552 INFO:teuthology.orchestra.run.smithi177.stdout:931 punch from 0x8db65b to 0x8dc714, (0x10b9 bytes) 2019-12-16T22:45:29.552 INFO:teuthology.orchestra.run.smithi177.stdout:577 writesame 0xbcc982e thru 0xbcca21c data_size 0x1(0x9ef bytes) 2019-12-16T22:45:29.556 INFO:teuthology.orchestra.run.smithi177.stdout:578 read 0x1ddd39b thru 0x1de3b9f (0x6805 bytes) 2019-12-16T22:45:29.557 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.557 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.558 INFO:teuthology.orchestra.run.smithi177.stdout:718 punch from 0x15f3b9e to 0x15f7972, (0x3dd4 bytes) 2019-12-16T22:45:29.559 INFO:teuthology.orchestra.run.smithi177.stdout:581 trunc from 0xbcca21d to 0xd018b3a 2019-12-16T22:45:29.564 INFO:teuthology.orchestra.run.smithi177.stdout:932 trunc from 0xa85783 to 0x60c74c7 2019-12-16T22:45:29.564 INFO:teuthology.orchestra.run.smithi177.stdout:887 writesame 0x7c8a457 thru 0x7c95839 data_size 0x1(0xb3e3 bytes) 2019-12-16T22:45:29.567 INFO:teuthology.orchestra.run.smithi177.stdout:628 writesame 0x6a183b4 thru 0x6a1c583 data_size 0x6c(0x41d0 bytes) 2019-12-16T22:45:29.573 INFO:teuthology.orchestra.run.smithi177.stdout:630 punch from 0x429f588 to 0x42a3271, (0x3ce9 bytes) 2019-12-16T22:45:29.573 INFO:teuthology.orchestra.run.smithi177.stdout:631 punch from 0x39c136 to 0x3a3203, (0x70cd bytes) 2019-12-16T22:45:29.573 INFO:teuthology.orchestra.run.smithi177.stdout:632 write 0x33dd750 thru 0x33eca05 (0xf2b6 bytes) 2019-12-16T22:45:29.574 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone4 from 0x15f2133 (overlap 0x15f2133) to 0xd2ad85 2019-12-16T22:45:29.579 INFO:teuthology.orchestra.run.smithi177.stdout:583 read 0x9dbfc8c thru 0x9dccbd8 (0xcf4d bytes) 2019-12-16T22:45:29.580 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.580 INFO:teuthology.orchestra.run.smithi177.stdout:586 read 0xbcd7247 thru 0xbcdea33 (0x77ed bytes) 2019-12-16T22:45:29.580 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.580 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.581 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.581 INFO:teuthology.orchestra.run.smithi177.stdout:590 read 0x3bff0fb thru 0x3c08154 (0x905a bytes) 2019-12-16T22:45:29.581 INFO:teuthology.orchestra.run.smithi177.stdout:591 read 0x4c7945f thru 0x4c83e42 (0xa9e4 bytes) 2019-12-16T22:45:29.581 INFO:teuthology.orchestra.run.smithi177.stdout:592 read 0xce3f406 thru 0xce46965 (0x7560 bytes) 2019-12-16T22:45:29.582 INFO:teuthology.orchestra.run.smithi177.stdout:594 read 0x42f7c77 thru 0x42fa6d9 (0x2a63 bytes) 2019-12-16T22:45:29.582 INFO:teuthology.orchestra.run.smithi177.stdout:595 writesame 0x7bccc09 thru 0x7bd1546 data_size 0x4b(0x493e bytes) 2019-12-16T22:45:29.585 INFO:teuthology.orchestra.run.smithi177.stdout:933 writesame 0xd51f58 thru 0xd598dd data_size 0xa(0x7986 bytes) 2019-12-16T22:45:29.589 INFO:teuthology.orchestra.run.smithi177.stdout:719 writesame 0xa98014b thru 0xa984d1f data_size 0x9(0x4bd5 bytes) 2019-12-16T22:45:29.592 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.592 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.595 INFO:teuthology.orchestra.run.smithi177.stdout:597 trunc from 0xd018b3a to 0xb58e5ae 2019-12-16T22:45:29.611 INFO:teuthology.orchestra.run.smithi177.stdout:889 write 0xc5dbaf3 thru 0xc5e2906 (0x6e14 bytes) 2019-12-16T22:45:29.619 INFO:teuthology.orchestra.run.smithi177.stdout:633 write 0x6e0971c thru 0x6e1772c (0xe011 bytes) 2019-12-16T22:45:29.623 INFO:teuthology.orchestra.run.smithi177.stdout:721 write 0xca062d0 thru 0xca0bbd8 (0x5909 bytes) 2019-12-16T22:45:29.625 INFO:teuthology.orchestra.run.smithi177.stdout:599 write 0xadb8c29 thru 0xadb90ac (0x484 bytes) 2019-12-16T22:45:29.627 INFO:teuthology.orchestra.run.smithi177.stdout:891 write 0x763ea8e thru 0x7642bf4 (0x4167 bytes) 2019-12-16T22:45:29.632 INFO:teuthology.orchestra.run.smithi177.stdout:935 write 0xbedf2a1 thru 0xbeec8d5 (0xd635 bytes) 2019-12-16T22:45:29.634 INFO:teuthology.orchestra.run.smithi177.stdout:601 read 0x2dcb50e thru 0x2dd3366 (0x7e59 bytes) 2019-12-16T22:45:29.635 INFO:teuthology.orchestra.run.smithi177.stdout:602 clone 6 order 23 su 524288 sc 13 2019-12-16T22:45:29.643 INFO:teuthology.orchestra.run.smithi177.stdout:722 read 0x1c7c317 thru 0x1c85e29 (0x9b13 bytes) 2019-12-16T22:45:29.643 INFO:teuthology.orchestra.run.smithi177.stdout:723 read 0x1a1e1dd thru 0x1a2afd5 (0xcdf9 bytes) 2019-12-16T22:45:29.643 INFO:teuthology.orchestra.run.smithi177.stdout:892 read 0x29ee05 thru 0x29fea9 (0x10a5 bytes) 2019-12-16T22:45:29.644 INFO:teuthology.orchestra.run.smithi177.stdout:893 write 0x18ce551 thru 0x18dbf12 (0xd9c2 bytes) 2019-12-16T22:45:29.645 INFO:teuthology.orchestra.run.smithi177.stdout:725 write 0xa135cc thru 0xa15f12 (0x2947 bytes) 2019-12-16T22:45:29.662 INFO:teuthology.orchestra.run.smithi177.stdout:726 writesame 0xb42bd25 thru 0xb432835 data_size 0x1(0x6b11 bytes) 2019-12-16T22:45:29.672 INFO:teuthology.orchestra.run.smithi177.stdout:936 writesame 0x69619be thru 0x69625ca data_size 0x1(0xc0d bytes) 2019-12-16T22:45:29.675 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.675 INFO:teuthology.orchestra.run.smithi177.stdout:895 punch from 0xaf3251e to 0xaf3ea82, (0xc564 bytes) 2019-12-16T22:45:29.676 INFO:teuthology.orchestra.run.smithi177.stdout:896 clone 7 order 22 su 524288 sc 7 2019-12-16T22:45:29.687 INFO:teuthology.orchestra.run.smithi177.stdout:727 punch from 0xa7ce40c to 0xa7d1442, (0x3036 bytes) 2019-12-16T22:45:29.687 INFO:teuthology.orchestra.run.smithi177.stdout:728 punch from 0x961f3f7 to 0x962beff, (0xcb08 bytes) 2019-12-16T22:45:29.687 INFO:teuthology.orchestra.run.smithi177.stdout:729 write 0xb312df2 thru 0xb3186d9 (0x58e8 bytes) 2019-12-16T22:45:29.689 INFO:teuthology.orchestra.run.smithi177.stdout:938 read 0x83d4bbe thru 0x83d93c5 (0x4808 bytes) 2019-12-16T22:45:29.690 INFO:teuthology.orchestra.run.smithi177.stdout:939 punch from 0x3554f7c to 0x355d9d4, (0x8a58 bytes) 2019-12-16T22:45:29.690 INFO:teuthology.orchestra.run.smithi177.stdout:941 punch from 0x9a83d7c to 0x9a88730, (0x49b4 bytes) 2019-12-16T22:45:29.690 INFO:teuthology.orchestra.run.smithi177.stdout:942 writesame 0x34df08 thru 0x350e8a data_size 0x1(0x2f83 bytes) 2019-12-16T22:45:29.691 INFO:teuthology.orchestra.run.smithi177.stdout:634 writesame 0xb3b9d7b thru 0xb3ba38b data_size 0x1(0x611 bytes) 2019-12-16T22:45:29.693 INFO:teuthology.orchestra.run.smithi177.stdout:636 write 0xa2ab09b thru 0xa2b8652 (0xd5b8 bytes) 2019-12-16T22:45:29.728 INFO:teuthology.orchestra.run.smithi177.stdout:639 punch from 0x6322eb8 to 0x632c2c5, (0x940d bytes) 2019-12-16T22:45:29.728 INFO:teuthology.orchestra.run.smithi177.stdout:641 write 0x367944f thru 0x3682fa8 (0x9b5a bytes) 2019-12-16T22:45:29.747 INFO:teuthology.orchestra.run.smithi177.stdout:642 write 0x9614968 thru 0x9624225 (0xf8be bytes) 2019-12-16T22:45:29.759 INFO:teuthology.orchestra.run.smithi177.stdout:645 clone 6 order 21 su 1048576 sc 12 2019-12-16T22:45:29.759 INFO:teuthology.orchestra.run.smithi177.stdout:730 writesame 0xd23d357 thru 0xd23d6fa data_size 0x2(0x3a4 bytes) 2019-12-16T22:45:29.763 INFO:teuthology.orchestra.run.smithi177.stdout:732 punch from 0x78b5464 to 0x78bc815, (0x73b1 bytes) 2019-12-16T22:45:29.763 INFO:teuthology.orchestra.run.smithi177.stdout:733 read 0xcfdd9d2 thru 0xcfe0301 (0x2930 bytes) 2019-12-16T22:45:29.764 INFO:teuthology.orchestra.run.smithi177.stdout:734 write 0xa864ca6 thru 0xa86690f (0x1c6a bytes) 2019-12-16T22:45:29.770 INFO:teuthology.orchestra.run.smithi177.stdout:943 read 0x1980463 thru 0x198feb3 (0xfa51 bytes) 2019-12-16T22:45:29.771 INFO:teuthology.orchestra.run.smithi177.stdout:944 writesame 0x519e693 thru 0x519f4b6 data_size 0xa(0xe24 bytes) 2019-12-16T22:45:29.771 INFO:teuthology.orchestra.run.smithi177.stdout:735 write 0x9f379b9 thru 0x9f400bc (0x8704 bytes) 2019-12-16T22:45:29.779 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #3, image image_cluster1.client.mirror.2-clone3 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent4 2019-12-16T22:45:29.786 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.786 INFO:teuthology.orchestra.run.smithi177.stdout:737 write 0xa83b64e thru 0xa848973 (0xd326 bytes) 2019-12-16T22:45:29.798 INFO:teuthology.orchestra.run.smithi177.stdout:738 read 0x6bec234 thru 0x6bf7d91 (0xbb5e bytes) 2019-12-16T22:45:29.804 INFO:teuthology.orchestra.run.smithi177.stdout:196 punch from 0x100557f to 0x10062ff, (0xd80 bytes) 2019-12-16T22:45:29.805 INFO:teuthology.orchestra.run.smithi177.stdout:739 trunc from 0xd23d6fb to 0xaf452da 2019-12-16T22:45:29.805 INFO:teuthology.orchestra.run.smithi177.stdout:945 writesame 0xc97e9e1 thru 0xc98adf4 data_size 0x2f(0xc414 bytes) 2019-12-16T22:45:29.810 INFO:teuthology.orchestra.run.smithi177.stdout:948 read 0x7c1fa17 thru 0x7c2452e (0x4b18 bytes) 2019-12-16T22:45:29.810 INFO:teuthology.orchestra.run.smithi177.stdout:949 write 0x32ea1a7 thru 0x32f8586 (0xe3e0 bytes) 2019-12-16T22:45:29.841 INFO:teuthology.orchestra.run.smithi177.stdout:950 write 0x3ab1e78 thru 0x3ab7aed (0x5c76 bytes) 2019-12-16T22:45:29.846 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.847 INFO:teuthology.orchestra.run.smithi177.stdout:741 read 0xa43913 thru 0xa47ae6 (0x41d4 bytes) 2019-12-16T22:45:29.847 INFO:teuthology.orchestra.run.smithi177.stdout:742 read 0x5060a13 thru 0x50635ec (0x2bda bytes) 2019-12-16T22:45:29.847 INFO:teuthology.orchestra.run.smithi177.stdout:743 write 0x45fbcc thru 0x467174 (0x75a9 bytes) 2019-12-16T22:45:29.851 INFO:teuthology.orchestra.run.smithi177.stdout:197 write 0x5c224d5 thru 0x5c2d1ef (0xad1b bytes) 2019-12-16T22:45:29.861 INFO:teuthology.orchestra.run.smithi177.stdout:744 trunc from 0xaf452da to 0xa00827e 2019-12-16T22:45:29.866 INFO:teuthology.orchestra.run.smithi177.stdout:198 writesame 0x25dd0ed thru 0x25e4911 data_size 0x1(0x7825 bytes) 2019-12-16T22:45:29.898 INFO:teuthology.orchestra.run.smithi177.stdout:951 write 0xea57236 thru 0xea5fd35 (0x8b00 bytes) 2019-12-16T22:45:29.914 INFO:teuthology.orchestra.run.smithi177.stdout:745 write 0xabd1b5a thru 0xabd1da8 (0x24f bytes) 2019-12-16T22:45:29.921 INFO:teuthology.orchestra.run.smithi177.stdout:748 writesame 0x95b9a52 thru 0x95c8fed data_size 0x16(0xf59c bytes) 2019-12-16T22:45:29.922 INFO:teuthology.orchestra.run.smithi177.stdout:952 writesame 0xe356bf1 thru 0xe3628c2 data_size 0x1(0xbcd2 bytes) 2019-12-16T22:45:29.928 INFO:teuthology.orchestra.run.smithi177.stdout:199 writesame 0xde22b49 thru 0xde2fb04 data_size 0x5(0xcfbc bytes) 2019-12-16T22:45:29.933 INFO:teuthology.orchestra.run.smithi177.stdout:749 punch from 0xf57e45 to 0xf5dff8, (0x61b3 bytes) 2019-12-16T22:45:29.934 INFO:teuthology.orchestra.run.smithi177.stdout:750 write 0x9263801 thru 0x926930f (0x5b0f bytes) 2019-12-16T22:45:29.937 INFO:teuthology.orchestra.run.smithi177.stdout:200 trunc from 0xde2fb05 to 0xb9b35de 2019-12-16T22:45:29.948 INFO:teuthology.orchestra.run.smithi177.stdout:751 punch from 0x281e82a to 0x282cf0c, (0xe6e2 bytes) 2019-12-16T22:45:29.954 INFO:teuthology.orchestra.run.smithi177.stdout:953 writesame 0x788f8d thru 0x797fc7 data_size 0x1(0xf03b bytes) 2019-12-16T22:45:29.976 INFO:teuthology.orchestra.run.smithi177.stdout:201 read 0x722a886 thru 0x722de66 (0x35e1 bytes) 2019-12-16T22:45:29.976 INFO:teuthology.orchestra.run.smithi177.stdout:202 punch from 0x4c1b7e to 0x4cf6f6, (0xdb78 bytes) 2019-12-16T22:45:29.977 INFO:teuthology.orchestra.run.smithi177.stdout:204 read 0xa650bd thru 0xa71795 (0xc6d9 bytes) 2019-12-16T22:45:29.977 INFO:teuthology.orchestra.run.smithi177.stdout:205 read 0x52c40f thru 0x5310a8 (0x4c9a bytes) 2019-12-16T22:45:29.978 INFO:teuthology.orchestra.run.smithi177.stdout:206 read 0x2311b49 thru 0x2315289 (0x3741 bytes) 2019-12-16T22:45:29.979 INFO:teuthology.orchestra.run.smithi177.stdout:208 read 0xb30ef92 thru 0xb31a72b (0xb79a bytes) 2019-12-16T22:45:29.980 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:29.980 INFO:teuthology.orchestra.run.smithi177.stdout:211 read 0x1fdc85c thru 0x1fe71d2 (0xa977 bytes) 2019-12-16T22:45:29.981 INFO:teuthology.orchestra.run.smithi177.stdout:213 write 0x1e0cd61 thru 0x1e18974 (0xbc14 bytes) 2019-12-16T22:45:30.013 INFO:teuthology.orchestra.run.smithi177.stdout:752 write 0xcdf4a0f thru 0xcdf5e91 (0x1483 bytes) 2019-12-16T22:45:30.024 INFO:teuthology.orchestra.run.smithi177.stdout:753 trunc from 0xcdf5e92 to 0xcbd8acc 2019-12-16T22:45:30.058 INFO:teuthology.orchestra.run.smithi177.stdout:754 punch from 0x8e72e18 to 0x8e79b31, (0x6d19 bytes) 2019-12-16T22:45:30.058 INFO:teuthology.orchestra.run.smithi177.stdout:755 punch from 0x6d6ea45 to 0x6d72237, (0x37f2 bytes) 2019-12-16T22:45:30.058 INFO:teuthology.orchestra.run.smithi177.stdout:756 punch from 0x8e922f8 to 0x8e9ea84, (0xc78c bytes) 2019-12-16T22:45:30.058 INFO:teuthology.orchestra.run.smithi177.stdout:757 writesame 0xb12c184 thru 0xb13ac89 data_size 0x2(0xeb06 bytes) 2019-12-16T22:45:30.069 INFO:teuthology.orchestra.run.smithi177.stdout:214 read 0x3ebe1be thru 0x3ec26c5 (0x4508 bytes) 2019-12-16T22:45:30.070 INFO:teuthology.orchestra.run.smithi177.stdout:215 punch from 0x265a70a to 0x265f935, (0x522b bytes) 2019-12-16T22:45:30.088 INFO:teuthology.orchestra.run.smithi177.stdout:758 flatten 2019-12-16T22:45:30.092 INFO:teuthology.orchestra.run.smithi177.stdout:216 trunc from 0xb9b35de to 0x1ac22ef 2019-12-16T22:45:30.109 INFO:teuthology.orchestra.run.smithi177.stdout:955 trunc from 0xea5fd36 to 0x1dc8dac 2019-12-16T22:45:30.118 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.124 INFO:teuthology.orchestra.run.smithi177.stdout:759 trunc from 0xcbd8acc to 0x1eb5933 2019-12-16T22:45:30.152 INFO:teuthology.orchestra.run.smithi177.stdout:218 write 0xbb3f481 thru 0xbb4416b (0x4ceb bytes) 2019-12-16T22:45:30.170 INFO:teuthology.orchestra.run.smithi177.stdout:956 trunc from 0x1dc8dac to 0x8aeaf20 2019-12-16T22:45:30.184 INFO:teuthology.orchestra.run.smithi177.stdout:957 read 0x53b2611 thru 0x53b96c8 (0x70b8 bytes) 2019-12-16T22:45:30.184 INFO:teuthology.orchestra.run.smithi177.stdout:963 read 0xa87eb5 thru 0xa948a3 (0xc9ef bytes) 2019-12-16T22:45:30.187 INFO:teuthology.orchestra.run.smithi177.stdout:219 write 0xddc8b5f thru 0xddd7851 (0xecf3 bytes) 2019-12-16T22:45:30.189 INFO:teuthology.orchestra.run.smithi177.stdout:964 trunc from 0x8aeaf20 to 0xb0cd640 2019-12-16T22:45:30.204 INFO:teuthology.orchestra.run.smithi177.stdout:220 read 0x467a360 thru 0x467f26c (0x4f0d bytes) 2019-12-16T22:45:30.205 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.205 INFO:teuthology.orchestra.run.smithi177.stdout:224 writesame 0x597ed1b thru 0x598b359 data_size 0x3(0xc63f bytes) 2019-12-16T22:45:30.205 INFO:teuthology.orchestra.run.smithi177.stdout:760 writesame 0xe51ac86 thru 0xe528dd4 data_size 0x1(0xe14f bytes) 2019-12-16T22:45:30.207 INFO:teuthology.orchestra.run.smithi177.stdout:761 read 0x244980d thru 0x244e8e8 (0x50dc bytes) 2019-12-16T22:45:30.207 INFO:teuthology.orchestra.run.smithi177.stdout:762 write 0xc308709 thru 0xc313974 (0xb26c bytes) 2019-12-16T22:45:30.209 INFO:teuthology.orchestra.run.smithi177.stdout:965 punch from 0x4f004b2 to 0x4f00dc0, (0x90e bytes) 2019-12-16T22:45:30.216 INFO:teuthology.orchestra.run.smithi177.stdout:966 trunc from 0xb0cd640 to 0x7572389 2019-12-16T22:45:30.217 INFO:teuthology.orchestra.run.smithi177.stdout:226 punch from 0x1b11f to 0x1eec0, (0x3da1 bytes) 2019-12-16T22:45:30.217 INFO:teuthology.orchestra.run.smithi177.stdout:227 write 0x67aa964 thru 0x67ac26a (0x1907 bytes) 2019-12-16T22:45:30.220 INFO:teuthology.orchestra.run.smithi177.stdout:763 punch from 0x807dfc2 to 0x8086606, (0x8644 bytes) 2019-12-16T22:45:30.223 INFO:teuthology.orchestra.run.smithi177.stdout:228 read 0x5d061a6 thru 0x5d0d554 (0x73af bytes) 2019-12-16T22:45:30.224 INFO:teuthology.orchestra.run.smithi177.stdout:231 read 0xd35f4a9 thru 0xd367d44 (0x889c bytes) 2019-12-16T22:45:30.225 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.225 INFO:teuthology.orchestra.run.smithi177.stdout:233 write 0xab94cc2 thru 0xab9c3c5 (0x7704 bytes) 2019-12-16T22:45:30.229 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.229 INFO:teuthology.orchestra.run.smithi177.stdout:235 punch from 0xcf1a1dd to 0xcf27fc2, (0xdde5 bytes) 2019-12-16T22:45:30.239 INFO:teuthology.orchestra.run.smithi177.stdout:764 trunc from 0xe528dd5 to 0x4aa3f1f 2019-12-16T22:45:30.239 INFO:teuthology.orchestra.run.smithi177.stdout:236 trunc from 0xddd7852 to 0x8ff7edf 2019-12-16T22:45:30.259 INFO:teuthology.orchestra.run.smithi177.stdout:967 write 0xa010a70 thru 0xa01cb3a (0xc0cb bytes) 2019-12-16T22:45:30.270 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.271 INFO:teuthology.orchestra.run.smithi177.stdout:766 read 0x2406321 thru 0x241298b (0xc66b bytes) 2019-12-16T22:45:30.271 INFO:teuthology.orchestra.run.smithi177.stdout:237 read 0x3cddc8c thru 0x3ce8e71 (0xb1e6 bytes) 2019-12-16T22:45:30.271 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.271 INFO:teuthology.orchestra.run.smithi177.stdout:240 read 0xd5d73d thru 0xd63bb0 (0x6474 bytes) 2019-12-16T22:45:30.272 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.272 INFO:teuthology.orchestra.run.smithi177.stdout:242 read 0x34ad23d thru 0x34b555a (0x831e bytes) 2019-12-16T22:45:30.272 INFO:teuthology.orchestra.run.smithi177.stdout:243 clone 6 order 24 su 8388608 sc 15 2019-12-16T22:45:30.282 INFO:teuthology.orchestra.run.smithi177.stdout:968 trunc from 0xa01cb3b to 0xb31b8ea 2019-12-16T22:45:30.298 INFO:teuthology.orchestra.run.smithi177.stdout:767 write 0xa576516 thru 0xa577d88 (0x1873 bytes) 2019-12-16T22:45:30.298 INFO:teuthology.orchestra.run.smithi177.stdout:969 read 0x17f7ace thru 0x1806b3b (0xf06e bytes) 2019-12-16T22:45:30.299 INFO:teuthology.orchestra.run.smithi177.stdout:970 write 0x1464866 thru 0x1474442 (0xfbdd bytes) 2019-12-16T22:45:30.311 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.311 INFO:teuthology.orchestra.run.smithi177.stdout:769 write 0x7c2f04e thru 0x7c3a5d9 (0xb58c bytes) 2019-12-16T22:45:30.328 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.329 INFO:teuthology.orchestra.run.smithi177.stdout:771 write 0x3a6a59c thru 0x3a79c43 (0xf6a8 bytes) 2019-12-16T22:45:30.329 INFO:teuthology.orchestra.run.smithi177.stdout:972 writesame 0x621391b thru 0x6217808 data_size 0x1e(0x3eee bytes) 2019-12-16T22:45:30.361 INFO:teuthology.orchestra.run.smithi177.stdout:973 punch from 0x6b062ac to 0x6b12d9d, (0xcaf1 bytes) 2019-12-16T22:45:30.361 INFO:teuthology.orchestra.run.smithi177.stdout:975 punch from 0x88fb65e to 0x8902585, (0x6f27 bytes) 2019-12-16T22:45:30.361 INFO:teuthology.orchestra.run.smithi177.stdout:976 write 0x61a4414 thru 0x61ac81b (0x8408 bytes) 2019-12-16T22:45:30.363 INFO:teuthology.orchestra.run.smithi177.stdout:772 writesame 0x573ee41 thru 0x574e3a2 data_size 0x7(0xf562 bytes) 2019-12-16T22:45:30.396 INFO:teuthology.orchestra.run.smithi177.stdout:773 read 0x73f18dd thru 0x73fb1b7 (0x98db bytes) 2019-12-16T22:45:30.406 INFO:teuthology.orchestra.run.smithi177.stdout:978 trunc from 0xb31b8ea to 0x3b94d68 2019-12-16T22:45:30.418 INFO:teuthology.orchestra.run.smithi177.stdout:774 write 0xc963093 thru 0xc96bda2 (0x8d10 bytes) 2019-12-16T22:45:30.435 INFO:teuthology.orchestra.run.smithi177.stdout:775 write 0x62eb236 thru 0x62f752c (0xc2f7 bytes) 2019-12-16T22:45:30.444 INFO:teuthology.orchestra.run.smithi177.stdout:776 write 0x6618365 thru 0x6620a24 (0x86c0 bytes) 2019-12-16T22:45:30.449 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.449 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.449 INFO:teuthology.orchestra.run.smithi177.stdout:981 read 0x1a03d31 thru 0x1a0824c (0x451c bytes) 2019-12-16T22:45:30.451 INFO:teuthology.orchestra.run.smithi177.stdout:983 trunc from 0x3b94d68 to 0x4a02936 2019-12-16T22:45:30.460 INFO:teuthology.orchestra.run.smithi177.stdout:777 write 0x7d80450 thru 0x7d8b39a (0xaf4b bytes) 2019-12-16T22:45:30.469 INFO:teuthology.orchestra.run.smithi177.stdout:778 punch from 0xac5d9cf to 0xac64bcc, (0x71fd bytes) 2019-12-16T22:45:30.470 INFO:teuthology.orchestra.run.smithi177.stdout:779 read 0x2f0caf9 thru 0x2f17eac (0xb3b4 bytes) 2019-12-16T22:45:30.471 INFO:teuthology.orchestra.run.smithi177.stdout:780 read 0x46f5e4d thru 0x46f87d6 (0x298a bytes) 2019-12-16T22:45:30.471 INFO:teuthology.orchestra.run.smithi177.stdout:781 punch from 0x482041b to 0x482caeb, (0xc6d0 bytes) 2019-12-16T22:45:30.471 INFO:teuthology.orchestra.run.smithi177.stdout:782 read 0x3f43d1b thru 0x3f4d3dd (0x96c3 bytes) 2019-12-16T22:45:30.471 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.471 INFO:teuthology.orchestra.run.smithi177.stdout:784 punch from 0xbfd358a to 0xbfdb42b, (0x7ea1 bytes) 2019-12-16T22:45:30.471 INFO:teuthology.orchestra.run.smithi177.stdout:787 write 0x4b8e205 thru 0x4b981c1 (0x9fbd bytes) 2019-12-16T22:45:30.472 INFO:teuthology.orchestra.run.smithi177.stdout:984 write 0x36116e3 thru 0x361e7df (0xd0fd bytes) 2019-12-16T22:45:30.498 INFO:teuthology.orchestra.run.smithi177.stdout:788 read 0x1605907 thru 0x1608952 (0x304c bytes) 2019-12-16T22:45:30.499 INFO:teuthology.orchestra.run.smithi177.stdout:789 write 0xa39e850 thru 0xa39fb71 (0x1322 bytes) 2019-12-16T22:45:30.504 INFO:teuthology.orchestra.run.smithi177.stdout:985 punch from 0x3fa01f2 to 0x3faa353, (0xa161 bytes) 2019-12-16T22:45:30.504 INFO:teuthology.orchestra.run.smithi177.stdout:986 write 0x2cd20cd thru 0x2cd6e98 (0x4dcc bytes) 2019-12-16T22:45:30.506 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone5 from 0xb58e5ae (overlap 0xaca0bb) to 0x8a1a2f 2019-12-16T22:45:30.509 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone5 from 0xb3ba38c (overlap 0x27cc3c) to 0x17e0f0 2019-12-16T22:45:30.515 INFO:teuthology.orchestra.run.smithi177.stdout:790 read 0x381fa7e thru 0x3820a28 (0xfab bytes) 2019-12-16T22:45:30.517 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.517 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.548 INFO:teuthology.orchestra.run.smithi177.stdout:794 write 0xd996128 thru 0xd99b39c (0x5275 bytes) 2019-12-16T22:45:30.555 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.555 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.561 INFO:teuthology.orchestra.run.smithi177.stdout:987 write 0x61a62f1 thru 0x61a9672 (0x3382 bytes) 2019-12-16T22:45:30.574 INFO:teuthology.orchestra.run.smithi177.stdout:988 clone 6 order 22 su 524288 sc 14 2019-12-16T22:45:30.575 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone5 from 0x8ff7edf (overlap 0x15f2133) to 0x13c0447 2019-12-16T22:45:30.575 INFO:teuthology.orchestra.run.smithi177.stdout:797 trunc from 0xd99b39d to 0x5527bd9 2019-12-16T22:45:30.591 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone6 from 0xc5e2907 (overlap 0xc5b913) to 0x0 2019-12-16T22:45:30.625 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.679 INFO:teuthology.orchestra.run.smithi177.stdout:799 writesame 0x6537d02 thru 0x654047b data_size 0x1(0x877a bytes) 2019-12-16T22:45:30.680 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #4, image image_cluster1.client.mirror.5-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent5 2019-12-16T22:45:30.682 INFO:teuthology.orchestra.run.smithi177.stdout:800 read 0x17a746d thru 0x17b53ce (0xdf62 bytes) 2019-12-16T22:45:30.685 INFO:teuthology.orchestra.run.smithi177.stdout:801 write 0x3795686 thru 0x37a4fba (0xf935 bytes) 2019-12-16T22:45:30.705 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #4, image image_cluster1.client.mirror.4-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent5 2019-12-16T22:45:30.730 INFO:teuthology.orchestra.run.smithi177.stdout:605 punch from 0x4703c20 to 0x4706f7f, (0x335f bytes) 2019-12-16T22:45:30.733 INFO:teuthology.orchestra.run.smithi177.stdout:804 writesame 0xba6013e thru 0xba6c6e5 data_size 0xc8(0xc5a8 bytes) 2019-12-16T22:45:30.734 INFO:teuthology.orchestra.run.smithi177.stdout:805 writesame 0x622c3db thru 0x62374fe data_size 0x6(0xb124 bytes) 2019-12-16T22:45:30.743 INFO:teuthology.orchestra.run.smithi177.stdout:806 punch from 0x4291def to 0x429e845, (0xca56 bytes) 2019-12-16T22:45:30.743 INFO:teuthology.orchestra.run.smithi177.stdout:807 writesame 0x2e808d0 thru 0x2e822f6 data_size 0xd(0x1a27 bytes) 2019-12-16T22:45:30.744 INFO:teuthology.orchestra.run.smithi177.stdout:606 write 0x1db6e25 thru 0x1dba861 (0x3a3d bytes) 2019-12-16T22:45:30.750 INFO:teuthology.orchestra.run.smithi177.stdout:808 write 0x3b3fdb2 thru 0x3b4db2b (0xdd7a bytes) 2019-12-16T22:45:30.762 INFO:teuthology.orchestra.run.smithi177.stdout:811 read 0x1772619 thru 0x1772a8b (0x473 bytes) 2019-12-16T22:45:30.762 INFO:teuthology.orchestra.run.smithi177.stdout:812 punch from 0x9439322 to 0x943b9fa, (0x26d8 bytes) 2019-12-16T22:45:30.762 INFO:teuthology.orchestra.run.smithi177.stdout:813 write 0xce0c33 thru 0xce1054 (0x422 bytes) 2019-12-16T22:45:30.765 INFO:teuthology.orchestra.run.smithi177.stdout:607 trunc from 0xb58e5ae to 0x7c0502d 2019-12-16T22:45:30.766 INFO:teuthology.orchestra.run.smithi177.stdout:814 read 0x8cab5d thru 0x8d54b4 (0xa958 bytes) 2019-12-16T22:45:30.767 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.767 INFO:teuthology.orchestra.run.smithi177.stdout:819 punch from 0x11df687 to 0x11e06b8, (0x1031 bytes) 2019-12-16T22:45:30.767 INFO:teuthology.orchestra.run.smithi177.stdout:821 writesame 0x85131b3 thru 0x8513555 data_size 0x7(0x3a3 bytes) 2019-12-16T22:45:30.772 INFO:teuthology.orchestra.run.smithi177.stdout:823 punch from 0x858c7f4 to 0x8593fda, (0x77e6 bytes) 2019-12-16T22:45:30.813 INFO:teuthology.orchestra.run.smithi177.stdout:825 write 0xca366a9 thru 0xca3aa63 (0x43bb bytes) 2019-12-16T22:45:30.824 INFO:teuthology.orchestra.run.smithi177.stdout:827 write 0x204a8cf thru 0x20537ae (0x8ee0 bytes) 2019-12-16T22:45:30.840 INFO:teuthology.orchestra.run.smithi177.stdout:828 read 0x2f688b7 thru 0x2f6d730 (0x4e7a bytes) 2019-12-16T22:45:30.841 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.841 INFO:teuthology.orchestra.run.smithi177.stdout:830 write 0xac8b01b thru 0xac98b14 (0xdafa bytes) 2019-12-16T22:45:30.841 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #4, image image_cluster1.client.mirror.2-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent5 2019-12-16T22:45:30.862 INFO:teuthology.orchestra.run.smithi177.stdout:831 write 0xb7d6c56 thru 0xb7d6cf1 (0x9c bytes) 2019-12-16T22:45:30.867 INFO:teuthology.orchestra.run.smithi177.stdout:832 write 0x3496740 thru 0x3499c95 (0x3556 bytes) 2019-12-16T22:45:30.873 INFO:teuthology.orchestra.run.smithi177.stdout:834 read 0x8c521a9 thru 0x8c557e9 (0x3641 bytes) 2019-12-16T22:45:30.873 INFO:teuthology.orchestra.run.smithi177.stdout:835 read 0xc394d2a thru 0xc399a5b (0x4d32 bytes) 2019-12-16T22:45:30.873 INFO:teuthology.orchestra.run.smithi177.stdout:837 read 0xbd68a30 thru 0xbd76b8f (0xe160 bytes) 2019-12-16T22:45:30.873 INFO:teuthology.orchestra.run.smithi177.stdout:610 write 0xb9812a4 thru 0xb982390 (0x10ed bytes) 2019-12-16T22:45:30.874 INFO:teuthology.orchestra.run.smithi177.stdout:839 read 0xc37ae45 thru 0xc37c60e (0x17ca bytes) 2019-12-16T22:45:30.874 INFO:teuthology.orchestra.run.smithi177.stdout:841 writesame 0xbc4a8ae thru 0xbc581d5 data_size 0x4(0xd928 bytes) 2019-12-16T22:45:30.877 INFO:teuthology.orchestra.run.smithi177.stdout:611 read 0x586d4a4 thru 0x587432a (0x6e87 bytes) 2019-12-16T22:45:30.877 INFO:teuthology.orchestra.run.smithi177.stdout:612 writesame 0x70f6529 thru 0x7101164 data_size 0x49(0xac3c bytes) 2019-12-16T22:45:30.879 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #5, image image_cluster1.client.mirror.0-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent6 2019-12-16T22:45:30.884 INFO:teuthology.orchestra.run.smithi177.stdout:613 writesame 0x8e48304 thru 0x8e564a6 data_size 0x1(0xe1a3 bytes) 2019-12-16T22:45:30.888 INFO:teuthology.orchestra.run.smithi177.stdout:843 write 0x820c06 thru 0x823ec4 (0x32bf bytes) 2019-12-16T22:45:30.893 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.893 INFO:teuthology.orchestra.run.smithi177.stdout:845 punch from 0x46a0a57 to 0x46a3cf5, (0x329e bytes) 2019-12-16T22:45:30.893 INFO:teuthology.orchestra.run.smithi177.stdout:846 writesame 0x6ff6f6f thru 0x6ff811f data_size 0x1(0x11b1 bytes) 2019-12-16T22:45:30.904 INFO:teuthology.orchestra.run.smithi177.stdout:244 read 0x3f43faf thru 0x3f48104 (0x4156 bytes) 2019-12-16T22:45:30.922 INFO:teuthology.orchestra.run.smithi177.stdout:847 write 0x7492c87 thru 0x7498818 (0x5b92 bytes) 2019-12-16T22:45:30.934 INFO:teuthology.orchestra.run.smithi177.stdout:615 read 0x2f796d5 thru 0x2f854f9 (0xbe25 bytes) 2019-12-16T22:45:30.934 INFO:teuthology.orchestra.run.smithi177.stdout:616 punch from 0xa7bb11c to 0xa7c6f86, (0xbe6a bytes) 2019-12-16T22:45:30.934 INFO:teuthology.orchestra.run.smithi177.stdout:618 write 0x26ce890 thru 0x26d2fbb (0x472c bytes) 2019-12-16T22:45:30.945 INFO:teuthology.orchestra.run.smithi177.stdout:246 read 0x8fa641f thru 0x8fa85c9 (0x21ab bytes) 2019-12-16T22:45:30.946 INFO:teuthology.orchestra.run.smithi177.stdout:247 read 0x21e4661 thru 0x21e8293 (0x3c33 bytes) 2019-12-16T22:45:30.946 INFO:teuthology.orchestra.run.smithi177.stdout:619 punch from 0x42e037d to 0x42ea58e, (0xa211 bytes) 2019-12-16T22:45:30.946 INFO:teuthology.orchestra.run.smithi177.stdout:620 punch from 0x9dc5b2b to 0x9dc6b83, (0x1058 bytes) 2019-12-16T22:45:30.948 INFO:teuthology.orchestra.run.smithi177.stdout:849 trunc from 0xca3aa64 to 0x6edae19 2019-12-16T22:45:30.962 INFO:teuthology.orchestra.run.smithi177.stdout:249 writesame 0x91baa15 thru 0x91bfa24 data_size 0x30(0x5010 bytes) 2019-12-16T22:45:30.967 INFO:teuthology.orchestra.run.smithi177.stdout:621 trunc from 0xb982391 to 0x927fc3 2019-12-16T22:45:30.969 INFO:teuthology.orchestra.run.smithi177.stdout:250 read 0x58b941e thru 0x58bd3f1 (0x3fd4 bytes) 2019-12-16T22:45:30.970 INFO:teuthology.orchestra.run.smithi177.stdout:251 punch from 0x7c435b4 to 0x7c51d30, (0xe77c bytes) 2019-12-16T22:45:30.970 INFO:teuthology.orchestra.run.smithi177.stdout:253 punch from 0x856c1d5 to 0x8571d5c, (0x5b87 bytes) 2019-12-16T22:45:30.970 INFO:teuthology.orchestra.run.smithi177.stdout:255 read 0x858ba41 thru 0x859013e (0x46fe bytes) 2019-12-16T22:45:30.970 INFO:teuthology.orchestra.run.smithi177.stdout:256 read 0x472b2d5 thru 0x472cffa (0x1d26 bytes) 2019-12-16T22:45:30.971 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:30.971 INFO:teuthology.orchestra.run.smithi177.stdout:258 punch from 0x342c87e to 0x3432362, (0x5ae4 bytes) 2019-12-16T22:45:30.971 INFO:teuthology.orchestra.run.smithi177.stdout:259 read 0x2056478 thru 0x2062c55 (0xc7de bytes) 2019-12-16T22:45:30.971 INFO:teuthology.orchestra.run.smithi177.stdout:260 punch from 0x5372723 to 0x537943a, (0x6d17 bytes) 2019-12-16T22:45:30.971 INFO:teuthology.orchestra.run.smithi177.stdout:261 write 0x598b3f0 thru 0x598b825 (0x436 bytes) 2019-12-16T22:45:30.972 INFO:teuthology.orchestra.run.smithi177.stdout:899 trunc from 0xc5e2907 to 0x2a50f3c 2019-12-16T22:45:30.980 INFO:teuthology.orchestra.run.smithi177.stdout:851 write 0x2eab7d3 thru 0x2eb898c (0xd1ba bytes) 2019-12-16T22:45:30.981 INFO:teuthology.orchestra.run.smithi177.stdout:262 punch from 0x4f19088 to 0x4f1c7d8, (0x3750 bytes) 2019-12-16T22:45:30.982 INFO:teuthology.orchestra.run.smithi177.stdout:263 write 0x4eeb550 thru 0x4ef7c1b (0xc6cc bytes) 2019-12-16T22:45:30.995 INFO:teuthology.orchestra.run.smithi177.stdout:852 write 0x59857c9 thru 0x598de71 (0x86a9 bytes) 2019-12-16T22:45:31.021 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.043 INFO:teuthology.orchestra.run.smithi177.stdout:264 writesame 0xac310ce thru 0xac32aa1 data_size 0x4(0x19d4 bytes) 2019-12-16T22:45:31.054 INFO:teuthology.orchestra.run.smithi177.stdout:854 write 0xab42b59 thru 0xab44433 (0x18db bytes) 2019-12-16T22:45:31.066 INFO:teuthology.orchestra.run.smithi177.stdout:855 write 0x3aa00de thru 0x3aa617b (0x609e bytes) 2019-12-16T22:45:31.067 INFO:teuthology.orchestra.run.smithi177.stdout:901 read 0xa075f6 thru 0xa082a1 (0xcac bytes) 2019-12-16T22:45:31.068 INFO:teuthology.orchestra.run.smithi177.stdout:903 read 0x547ec8 thru 0x556e2b (0xef64 bytes) 2019-12-16T22:45:31.071 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.073 INFO:teuthology.orchestra.run.smithi177.stdout:646 read 0x6642217 thru 0x664e53a (0xc324 bytes) 2019-12-16T22:45:31.075 INFO:teuthology.orchestra.run.smithi177.stdout:856 read 0x184f91a thru 0x185caa6 (0xd18d bytes) 2019-12-16T22:45:31.077 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.077 INFO:teuthology.orchestra.run.smithi177.stdout:858 write 0x2ac9c34 thru 0x2ad2f7f (0x934c bytes) 2019-12-16T22:45:31.077 INFO:teuthology.orchestra.run.smithi177.stdout:265 write 0xbc9b9b8 thru 0xbc9f21b (0x3864 bytes) 2019-12-16T22:45:31.085 INFO:teuthology.orchestra.run.smithi177.stdout:859 punch from 0x9493994 to 0x9499bee, (0x625a bytes) 2019-12-16T22:45:31.086 INFO:teuthology.orchestra.run.smithi177.stdout:860 writesame 0x287abcd thru 0x287ca11 data_size 0x29(0x1e45 bytes) 2019-12-16T22:45:31.090 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.090 INFO:teuthology.orchestra.run.smithi177.stdout:650 read 0x292355 thru 0x297457 (0x5103 bytes) 2019-12-16T22:45:31.091 INFO:teuthology.orchestra.run.smithi177.stdout:266 read 0x425ce06 thru 0x4263bdd (0x6dd8 bytes) 2019-12-16T22:45:31.092 INFO:teuthology.orchestra.run.smithi177.stdout:267 punch from 0xa5a9248 to 0xa5b38c8, (0xa680 bytes) 2019-12-16T22:45:31.092 INFO:teuthology.orchestra.run.smithi177.stdout:268 clone 7 order 25 su 2097152 sc 14 2019-12-16T22:45:31.093 INFO:teuthology.orchestra.run.smithi177.stdout:861 read 0x101bbe3 thru 0x102a98e (0xedac bytes) 2019-12-16T22:45:31.094 INFO:teuthology.orchestra.run.smithi177.stdout:863 writesame 0x8ac12f1 thru 0x8ac4439 data_size 0x25(0x3149 bytes) 2019-12-16T22:45:31.100 INFO:teuthology.orchestra.run.smithi177.stdout:904 write 0x3d89b83 thru 0x3d98f21 (0xf39f bytes) 2019-12-16T22:45:31.109 INFO:teuthology.orchestra.run.smithi177.stdout:864 trunc from 0xab44434 to 0xa395e72 2019-12-16T22:45:31.109 INFO:teuthology.orchestra.run.smithi177.stdout:651 trunc from 0xb3ba38c to 0x2bb9883 2019-12-16T22:45:31.112 INFO:teuthology.orchestra.run.smithi177.stdout:623 writesame 0x9d14e1f thru 0x9d1ae66 data_size 0x68(0x6048 bytes) 2019-12-16T22:45:31.112 INFO:teuthology.orchestra.run.smithi177.stdout:907 read 0x36bb3b7 thru 0x36c6a80 (0xb6ca bytes) 2019-12-16T22:45:31.112 INFO:teuthology.orchestra.run.smithi177.stdout:908 punch from 0x33c5133 to 0x33cb589, (0x6456 bytes) 2019-12-16T22:45:31.116 INFO:teuthology.orchestra.run.smithi177.stdout:624 read 0x3904f90 thru 0x3908a0a (0x3a7b bytes) 2019-12-16T22:45:31.117 INFO:teuthology.orchestra.run.smithi177.stdout:625 writesame 0x8c04b91 thru 0x8c0a815 data_size 0x5(0x5c85 bytes) 2019-12-16T22:45:31.127 INFO:teuthology.orchestra.run.smithi177.stdout:909 trunc from 0x3d98f22 to 0xe0d78c2 2019-12-16T22:45:31.133 INFO:teuthology.orchestra.run.smithi177.stdout:865 punch from 0x81566e3 to 0x8162c8f, (0xc5ac bytes) 2019-12-16T22:45:31.145 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.145 INFO:teuthology.orchestra.run.smithi177.stdout:911 write 0x703edcb thru 0x70430e3 (0x4319 bytes) 2019-12-16T22:45:31.145 INFO:teuthology.orchestra.run.smithi177.stdout:626 writesame 0xb97abac thru 0xb980e23 data_size 0x2e(0x6278 bytes) 2019-12-16T22:45:31.152 INFO:teuthology.orchestra.run.smithi177.stdout:912 punch from 0x7f3fe36 to 0x7f474d0, (0x769a bytes) 2019-12-16T22:45:31.152 INFO:teuthology.orchestra.run.smithi177.stdout:913 writesame 0x5130a86 thru 0x5137098 data_size 0x1(0x6613 bytes) 2019-12-16T22:45:31.153 INFO:teuthology.orchestra.run.smithi177.stdout:866 write 0xcf7020e thru 0xcf7bdd6 (0xbbc9 bytes) 2019-12-16T22:45:31.164 INFO:teuthology.orchestra.run.smithi177.stdout:652 write 0x63f47b3 thru 0x63fdc01 (0x944f bytes) 2019-12-16T22:45:31.179 INFO:teuthology.orchestra.run.smithi177.stdout:867 write 0xc47c9ef thru 0xc4804f6 (0x3b08 bytes) 2019-12-16T22:45:31.179 INFO:teuthology.orchestra.run.smithi177.stdout:914 punch from 0x2615567 to 0x261ff9b, (0xaa34 bytes) 2019-12-16T22:45:31.181 INFO:teuthology.orchestra.run.smithi177.stdout:627 write 0xd1e1b3b thru 0xd1f08e2 (0xeda8 bytes) 2019-12-16T22:45:31.186 INFO:teuthology.orchestra.run.smithi177.stdout:654 trunc from 0x63fdc02 to 0xef3b2a 2019-12-16T22:45:31.191 INFO:teuthology.orchestra.run.smithi177.stdout:630 trunc from 0xd1f08e3 to 0xcc7c28f 2019-12-16T22:45:31.201 INFO:teuthology.orchestra.run.smithi177.stdout:916 trunc from 0xe0d78c2 to 0x38384aa 2019-12-16T22:45:31.217 INFO:teuthology.orchestra.run.smithi177.stdout:868 write 0xe64bac7 thru 0xe64c60c (0xb46 bytes) 2019-12-16T22:45:31.229 INFO:teuthology.orchestra.run.smithi177.stdout:869 read 0xaea979b thru 0xaeacbce (0x3434 bytes) 2019-12-16T22:45:31.229 INFO:teuthology.orchestra.run.smithi177.stdout:870 punch from 0xe167a96 to 0xe1750d1, (0xd63b bytes) 2019-12-16T22:45:31.231 INFO:teuthology.orchestra.run.smithi177.stdout:631 write 0x1c1e6b3 thru 0x1c28a36 (0xa384 bytes) 2019-12-16T22:45:31.237 INFO:teuthology.orchestra.run.smithi177.stdout:632 write 0x1d9fed3 thru 0x1da0987 (0xab5 bytes) 2019-12-16T22:45:31.241 INFO:teuthology.orchestra.run.smithi177.stdout:634 read 0x1a23f83 thru 0x1a2bc63 (0x7ce1 bytes) 2019-12-16T22:45:31.247 INFO:teuthology.orchestra.run.smithi177.stdout:917 write 0x1e14678 thru 0x1e1d374 (0x8cfd bytes) 2019-12-16T22:45:31.253 INFO:teuthology.orchestra.run.smithi177.stdout:871 trunc from 0xe64c60d to 0x197db59 2019-12-16T22:45:31.260 INFO:teuthology.orchestra.run.smithi177.stdout:918 trunc from 0x38384aa to 0x6fec747 2019-12-16T22:45:31.271 INFO:teuthology.orchestra.run.smithi177.stdout:635 write 0xdb1f269 thru 0xdb2a20e (0xafa6 bytes) 2019-12-16T22:45:31.276 INFO:teuthology.orchestra.run.smithi177.stdout:655 writesame 0x4272fe7 thru 0x427b606 data_size 0x74(0x8620 bytes) 2019-12-16T22:45:31.281 INFO:teuthology.orchestra.run.smithi177.stdout:656 read 0x23652a2 thru 0x236c808 (0x7567 bytes) 2019-12-16T22:45:31.282 INFO:teuthology.orchestra.run.smithi177.stdout:636 read 0x2196416 thru 0x21a459e (0xe189 bytes) 2019-12-16T22:45:31.283 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.283 INFO:teuthology.orchestra.run.smithi177.stdout:639 read 0x5fbbf80 thru 0x5fbfcdf (0x3d60 bytes) 2019-12-16T22:45:31.284 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.284 INFO:teuthology.orchestra.run.smithi177.stdout:641 punch from 0x5400a6c to 0x540c90f, (0xbea3 bytes) 2019-12-16T22:45:31.284 INFO:teuthology.orchestra.run.smithi177.stdout:642 read 0x83ab3f7 thru 0x83b8c65 (0xd86f bytes) 2019-12-16T22:45:31.285 INFO:teuthology.orchestra.run.smithi177.stdout:643 read 0xadf4c71 thru 0xadf4c71 (0x1 bytes) 2019-12-16T22:45:31.285 INFO:teuthology.orchestra.run.smithi177.stdout:644 punch from 0x8eb81d3 to 0x8eba4d5, (0x2302 bytes) 2019-12-16T22:45:31.285 INFO:teuthology.orchestra.run.smithi177.stdout:645 read 0xc550fb6 thru 0xc55ad08 (0x9d53 bytes) 2019-12-16T22:45:31.285 INFO:teuthology.orchestra.run.smithi177.stdout:648 read 0x23fd651 thru 0x23ffd50 (0x2700 bytes) 2019-12-16T22:45:31.285 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.286 INFO:teuthology.orchestra.run.smithi177.stdout:650 read 0x8f98ddd thru 0x8fa17f4 (0x8a18 bytes) 2019-12-16T22:45:31.286 INFO:teuthology.orchestra.run.smithi177.stdout:651 writesame 0x304d2f2 thru 0x304ec89 data_size 0x1c(0x1998 bytes) 2019-12-16T22:45:31.289 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.289 INFO:teuthology.orchestra.run.smithi177.stdout:920 punch from 0x245ae9b to 0x24635a0, (0x8705 bytes) 2019-12-16T22:45:31.290 INFO:teuthology.orchestra.run.smithi177.stdout:652 read 0x96b23d6 thru 0x96b75d8 (0x5203 bytes) 2019-12-16T22:45:31.290 INFO:teuthology.orchestra.run.smithi177.stdout:653 writesame 0xda825bf thru 0xda89417 data_size 0x29(0x6e59 bytes) 2019-12-16T22:45:31.295 INFO:teuthology.orchestra.run.smithi177.stdout:654 read 0x2c0f64c thru 0x2c190c4 (0x9a79 bytes) 2019-12-16T22:45:31.296 INFO:teuthology.orchestra.run.smithi177.stdout:655 write 0x5858540 thru 0x585e059 (0x5b1a bytes) 2019-12-16T22:45:31.296 INFO:teuthology.orchestra.run.smithi177.stdout:872 trunc from 0x197db59 to 0x1bcb8ca 2019-12-16T22:45:31.301 INFO:teuthology.orchestra.run.smithi177.stdout:657 trunc from 0x427b607 to 0xc08cfae 2019-12-16T22:45:31.303 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.303 INFO:teuthology.orchestra.run.smithi177.stdout:657 punch from 0x809a14e to 0x80a5ce1, (0xbb93 bytes) 2019-12-16T22:45:31.304 INFO:teuthology.orchestra.run.smithi177.stdout:658 writesame 0xb8032ce thru 0xb810d9d data_size 0x48(0xdad0 bytes) 2019-12-16T22:45:31.311 INFO:teuthology.orchestra.run.smithi177.stdout:659 read 0x8fb24bf thru 0x8fb5969 (0x34ab bytes) 2019-12-16T22:45:31.312 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.312 INFO:teuthology.orchestra.run.smithi177.stdout:661 write 0xe6e57d thru 0xe767fd (0x8281 bytes) 2019-12-16T22:45:31.317 INFO:teuthology.orchestra.run.smithi177.stdout:662 punch from 0x4b4f824 to 0x4b523d7, (0x2bb3 bytes) 2019-12-16T22:45:31.317 INFO:teuthology.orchestra.run.smithi177.stdout:873 read 0xf9a7b5 thru 0xfa7a73 (0xd2bf bytes) 2019-12-16T22:45:31.321 INFO:teuthology.orchestra.run.smithi177.stdout:874 clone 7 order 21 su 65536 sc 3 2019-12-16T22:45:31.321 INFO:teuthology.orchestra.run.smithi177.stdout:921 write 0xa22e5d8 thru 0xa22f4da (0xf03 bytes) 2019-12-16T22:45:31.327 INFO:teuthology.orchestra.run.smithi177.stdout:658 read 0x4d2074d thru 0x4d25b8c (0x5440 bytes) 2019-12-16T22:45:31.327 INFO:teuthology.orchestra.run.smithi177.stdout:659 read 0x78a5615 thru 0x78b02d2 (0xacbe bytes) 2019-12-16T22:45:31.327 INFO:teuthology.orchestra.run.smithi177.stdout:662 read 0x4596379 thru 0x45a3c15 (0xd89d bytes) 2019-12-16T22:45:31.328 INFO:teuthology.orchestra.run.smithi177.stdout:663 write 0x5152e7 thru 0x5157bf (0x4d9 bytes) 2019-12-16T22:45:31.328 INFO:teuthology.orchestra.run.smithi177.stdout:923 write 0x1769698 thru 0x176ba20 (0x2389 bytes) 2019-12-16T22:45:31.328 INFO:teuthology.orchestra.run.smithi177.stdout:664 clone 7 order 23 su 131072 sc 8 2019-12-16T22:45:31.350 INFO:teuthology.orchestra.run.smithi177.stdout:664 write 0xe5bda16 thru 0xe5c8ccb (0xb2b6 bytes) 2019-12-16T22:45:31.351 INFO:teuthology.orchestra.run.smithi177.stdout:924 read 0x6094c5 thru 0x619105 (0xfc41 bytes) 2019-12-16T22:45:31.351 INFO:teuthology.orchestra.run.smithi177.stdout:925 read 0x3b68047 thru 0x3b70ab7 (0x8a71 bytes) 2019-12-16T22:45:31.379 INFO:teuthology.orchestra.run.smithi177.stdout:926 writesame 0xaba4e63 thru 0xabaaa0b data_size 0x13(0x5ba9 bytes) 2019-12-16T22:45:31.381 INFO:teuthology.orchestra.run.smithi177.stdout:928 write 0x2ebca7c thru 0x2ec375a (0x6cdf bytes) 2019-12-16T22:45:31.399 INFO:teuthology.orchestra.run.smithi177.stdout:665 writesame 0xebd2558 thru 0xebdf8e2 data_size 0x1(0xd38b bytes) 2019-12-16T22:45:31.399 INFO:teuthology.orchestra.run.smithi177.stdout:666 punch from 0x3281a9f to 0x3286036, (0x4597 bytes) 2019-12-16T22:45:31.399 INFO:teuthology.orchestra.run.smithi177.stdout:667 write 0x5976973 thru 0x597713c (0x7ca bytes) 2019-12-16T22:45:31.399 INFO:teuthology.orchestra.run.smithi177.stdout:668 write 0xc9356f4 thru 0xc944105 (0xea12 bytes) 2019-12-16T22:45:31.400 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.400 INFO:teuthology.orchestra.run.smithi177.stdout:930 punch from 0x9155f34 to 0x915d069, (0x7135 bytes) 2019-12-16T22:45:31.400 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.400 INFO:teuthology.orchestra.run.smithi177.stdout:933 write 0x655669c thru 0x65625a4 (0xbf09 bytes) 2019-12-16T22:45:31.400 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.400 INFO:teuthology.orchestra.run.smithi177.stdout:940 writesame 0x862dd2d thru 0x8633eee data_size 0x6(0x61c2 bytes) 2019-12-16T22:45:31.410 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.410 INFO:teuthology.orchestra.run.smithi177.stdout:670 punch from 0x97ac5a6 to 0x97b571c, (0x9176 bytes) 2019-12-16T22:45:31.410 INFO:teuthology.orchestra.run.smithi177.stdout:671 read 0xa4e0634 thru 0xa4ed2b1 (0xcc7e bytes) 2019-12-16T22:45:31.411 INFO:teuthology.orchestra.run.smithi177.stdout:672 read 0xa09c639 thru 0xa0a41e5 (0x7bad bytes) 2019-12-16T22:45:31.411 INFO:teuthology.orchestra.run.smithi177.stdout:673 write 0x40b449b thru 0x40bf6ab (0xb211 bytes) 2019-12-16T22:45:31.417 INFO:teuthology.orchestra.run.smithi177.stdout:674 punch from 0x287e65a to 0x288c222, (0xdbc8 bytes) 2019-12-16T22:45:31.417 INFO:teuthology.orchestra.run.smithi177.stdout:675 write 0x69bbd64 thru 0x69ca141 (0xe3de bytes) 2019-12-16T22:45:31.436 INFO:teuthology.orchestra.run.smithi177.stdout:941 writesame 0xb254b41 thru 0xb25da99 data_size 0x1(0x8f59 bytes) 2019-12-16T22:45:31.437 INFO:teuthology.orchestra.run.smithi177.stdout:942 write 0x1846140 thru 0x1846dfc (0xcbd bytes) 2019-12-16T22:45:31.438 INFO:teuthology.orchestra.run.smithi177.stdout:678 trunc from 0xebdf8e3 to 0xbffb7c4 2019-12-16T22:45:31.460 INFO:teuthology.orchestra.run.smithi177.stdout:943 write 0x9177fe9 thru 0x917ea6e (0x6a86 bytes) 2019-12-16T22:45:31.470 INFO:teuthology.orchestra.run.smithi177.stdout:944 read 0x7724dc3 thru 0x773234a (0xd588 bytes) 2019-12-16T22:45:31.471 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.471 INFO:teuthology.orchestra.run.smithi177.stdout:947 read 0x56902f9 thru 0x569c542 (0xc24a bytes) 2019-12-16T22:45:31.471 INFO:teuthology.orchestra.run.smithi177.stdout:948 read 0x3fedead thru 0x3ffb5d4 (0xd728 bytes) 2019-12-16T22:45:31.471 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.476 INFO:teuthology.orchestra.run.smithi177.stdout:680 writesame 0x1114550 thru 0x1120213 data_size 0x6(0xbcc4 bytes) 2019-12-16T22:45:31.485 INFO:teuthology.orchestra.run.smithi177.stdout:682 writesame 0x733378b thru 0x73349e6 data_size 0x2f(0x125c bytes) 2019-12-16T22:45:31.486 INFO:teuthology.orchestra.run.smithi177.stdout:952 trunc from 0xb25da9a to 0x37decaf 2019-12-16T22:45:31.516 INFO:teuthology.orchestra.run.smithi177.stdout:683 write 0xd3074e8 thru 0xd307d98 (0x8b1 bytes) 2019-12-16T22:45:31.516 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.517 INFO:teuthology.orchestra.run.smithi177.stdout:954 read 0x9062b thru 0x9dc2c (0xd602 bytes) 2019-12-16T22:45:31.520 INFO:teuthology.orchestra.run.smithi177.stdout:955 read 0x355cecc thru 0x35622a9 (0x53de bytes) 2019-12-16T22:45:31.521 INFO:teuthology.orchestra.run.smithi177.stdout:956 read 0x14744b5 thru 0x1477639 (0x3185 bytes) 2019-12-16T22:45:31.521 INFO:teuthology.orchestra.run.smithi177.stdout:958 writesame 0x2e3c0d2 thru 0x2e3fb5a data_size 0xf(0x3a89 bytes) 2019-12-16T22:45:31.522 INFO:teuthology.orchestra.run.smithi177.stdout:684 punch from 0x59a18e0 to 0x59a63b4, (0x4ad4 bytes) 2019-12-16T22:45:31.529 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone5 from 0x61a9673 (overlap 0xa85783) to 0x0 2019-12-16T22:45:31.533 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone6 from 0xbc9f21c (overlap 0x8ff7edf) to 0x0 2019-12-16T22:45:31.535 INFO:teuthology.orchestra.run.smithi177.stdout:685 trunc from 0xd307d99 to 0x6370d0d 2019-12-16T22:45:31.547 INFO:teuthology.orchestra.run.smithi177.stdout:959 trunc from 0x37decaf to 0xd8277b5 2019-12-16T22:45:31.574 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #5, image image_cluster1.client.mirror.3-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent6 2019-12-16T22:45:31.655 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.656 INFO:teuthology.orchestra.run.smithi177.stdout:964 write 0x21f1920 thru 0x21f5c74 (0x4355 bytes) 2019-12-16T22:45:31.682 INFO:teuthology.orchestra.run.smithi177.stdout:965 write 0x2f58de1 thru 0x2f59998 (0xbb8 bytes) 2019-12-16T22:45:31.688 INFO:teuthology.orchestra.run.smithi177.stdout:966 read 0xc585873 thru 0xc5943fd (0xeb8b bytes) 2019-12-16T22:45:31.688 INFO:teuthology.orchestra.run.smithi177.stdout:967 write 0x11a218f thru 0x11a33cd (0x123f bytes) 2019-12-16T22:45:31.703 INFO:teuthology.orchestra.run.smithi177.stdout:687 clone 7 order 20 su 32768 sc 12 2019-12-16T22:45:31.723 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.723 INFO:teuthology.orchestra.run.smithi177.stdout:969 read 0xa905d7b thru 0xa907cb9 (0x1f3f bytes) 2019-12-16T22:45:31.723 INFO:teuthology.orchestra.run.smithi177.stdout:972 writesame 0x8d70ae7 thru 0x8d7fa86 data_size 0x90(0xefa0 bytes) 2019-12-16T22:45:31.729 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.729 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.729 INFO:teuthology.orchestra.run.smithi177.stdout:976 read 0x68978f9 thru 0x68a14a7 (0x9baf bytes) 2019-12-16T22:45:31.729 INFO:teuthology.orchestra.run.smithi177.stdout:977 writesame 0x79d793d thru 0x79d7efd data_size 0x1(0x5c1 bytes) 2019-12-16T22:45:31.733 INFO:teuthology.orchestra.run.smithi177.stdout:875 write 0x99a5fe3 thru 0x99b3198 (0xd1b6 bytes) 2019-12-16T22:45:31.736 INFO:teuthology.orchestra.run.smithi177.stdout:978 read 0x7afeb06 thru 0x7b093e4 (0xa8df bytes) 2019-12-16T22:45:31.737 INFO:teuthology.orchestra.run.smithi177.stdout:979 punch from 0xd06ca09 to 0xd07c747, (0xfd3e bytes) 2019-12-16T22:45:31.737 INFO:teuthology.orchestra.run.smithi177.stdout:980 write 0x2b5765c thru 0x2b65ec8 (0xe86d bytes) 2019-12-16T22:45:31.749 INFO:teuthology.orchestra.run.smithi177.stdout:981 read 0x9d90cfa thru 0x9d9f748 (0xea4f bytes) 2019-12-16T22:45:31.749 INFO:teuthology.orchestra.run.smithi177.stdout:982 read 0x9204ab7 thru 0x92123bb (0xd905 bytes) 2019-12-16T22:45:31.749 INFO:teuthology.orchestra.run.smithi177.stdout:983 read 0x8864ef7 thru 0x88671ec (0x22f6 bytes) 2019-12-16T22:45:31.749 INFO:teuthology.orchestra.run.smithi177.stdout:984 write 0x54ea235 thru 0x54f742b (0xd1f7 bytes) 2019-12-16T22:45:31.754 INFO:teuthology.orchestra.run.smithi177.stdout:877 write 0x692adb0 thru 0x692d66f (0x28c0 bytes) 2019-12-16T22:45:31.759 INFO:teuthology.orchestra.run.smithi177.stdout:985 write 0x8d0464d thru 0x8d06a56 (0x240a bytes) 2019-12-16T22:45:31.760 INFO:teuthology.orchestra.run.smithi177.stdout:878 write 0x77c1199 thru 0x77ca18c (0x8ff4 bytes) 2019-12-16T22:45:31.763 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.763 INFO:teuthology.orchestra.run.smithi177.stdout:989 read 0x20342b6 thru 0x2042fe3 (0xed2e bytes) 2019-12-16T22:45:31.764 INFO:teuthology.orchestra.run.smithi177.stdout:990 read 0x614c214 thru 0x615174a (0x5537 bytes) 2019-12-16T22:45:31.764 INFO:teuthology.orchestra.run.smithi177.stdout:992 punch from 0x65318ad to 0x653f330, (0xda83 bytes) 2019-12-16T22:45:31.765 INFO:teuthology.orchestra.run.smithi177.stdout:994 writesame 0xa551a43 thru 0xa55233c data_size 0x3(0x8fa bytes) 2019-12-16T22:45:31.770 INFO:teuthology.orchestra.run.smithi177.stdout:997 punch from 0x7bc060 to 0x7c7f26, (0xbec6 bytes) 2019-12-16T22:45:31.770 INFO:teuthology.orchestra.run.smithi177.stdout:998 write 0x5663478 thru 0x5666b22 (0x36ab bytes) 2019-12-16T22:45:31.776 INFO:teuthology.orchestra.run.smithi177.stdout:1000 write 0x3f8e877 thru 0x3f9b8f4 (0xd07e bytes) 2019-12-16T22:45:31.777 INFO:teuthology.orchestra.run.smithi177.stdout:879 trunc from 0x99b3199 to 0xde3a528 2019-12-16T22:45:31.783 INFO:teuthology.orchestra.run.smithi177.stdout:1003 write 0x60164d thru 0x60bea2 (0xa856 bytes) 2019-12-16T22:45:31.799 INFO:teuthology.orchestra.run.smithi177.stdout:880 punch from 0x11cdf7b to 0x11cf0b5, (0x113a bytes) 2019-12-16T22:45:31.799 INFO:teuthology.orchestra.run.smithi177.stdout:882 writesame 0x2faeaf1 thru 0x2fb95b0 data_size 0x20(0xaac0 bytes) 2019-12-16T22:45:31.809 INFO:teuthology.orchestra.run.smithi177.stdout:1004 writesame 0x9f64f73 thru 0x9f7140f data_size 0x1(0xc49d bytes) 2019-12-16T22:45:31.850 INFO:teuthology.orchestra.run.smithi177.stdout:1006 punch from 0xb7e287e to 0xb7e64c4, (0x3c46 bytes) 2019-12-16T22:45:31.850 INFO:teuthology.orchestra.run.smithi177.stdout:1009 read 0xc7bb37e thru 0xc7c4bb7 (0x983a bytes) 2019-12-16T22:45:31.850 INFO:teuthology.orchestra.run.smithi177.stdout:1011 write 0x4ca3fd4 thru 0x4ca6bd8 (0x2c05 bytes) 2019-12-16T22:45:31.856 INFO:teuthology.orchestra.run.smithi177.stdout:1013 write 0x5df8993 thru 0x5dfcb96 (0x4204 bytes) 2019-12-16T22:45:31.860 INFO:teuthology.orchestra.run.smithi177.stdout:883 write 0xe6fc06c thru 0xe702d55 (0x6cea bytes) 2019-12-16T22:45:31.869 INFO:teuthology.orchestra.run.smithi177.stdout:1015 punch from 0x8f4f2f5 to 0x8f5175d, (0x2468 bytes) 2019-12-16T22:45:31.869 INFO:teuthology.orchestra.run.smithi177.stdout:1016 read 0x9c4520 thru 0x9cad4b (0x682c bytes) 2019-12-16T22:45:31.869 INFO:teuthology.orchestra.run.smithi177.stdout:1017 write 0xad8993b thru 0xad8c244 (0x290a bytes) 2019-12-16T22:45:31.888 INFO:teuthology.orchestra.run.smithi177.stdout:884 trunc from 0xe702d56 to 0x5523039 2019-12-16T22:45:31.888 INFO:teuthology.orchestra.run.smithi177.stdout:1018 trunc from 0xd8277b5 to 0x606b833 2019-12-16T22:45:31.907 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #4, image image_cluster1.client.mirror.1-clone4 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent5 2019-12-16T22:45:31.918 INFO:teuthology.orchestra.run.smithi177.stdout:1019 write 0x2774614 thru 0x2781aae (0xd49b bytes) 2019-12-16T22:45:31.920 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #5, image image_cluster1.client.mirror.2-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent6 2019-12-16T22:45:31.929 INFO:teuthology.orchestra.run.smithi177.stdout:1020 read 0x3c9ce24 thru 0x3ca3c88 (0x6e65 bytes) 2019-12-16T22:45:31.938 INFO:teuthology.orchestra.run.smithi177.stdout:885 write 0x7d86431 thru 0x7d9357b (0xd14b bytes) 2019-12-16T22:45:31.945 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.945 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:31.950 INFO:teuthology.orchestra.run.smithi177.stdout:887 write 0xa5568e thru 0xa6075a (0xb0cd bytes) 2019-12-16T22:45:31.972 INFO:teuthology.orchestra.run.smithi177.stdout:1021 write 0xce0d909 thru 0xce16403 (0x8afb bytes) 2019-12-16T22:45:31.992 INFO:teuthology.orchestra.run.smithi177.stdout:1022 punch from 0x72316f6 to 0x723f460, (0xdd6a bytes) 2019-12-16T22:45:31.994 INFO:teuthology.orchestra.run.smithi177.stdout:269 write 0x7efde72 thru 0x7f001be (0x234d bytes) 2019-12-16T22:45:32.001 INFO:teuthology.orchestra.run.smithi177.stdout:1023 trunc from 0xce16404 to 0x69b2a40 2019-12-16T22:45:32.002 INFO:teuthology.orchestra.run.smithi177.stdout:888 read 0x6abba3a thru 0x6ac937f (0xd946 bytes) 2019-12-16T22:45:32.003 INFO:teuthology.orchestra.run.smithi177.stdout:889 write 0x1122620 thru 0x112b4ae (0x8e8f bytes) 2019-12-16T22:45:32.006 INFO:teuthology.orchestra.run.smithi177.stdout:992 writesame 0xdf88f7b thru 0xdf89afc data_size 0x3(0xb82 bytes) 2019-12-16T22:45:32.009 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.028 INFO:teuthology.orchestra.run.smithi177.stdout:890 trunc from 0x7d9357c to 0x79f302b 2019-12-16T22:45:32.035 INFO:teuthology.orchestra.run.smithi177.stdout:1025 read 0x25e9928 thru 0x25f82f0 (0xe9c9 bytes) 2019-12-16T22:45:32.035 INFO:teuthology.orchestra.run.smithi177.stdout:1026 punch from 0x182df52 to 0x183be8a, (0xdf38 bytes) 2019-12-16T22:45:32.036 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.037 INFO:teuthology.orchestra.run.smithi177.stdout:994 write 0xe8c0d51 thru 0xe8cc776 (0xba26 bytes) 2019-12-16T22:45:32.038 INFO:teuthology.orchestra.run.smithi177.stdout:1029 trunc from 0x69b2a40 to 0x7969754 2019-12-16T22:45:32.039 INFO:teuthology.orchestra.run.smithi177.stdout:271 read 0x236f4f4 thru 0x2374c00 (0x570d bytes) 2019-12-16T22:45:32.046 INFO:teuthology.orchestra.run.smithi177.stdout:272 trunc from 0xbc9f21c to 0x8c06ed5 2019-12-16T22:45:32.054 INFO:teuthology.orchestra.run.smithi177.stdout:892 read 0x6021837 thru 0x6030683 (0xee4d bytes) 2019-12-16T22:45:32.054 INFO:teuthology.orchestra.run.smithi177.stdout:893 punch from 0x2b32d to 0x31d74, (0x6a47 bytes) 2019-12-16T22:45:32.055 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.055 INFO:teuthology.orchestra.run.smithi177.stdout:897 read 0x6c86ec2 thru 0x6c8a9f3 (0x3b32 bytes) 2019-12-16T22:45:32.055 INFO:teuthology.orchestra.run.smithi177.stdout:898 punch from 0x2bceb16 to 0x2bd55e7, (0x6ad1 bytes) 2019-12-16T22:45:32.058 INFO:teuthology.orchestra.run.smithi177.stdout:1031 write 0x5a32245 thru 0x5a37bc5 (0x5981 bytes) 2019-12-16T22:45:32.059 INFO:teuthology.orchestra.run.smithi177.stdout:995 trunc from 0xe8cc777 to 0x9256b29 2019-12-16T22:45:32.063 INFO:teuthology.orchestra.run.smithi177.stdout:1032 read 0x3371c9e thru 0x337904d (0x73b0 bytes) 2019-12-16T22:45:32.064 INFO:teuthology.orchestra.run.smithi177.stdout:1033 read 0x53ca04f thru 0x53cfe25 (0x5dd7 bytes) 2019-12-16T22:45:32.064 INFO:teuthology.orchestra.run.smithi177.stdout:899 trunc from 0x79f302b to 0x301b4f0 2019-12-16T22:45:32.065 INFO:teuthology.orchestra.run.smithi177.stdout:1035 write 0x27c1df4 thru 0x27c9d4a (0x7f57 bytes) 2019-12-16T22:45:32.079 INFO:teuthology.orchestra.run.smithi177.stdout:1036 trunc from 0x7969754 to 0x2594850 2019-12-16T22:45:32.110 INFO:teuthology.orchestra.run.smithi177.stdout:997 write 0x46584b2 thru 0x46626de (0xa22d bytes) 2019-12-16T22:45:32.111 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.112 INFO:teuthology.orchestra.run.smithi177.stdout:901 read 0x1a88310 thru 0x1a92320 (0xa011 bytes) 2019-12-16T22:45:32.121 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.167 INFO:teuthology.orchestra.run.smithi177.stdout:998 writesame 0x90b2379 thru 0x90b5488 data_size 0x28(0x3110 bytes) 2019-12-16T22:45:32.175 INFO:teuthology.orchestra.run.smithi177.stdout:999 writesame 0x54e272f thru 0x54e4afa data_size 0x1d(0x23cc bytes) 2019-12-16T22:45:32.178 INFO:teuthology.orchestra.run.smithi177.stdout:904 write 0xe038837 thru 0xe0466cb (0xde95 bytes) 2019-12-16T22:45:32.185 INFO:teuthology.orchestra.run.smithi177.stdout:274 punch from 0x1ef531a to 0x1f0520f, (0xfef5 bytes) 2019-12-16T22:45:32.186 INFO:teuthology.orchestra.run.smithi177.stdout:1000 writesame 0x44e1cc3 thru 0x44ec9cb data_size 0x1(0xad09 bytes) 2019-12-16T22:45:32.190 INFO:teuthology.orchestra.run.smithi177.stdout:905 writesame 0x622cd46 thru 0x622e04d data_size 0x1d(0x1308 bytes) 2019-12-16T22:45:32.196 INFO:teuthology.orchestra.run.smithi177.stdout:906 read 0xc53c440 thru 0xc543247 (0x6e08 bytes) 2019-12-16T22:45:32.196 INFO:teuthology.orchestra.run.smithi177.stdout:907 read 0xc79a93c thru 0xc79ed3a (0x43ff bytes) 2019-12-16T22:45:32.197 INFO:teuthology.orchestra.run.smithi177.stdout:908 read 0x2eb4506 thru 0x2eb6356 (0x1e51 bytes) 2019-12-16T22:45:32.197 INFO:teuthology.orchestra.run.smithi177.stdout:910 write 0x11b6a86 thru 0x11bf348 (0x88c3 bytes) 2019-12-16T22:45:32.210 INFO:teuthology.orchestra.run.smithi177.stdout:911 write 0x361e02c thru 0x362d055 (0xf02a bytes) 2019-12-16T22:45:32.222 INFO:teuthology.orchestra.run.smithi177.stdout:276 write 0xc22db0d thru 0xc231b93 (0x4087 bytes) 2019-12-16T22:45:32.227 INFO:teuthology.orchestra.run.smithi177.stdout:278 punch from 0x7bd7f6b to 0x7be1c36, (0x9ccb bytes) 2019-12-16T22:45:32.227 INFO:teuthology.orchestra.run.smithi177.stdout:279 punch from 0x1c623d8 to 0x1c663d1, (0x3ff9 bytes) 2019-12-16T22:45:32.228 INFO:teuthology.orchestra.run.smithi177.stdout:912 read 0x19fa451 thru 0x1a03e4d (0x99fd bytes) 2019-12-16T22:45:32.231 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.240 INFO:teuthology.orchestra.run.smithi177.stdout:1004 trunc from 0x9256b29 to 0xe0485f5 2019-12-16T22:45:32.240 INFO:teuthology.orchestra.run.smithi177.stdout:1037 write 0xe1ad301 thru 0xe1b19ea (0x46ea bytes) 2019-12-16T22:45:32.250 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.250 INFO:teuthology.orchestra.run.smithi177.stdout:1040 writesame 0xa067e59 thru 0xa06fc06 data_size 0x1(0x7dae bytes) 2019-12-16T22:45:32.250 INFO:teuthology.orchestra.run.smithi177.stdout:914 trunc from 0xe0466cc to 0x29c189d 2019-12-16T22:45:32.255 INFO:teuthology.orchestra.run.smithi177.stdout:280 write 0xe11eff4 thru 0xe1224b0 (0x34bd bytes) 2019-12-16T22:45:32.261 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.261 INFO:teuthology.orchestra.run.smithi177.stdout:1006 writesame 0xacdee3c thru 0xace0a2d data_size 0x31(0x1bf2 bytes) 2019-12-16T22:45:32.268 INFO:teuthology.orchestra.run.smithi177.stdout:282 write 0x66279f3 thru 0x662978a (0x1d98 bytes) 2019-12-16T22:45:32.280 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.280 INFO:teuthology.orchestra.run.smithi177.stdout:1042 writesame 0x4f9b316 thru 0x4f9f54c data_size 0x17(0x4237 bytes) 2019-12-16T22:45:32.281 INFO:teuthology.orchestra.run.smithi177.stdout:283 read 0xa38ab8a thru 0xa38fca5 (0x511c bytes) 2019-12-16T22:45:32.281 INFO:teuthology.orchestra.run.smithi177.stdout:284 read 0x4e2e602 thru 0x4e33e47 (0x5846 bytes) 2019-12-16T22:45:32.281 INFO:teuthology.orchestra.run.smithi177.stdout:1007 write 0xdfe1406 thru 0xdfe9caa (0x88a5 bytes) 2019-12-16T22:45:32.283 INFO:teuthology.orchestra.run.smithi177.stdout:1044 punch from 0x2f4d03d to 0x2f51f4c, (0x4f0f bytes) 2019-12-16T22:45:32.283 INFO:teuthology.orchestra.run.smithi177.stdout:1045 write 0x13ce854 thru 0x13d641f (0x7bcc bytes) 2019-12-16T22:45:32.288 INFO:teuthology.orchestra.run.smithi177.stdout:285 trunc from 0xe1224b1 to 0x9de6a9e 2019-12-16T22:45:32.294 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.294 INFO:teuthology.orchestra.run.smithi177.stdout:1047 read 0xcf963d2 thru 0xcfa2aad (0xc6dc bytes) 2019-12-16T22:45:32.308 INFO:teuthology.orchestra.run.smithi177.stdout:1049 trunc from 0xe1b19eb to 0x6c80e95 2019-12-16T22:45:32.315 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.316 INFO:teuthology.orchestra.run.smithi177.stdout:287 read 0x7d9040f thru 0x7d9b7a5 (0xb397 bytes) 2019-12-16T22:45:32.317 INFO:teuthology.orchestra.run.smithi177.stdout:1008 write 0xe36aec6 thru 0xe375bf7 (0xad32 bytes) 2019-12-16T22:45:32.329 INFO:teuthology.orchestra.run.smithi177.stdout:1009 read 0xc480ac thru 0xc4d984 (0x58d9 bytes) 2019-12-16T22:45:32.330 INFO:teuthology.orchestra.run.smithi177.stdout:1010 writesame 0x4a7d46f thru 0x4a8683f data_size 0x1(0x93d1 bytes) 2019-12-16T22:45:32.332 INFO:teuthology.orchestra.run.smithi177.stdout:289 trunc from 0x9de6a9e to 0x1f9164 2019-12-16T22:45:32.333 INFO:teuthology.orchestra.run.smithi177.stdout:915 writesame 0x736c6c0 thru 0x73787d1 data_size 0xd(0xc112 bytes) 2019-12-16T22:45:32.337 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.337 INFO:teuthology.orchestra.run.smithi177.stdout:917 punch from 0x26a755b to 0x26aace4, (0x3789 bytes) 2019-12-16T22:45:32.352 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.372 INFO:teuthology.orchestra.run.smithi177.stdout:1011 read 0x6cbff7f thru 0x6cc2d65 (0x2de7 bytes) 2019-12-16T22:45:32.372 INFO:teuthology.orchestra.run.smithi177.stdout:1013 read 0x97350f9 thru 0x974405c (0xef64 bytes) 2019-12-16T22:45:32.373 INFO:teuthology.orchestra.run.smithi177.stdout:1014 read 0x57f1296 thru 0x5800374 (0xf0df bytes) 2019-12-16T22:45:32.373 INFO:teuthology.orchestra.run.smithi177.stdout:1015 read 0xd79cc4d thru 0xd7a187b (0x4c2f bytes) 2019-12-16T22:45:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:1051 write 0xdd7d662 thru 0xdd8784a (0xa1e9 bytes) 2019-12-16T22:45:32.391 INFO:teuthology.orchestra.run.smithi177.stdout:1016 trunc from 0xe375bf8 to 0x43b8cff 2019-12-16T22:45:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:918 writesame 0xe947196 thru 0xe9523ed data_size 0x34(0xb258 bytes) 2019-12-16T22:45:32.408 INFO:teuthology.orchestra.run.smithi177.stdout:1052 write 0x445bc8f thru 0x446952c (0xd89e bytes) 2019-12-16T22:45:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:920 punch from 0xdf4b459 to 0xdf56b61, (0xb708 bytes) 2019-12-16T22:45:32.409 INFO:teuthology.orchestra.run.smithi177.stdout:921 write 0x87fc875 thru 0x87fd0b6 (0x842 bytes) 2019-12-16T22:45:32.414 INFO:teuthology.orchestra.run.smithi177.stdout:1053 read 0xc63c571 thru 0xc64a4bc (0xdf4c bytes) 2019-12-16T22:45:32.415 INFO:teuthology.orchestra.run.smithi177.stdout:1054 writesame 0xdd1aae8 thru 0xdd28ffd data_size 0xe(0xe516 bytes) 2019-12-16T22:45:32.421 INFO:teuthology.orchestra.run.smithi177.stdout:1055 write 0x286e2a6 thru 0x287709a (0x8df5 bytes) 2019-12-16T22:45:32.421 INFO:teuthology.orchestra.run.smithi177.stdout:923 write 0x5d5d486 thru 0x5d67cbb (0xa836 bytes) 2019-12-16T22:45:32.433 INFO:teuthology.orchestra.run.smithi177.stdout:1057 write 0x1e2239b thru 0x1e2dde7 (0xba4d bytes) 2019-12-16T22:45:32.442 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.442 INFO:teuthology.orchestra.run.smithi177.stdout:927 write 0x6dee5d1 thru 0x6dfcdb2 (0xe7e2 bytes) 2019-12-16T22:45:32.448 INFO:teuthology.orchestra.run.smithi177.stdout:1058 read 0x5248cb3 thru 0x524c870 (0x3bbe bytes) 2019-12-16T22:45:32.448 INFO:teuthology.orchestra.run.smithi177.stdout:1059 read 0x11be7ff thru 0x11c85d3 (0x9dd5 bytes) 2019-12-16T22:45:32.449 INFO:teuthology.orchestra.run.smithi177.stdout:1060 write 0x2b62d0 thru 0x2b6340 (0x71 bytes) 2019-12-16T22:45:32.457 INFO:teuthology.orchestra.run.smithi177.stdout:1063 punch from 0x61d8a86 to 0x61e356c, (0xaae6 bytes) 2019-12-16T22:45:32.457 INFO:teuthology.orchestra.run.smithi177.stdout:1064 punch from 0x979a38c to 0x97a00f5, (0x5d69 bytes) 2019-12-16T22:45:32.457 INFO:teuthology.orchestra.run.smithi177.stdout:1065 write 0xb56cdaa thru 0xb575ed5 (0x912c bytes) 2019-12-16T22:45:32.467 INFO:teuthology.orchestra.run.smithi177.stdout:1066 punch from 0x28ed657 to 0x28fabc2, (0xd56b bytes) 2019-12-16T22:45:32.476 INFO:teuthology.orchestra.run.smithi177.stdout:1018 write 0x26ae1c5 thru 0x26b2ac2 (0x48fe bytes) 2019-12-16T22:45:32.484 INFO:teuthology.orchestra.run.smithi177.stdout:930 trunc from 0xe9523ee to 0x370ca1b 2019-12-16T22:45:32.498 INFO:teuthology.orchestra.run.smithi177.stdout:1067 write 0xee03dcf thru 0xee0952d (0x575f bytes) 2019-12-16T22:45:32.506 INFO:teuthology.orchestra.run.smithi177.stdout:1068 write 0xcf3b62d thru 0xcf47d86 (0xc75a bytes) 2019-12-16T22:45:32.517 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:1070 read 0xbe45db0 thru 0xbe4daaa (0x7cfb bytes) 2019-12-16T22:45:32.518 INFO:teuthology.orchestra.run.smithi177.stdout:292 write 0xd6becef thru 0xd6c8ebb (0xa1cd bytes) 2019-12-16T22:45:32.524 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone6 from 0xc08cfae (overlap 0xef3b2a) to 0x0 2019-12-16T22:45:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:295 read 0x2cac35a thru 0x2cb4411 (0x80b8 bytes) 2019-12-16T22:45:32.528 INFO:teuthology.orchestra.run.smithi177.stdout:296 read 0x1ab7edf thru 0x1ac7e62 (0xff84 bytes) 2019-12-16T22:45:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:297 write 0xc76161f thru 0xc76ef40 (0xd922 bytes) 2019-12-16T22:45:32.529 INFO:teuthology.orchestra.run.smithi177.stdout:1071 trunc from 0xee0952e to 0xa8f897a 2019-12-16T22:45:32.537 INFO:teuthology.orchestra.run.smithi177.stdout:1019 write 0xd7bf23e thru 0xd7c4803 (0x55c6 bytes) 2019-12-16T22:45:32.543 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone6 from 0x6370d0d (overlap 0x927fc3) to 0x2bf320 2019-12-16T22:45:32.544 INFO:teuthology.orchestra.run.smithi177.stdout:298 trunc from 0xd6c8ebc to 0xd922730 2019-12-16T22:45:32.558 INFO:teuthology.orchestra.run.smithi177.stdout:931 write 0xb4c2d93 thru 0xb4d135c (0xe5ca bytes) 2019-12-16T22:45:32.566 INFO:teuthology.orchestra.run.smithi177.stdout:1020 trunc from 0xd7c4804 to 0x84237c4 2019-12-16T22:45:32.574 INFO:teuthology.orchestra.run.smithi177.stdout:932 punch from 0x7401dc6 to 0x74032cb, (0x1505 bytes) 2019-12-16T22:45:32.574 INFO:teuthology.orchestra.run.smithi177.stdout:933 write 0x3fe6709 thru 0x3ff230e (0xbc06 bytes) 2019-12-16T22:45:32.579 INFO:teuthology.orchestra.run.smithi177.stdout:299 write 0x4d5de9b thru 0x4d63f2f (0x6095 bytes) 2019-12-16T22:45:32.590 INFO:teuthology.orchestra.run.smithi177.stdout:936 writesame 0x2b915ab thru 0x2b93c34 data_size 0x1(0x268a bytes) 2019-12-16T22:45:32.604 INFO:teuthology.orchestra.run.smithi177.stdout:938 write 0x1a8f2f3 thru 0x1a9d3ba (0xe0c8 bytes) 2019-12-16T22:45:32.619 INFO:teuthology.orchestra.run.smithi177.stdout:301 trunc from 0xd922730 to 0x2329477 2019-12-16T22:45:32.623 INFO:teuthology.orchestra.run.smithi177.stdout:1072 write 0xa9c3d0f thru 0xa9c58c6 (0x1bb8 bytes) 2019-12-16T22:45:32.631 INFO:teuthology.orchestra.run.smithi177.stdout:941 read 0x3ec7063 thru 0x3ed6172 (0xf110 bytes) 2019-12-16T22:45:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:1073 write 0x3679190 thru 0x367f232 (0x60a3 bytes) 2019-12-16T22:45:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:942 read 0x59bdbcf thru 0x59c2be6 (0x5018 bytes) 2019-12-16T22:45:32.633 INFO:teuthology.orchestra.run.smithi177.stdout:943 write 0x9ce4dbc thru 0x9cef8a6 (0xaaeb bytes) 2019-12-16T22:45:32.644 INFO:teuthology.orchestra.run.smithi177.stdout:1021 write 0xe2c9eb2 thru 0xe2cbf47 (0x2096 bytes) 2019-12-16T22:45:32.646 INFO:teuthology.orchestra.run.smithi177.stdout:1074 punch from 0x800b84f to 0x800ea20, (0x31d1 bytes) 2019-12-16T22:45:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:1075 write 0x34df72 thru 0x34e9f9 (0xa88 bytes) 2019-12-16T22:45:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:944 punch from 0x694f788 to 0x6955b09, (0x6381 bytes) 2019-12-16T22:45:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:945 punch from 0x2415809 to 0x24190b2, (0x38a9 bytes) 2019-12-16T22:45:32.647 INFO:teuthology.orchestra.run.smithi177.stdout:946 writesame 0x4b2f95d thru 0x4b3407b data_size 0x9(0x471f bytes) 2019-12-16T22:45:32.651 INFO:teuthology.orchestra.run.smithi177.stdout:1076 read 0x42473d1 thru 0x425736b (0xff9b bytes) 2019-12-16T22:45:32.652 INFO:teuthology.orchestra.run.smithi177.stdout:1022 write 0xd9b6655 thru 0xd9bcbcf (0x657b bytes) 2019-12-16T22:45:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.661 INFO:teuthology.orchestra.run.smithi177.stdout:1024 writesame 0xcb698aa thru 0xcb6aea5 data_size 0x4(0x15fc bytes) 2019-12-16T22:45:32.662 INFO:teuthology.orchestra.run.smithi177.stdout:947 trunc from 0xb4d135d to 0xdb06f79 2019-12-16T22:45:32.667 INFO:teuthology.orchestra.run.smithi177.stdout:1025 write 0x35f55cd thru 0x35f840b (0x2e3f bytes) 2019-12-16T22:45:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #5, image image_cluster1.client.mirror.5-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent6 2019-12-16T22:45:32.680 INFO:teuthology.orchestra.run.smithi177.stdout:1026 write 0x36e5feb thru 0x36e936a (0x3380 bytes) 2019-12-16T22:45:32.688 INFO:teuthology.orchestra.run.smithi177.stdout:1078 writesame 0xda13d35 thru 0xda2262b data_size 0x1(0xe8f7 bytes) 2019-12-16T22:45:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:949 read 0x92bb0e7 thru 0x92c4db9 (0x9cd3 bytes) 2019-12-16T22:45:32.690 INFO:teuthology.orchestra.run.smithi177.stdout:950 read 0x85f302b thru 0x860049a (0xd470 bytes) 2019-12-16T22:45:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:953 read 0x32fffa1 thru 0x3301930 (0x1990 bytes) 2019-12-16T22:45:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:954 write 0xa179cdc thru 0xa18551d (0xb842 bytes) 2019-12-16T22:45:32.691 INFO:teuthology.orchestra.run.smithi177.stdout:1080 read 0x526063b thru 0x5266184 (0x5b4a bytes) 2019-12-16T22:45:32.692 INFO:teuthology.orchestra.run.smithi177.stdout:1081 write 0x4b7f0a7 thru 0x4b85664 (0x65be bytes) 2019-12-16T22:45:32.701 INFO:teuthology.orchestra.run.smithi177.stdout:1028 read 0x694f056 thru 0x6952cf5 (0x3ca0 bytes) 2019-12-16T22:45:32.701 INFO:teuthology.orchestra.run.smithi177.stdout:1029 punch from 0x7f63485 to 0x7f6cce7, (0x9862 bytes) 2019-12-16T22:45:32.702 INFO:teuthology.orchestra.run.smithi177.stdout:1031 read 0x5e965c9 thru 0x5ea4aae (0xe4e6 bytes) 2019-12-16T22:45:32.702 INFO:teuthology.orchestra.run.smithi177.stdout:1032 read 0x6a39f43 thru 0x6a42b1f (0x8bdd bytes) 2019-12-16T22:45:32.703 INFO:teuthology.orchestra.run.smithi177.stdout:1033 punch from 0x69cd22c to 0x69d8949, (0xb71d bytes) 2019-12-16T22:45:32.703 INFO:teuthology.orchestra.run.smithi177.stdout:1034 punch from 0xca3208a to 0xca3cb01, (0xaa77 bytes) 2019-12-16T22:45:32.703 INFO:teuthology.orchestra.run.smithi177.stdout:1082 writesame 0xab6930b thru 0xab6a751 data_size 0x1(0x1447 bytes) 2019-12-16T22:45:32.709 INFO:teuthology.orchestra.run.smithi177.stdout:303 write 0xc61831f thru 0xc620466 (0x8148 bytes) 2019-12-16T22:45:32.709 INFO:teuthology.orchestra.run.smithi177.stdout:1035 trunc from 0xe2cbf48 to 0xc1fef72 2019-12-16T22:45:32.711 INFO:teuthology.orchestra.run.smithi177.stdout:956 write 0x7cc2a0a thru 0x7cc8fa4 (0x659b bytes) 2019-12-16T22:45:32.717 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.717 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.717 INFO:teuthology.orchestra.run.smithi177.stdout:307 read 0x2a0496e thru 0x2a060c4 (0x1757 bytes) 2019-12-16T22:45:32.717 INFO:teuthology.orchestra.run.smithi177.stdout:308 read 0x82214d6 thru 0x8225d32 (0x485d bytes) 2019-12-16T22:45:32.718 INFO:teuthology.orchestra.run.smithi177.stdout:309 write 0x87bae4a thru 0x87be992 (0x3b49 bytes) 2019-12-16T22:45:32.720 INFO:teuthology.orchestra.run.smithi177.stdout:957 read 0x7afa1f5 thru 0x7afb86e (0x167a bytes) 2019-12-16T22:45:32.721 INFO:teuthology.orchestra.run.smithi177.stdout:958 write 0xda436a thru 0xdb0dbf (0xca56 bytes) 2019-12-16T22:45:32.735 INFO:teuthology.orchestra.run.smithi177.stdout:312 punch from 0x6636584 to 0x6642432, (0xbeae bytes) 2019-12-16T22:45:32.736 INFO:teuthology.orchestra.run.smithi177.stdout:313 read 0x3843528 thru 0x38438b9 (0x392 bytes) 2019-12-16T22:45:32.736 INFO:teuthology.orchestra.run.smithi177.stdout:314 clone 8 order 18 su 32768 sc 8 2019-12-16T22:45:32.739 INFO:teuthology.orchestra.run.smithi177.stdout:1083 trunc from 0xda2262c to 0x310b3f3 2019-12-16T22:45:32.740 INFO:teuthology.orchestra.run.smithi177.stdout:666 trunc from 0xc08cfae to 0x8e6446b 2019-12-16T22:45:32.761 INFO:teuthology.orchestra.run.smithi177.stdout:1036 write 0x6f6da31 thru 0x6f7c54f (0xeb1f bytes) 2019-12-16T22:45:32.763 INFO:teuthology.orchestra.run.smithi177.stdout:959 write 0xc3ddcec thru 0xc3e1963 (0x3c78 bytes) 2019-12-16T22:45:32.765 INFO:teuthology.orchestra.run.smithi177.stdout:1037 read 0x8a774df thru 0x8a81a2d (0xa54f bytes) 2019-12-16T22:45:32.772 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #5, image image_cluster1.client.mirror.4-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent6 2019-12-16T22:45:32.775 INFO:teuthology.orchestra.run.smithi177.stdout:960 writesame 0x7da9687 thru 0x7db3607 data_size 0x27(0x9f81 bytes) 2019-12-16T22:45:32.784 INFO:teuthology.orchestra.run.smithi177.stdout:961 writesame 0x1b50807 thru 0x1b54b76 data_size 0x1a(0x4370 bytes) 2019-12-16T22:45:32.787 INFO:teuthology.orchestra.run.smithi177.stdout:1038 trunc from 0xc1fef72 to 0x2bdd26a 2019-12-16T22:45:32.789 INFO:teuthology.orchestra.run.smithi177.stdout:963 punch from 0x11ffa94 to 0x1207fce, (0x853a bytes) 2019-12-16T22:45:32.789 INFO:teuthology.orchestra.run.smithi177.stdout:964 punch from 0x344a946 to 0x344d179, (0x2833 bytes) 2019-12-16T22:45:32.825 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.826 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.826 INFO:teuthology.orchestra.run.smithi177.stdout:672 writesame 0x7cd4788 thru 0x7cd6865 data_size 0x7(0x20de bytes) 2019-12-16T22:45:32.826 INFO:teuthology.orchestra.run.smithi177.stdout:1084 writesame 0xe1e560f thru 0xe1eb54b data_size 0x51(0x5f3d bytes) 2019-12-16T22:45:32.829 INFO:teuthology.orchestra.run.smithi177.stdout:1085 read 0xb8980a6 thru 0xb8a7ffe (0xff59 bytes) 2019-12-16T22:45:32.834 INFO:teuthology.orchestra.run.smithi177.stdout:966 write 0xe3399b1 thru 0xe33e2ac (0x48fc bytes) 2019-12-16T22:45:32.845 INFO:teuthology.orchestra.run.smithi177.stdout:688 read 0x51619bd thru 0x51690dc (0x7720 bytes) 2019-12-16T22:45:32.847 INFO:teuthology.orchestra.run.smithi177.stdout:1086 trunc from 0xe1eb54c to 0x26930b5 2019-12-16T22:45:32.848 INFO:teuthology.orchestra.run.smithi177.stdout:674 write 0x519679d thru 0x5196bfe (0x462 bytes) 2019-12-16T22:45:32.852 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.852 INFO:teuthology.orchestra.run.smithi177.stdout:968 write 0x12c3ae2 thru 0x12c8123 (0x4642 bytes) 2019-12-16T22:45:32.866 INFO:teuthology.orchestra.run.smithi177.stdout:675 punch from 0x6af371 to 0x6bc998, (0xd627 bytes) 2019-12-16T22:45:32.866 INFO:teuthology.orchestra.run.smithi177.stdout:676 write 0x87a5d99 thru 0x87a8076 (0x22de bytes) 2019-12-16T22:45:32.871 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.871 INFO:teuthology.orchestra.run.smithi177.stdout:678 write 0x3723103 thru 0x3723f3e (0xe3c bytes) 2019-12-16T22:45:32.871 INFO:teuthology.orchestra.run.smithi177.stdout:689 punch from 0x31f7347 to 0x320197a, (0xa633 bytes) 2019-12-16T22:45:32.871 INFO:teuthology.orchestra.run.smithi177.stdout:690 read 0x260c38 thru 0x2649b9 (0x3d82 bytes) 2019-12-16T22:45:32.872 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.873 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.873 INFO:teuthology.orchestra.run.smithi177.stdout:970 read 0x2d9f27c thru 0x2da48a7 (0x562c bytes) 2019-12-16T22:45:32.873 INFO:teuthology.orchestra.run.smithi177.stdout:971 writesame 0x2a3c31c thru 0x2a3fa6e data_size 0x1(0x3753 bytes) 2019-12-16T22:45:32.896 INFO:teuthology.orchestra.run.smithi177.stdout:680 write 0x88c6057 thru 0x88cfd64 (0x9d0e bytes) 2019-12-16T22:45:32.897 INFO:teuthology.orchestra.run.smithi177.stdout:681 read 0x212ebd2 thru 0x213cd4f (0xe17e bytes) 2019-12-16T22:45:32.897 INFO:teuthology.orchestra.run.smithi177.stdout:682 punch from 0x4dac215 to 0x4db3266, (0x7051 bytes) 2019-12-16T22:45:32.898 INFO:teuthology.orchestra.run.smithi177.stdout:692 trunc from 0x6370d0d to 0xcdc8a4 2019-12-16T22:45:32.898 INFO:teuthology.orchestra.run.smithi177.stdout:1087 punch from 0xb39de3 to 0xb3a521, (0x73e bytes) 2019-12-16T22:45:32.898 INFO:teuthology.orchestra.run.smithi177.stdout:1089 punch from 0xd0f010 to 0xd168ac, (0x789c bytes) 2019-12-16T22:45:32.898 INFO:teuthology.orchestra.run.smithi177.stdout:1090 read 0x179367b thru 0x179c04b (0x89d1 bytes) 2019-12-16T22:45:32.898 INFO:teuthology.orchestra.run.smithi177.stdout:1091 punch from 0x7c1ad6 to 0x7c8eb2, (0x73dc bytes) 2019-12-16T22:45:32.898 INFO:teuthology.orchestra.run.smithi177.stdout:974 read 0xa6b94e6 thru 0xa6bf811 (0x632c bytes) 2019-12-16T22:45:32.899 INFO:teuthology.orchestra.run.smithi177.stdout:975 clone 8 order 23 su 4194304 sc 13 2019-12-16T22:45:32.923 INFO:teuthology.orchestra.run.smithi177.stdout:1039 write 0x4248e58 thru 0x4253709 (0xa8b2 bytes) 2019-12-16T22:45:32.931 INFO:teuthology.orchestra.run.smithi177.stdout:1092 write 0xbd580c2 thru 0xbd60e54 (0x8d93 bytes) 2019-12-16T22:45:32.932 INFO:teuthology.orchestra.run.smithi177.stdout:683 write 0xc6806f8 thru 0xc68d696 (0xcf9f bytes) 2019-12-16T22:45:32.941 INFO:teuthology.orchestra.run.smithi177.stdout:1093 write 0x60f132c thru 0x60fa509 (0x91de bytes) 2019-12-16T22:45:32.943 INFO:teuthology.orchestra.run.smithi177.stdout:685 punch from 0x7a83810 to 0x7a92b48, (0xf338 bytes) 2019-12-16T22:45:32.944 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.944 INFO:teuthology.orchestra.run.smithi177.stdout:688 write 0x7e6b324 thru 0x7e6d4a1 (0x217e bytes) 2019-12-16T22:45:32.949 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.949 INFO:teuthology.orchestra.run.smithi177.stdout:1095 punch from 0x60e5dd9 to 0x60f2c17, (0xce3e bytes) 2019-12-16T22:45:32.949 INFO:teuthology.orchestra.run.smithi177.stdout:1096 read 0x44b31e5 thru 0x44b9f2f (0x6d4b bytes) 2019-12-16T22:45:32.950 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:32.952 INFO:teuthology.orchestra.run.smithi177.stdout:689 read 0x2eb2bf3 thru 0x2eb8097 (0x54a5 bytes) 2019-12-16T22:45:32.952 INFO:teuthology.orchestra.run.smithi177.stdout:691 read 0xabe4d49 thru 0xabec68e (0x7946 bytes) 2019-12-16T22:45:32.968 INFO:teuthology.orchestra.run.smithi177.stdout:1099 trunc from 0xbd60e55 to 0x4287d04 2019-12-16T22:45:32.975 INFO:teuthology.orchestra.run.smithi177.stdout:692 trunc from 0xc68d697 to 0xae9847 2019-12-16T22:45:32.976 INFO:teuthology.orchestra.run.smithi177.stdout:694 trunc from 0xcdc8a4 to 0x9455800 2019-12-16T22:45:32.977 INFO:teuthology.orchestra.run.smithi177.stdout:1040 writesame 0x9460317 thru 0x9468dfe data_size 0x1c(0x8ae8 bytes) 2019-12-16T22:45:32.984 INFO:teuthology.orchestra.run.smithi177.stdout:1041 read 0x72b063c thru 0x72bbc00 (0xb5c5 bytes) 2019-12-16T22:45:33.000 INFO:teuthology.orchestra.run.smithi177.stdout:1042 trunc from 0x9468dff to 0x1c1d0dd 2019-12-16T22:45:33.024 INFO:teuthology.orchestra.run.smithi177.stdout:1100 writesame 0x15d50d1 thru 0x15ddddb data_size 0x1(0x8d0b bytes) 2019-12-16T22:45:33.038 INFO:teuthology.orchestra.run.smithi177.stdout:695 write 0xbeaa1d6 thru 0xbeb542d (0xb258 bytes) 2019-12-16T22:45:33.057 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.063 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.063 INFO:teuthology.orchestra.run.smithi177.stdout:697 read 0x8abbe42 thru 0x8abc586 (0x745 bytes) 2019-12-16T22:45:33.073 INFO:teuthology.orchestra.run.smithi177.stdout:1101 read 0x239c0f7 thru 0x23a85a6 (0xc4b0 bytes) 2019-12-16T22:45:33.081 INFO:teuthology.orchestra.run.smithi177.stdout:1102 clone 8 order 20 su 262144 sc 12 2019-12-16T22:45:33.088 INFO:teuthology.orchestra.run.smithi177.stdout:1047 write 0xa69b7b1 thru 0xa6ab140 (0xf990 bytes) 2019-12-16T22:45:33.097 INFO:teuthology.orchestra.run.smithi177.stdout:698 write 0xca7cbbb thru 0xca80c25 (0x406b bytes) 2019-12-16T22:45:33.097 INFO:teuthology.orchestra.run.smithi177.stdout:693 trunc from 0xae9847 to 0x8d4c2aa 2019-12-16T22:45:33.098 INFO:teuthology.orchestra.run.smithi177.stdout:1049 trunc from 0xa6ab141 to 0xa0cbd5f 2019-12-16T22:45:33.102 INFO:teuthology.orchestra.run.smithi177.stdout:699 read 0x84b363d thru 0x84c2f39 (0xf8fd bytes) 2019-12-16T22:45:33.112 INFO:teuthology.orchestra.run.smithi177.stdout:695 write 0x4a818c1 thru 0x4a87f12 (0x6652 bytes) 2019-12-16T22:45:33.120 INFO:teuthology.orchestra.run.smithi177.stdout:697 read 0x18f4c06 thru 0x18fa0e2 (0x54dd bytes) 2019-12-16T22:45:33.121 INFO:teuthology.orchestra.run.smithi177.stdout:698 punch from 0x387ea2d to 0x3889552, (0xab25 bytes) 2019-12-16T22:45:33.121 INFO:teuthology.orchestra.run.smithi177.stdout:699 writesame 0xdfc23d thru 0xe00250 data_size 0x6(0x4014 bytes) 2019-12-16T22:45:33.126 INFO:teuthology.orchestra.run.smithi177.stdout:700 writesame 0xd668ff4 thru 0xd678469 data_size 0x53(0xf476 bytes) 2019-12-16T22:45:33.127 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe7903a9 2019-12-16T22:45:33.133 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone7 from 0xe33e2ad (overlap 0x1bcb8ca) to 0x0 2019-12-16T22:45:33.133 INFO:teuthology.orchestra.run.smithi177.stdout:700 trunc from 0x8d4c2aa to 0xa06ff74 2019-12-16T22:45:33.133 INFO:teuthology.orchestra.run.smithi177.stdout:704 trunc from 0xd67846a to 0xe7903a9 2019-12-16T22:45:33.135 INFO:teuthology.orchestra.run.smithi177.stdout:1050 trunc from 0xa0cbd5f to 0x3442760 2019-12-16T22:45:33.170 INFO:teuthology.orchestra.run.smithi177.stdout:701 read 0x383139c thru 0x38316e2 (0x347 bytes) 2019-12-16T22:45:33.171 INFO:teuthology.orchestra.run.smithi177.stdout:702 read 0x3cc3fc1 thru 0x3ccdb3e (0x9b7e bytes) 2019-12-16T22:45:33.172 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.175 INFO:teuthology.orchestra.run.smithi177.stdout:706 trunc from 0xa06ff74 to 0xbd1aa4a 2019-12-16T22:45:33.216 INFO:teuthology.orchestra.run.smithi177.stdout:705 trunc from 0xe7903a9 to 0x6a3eb5 2019-12-16T22:45:33.220 INFO:teuthology.orchestra.run.smithi177.stdout:707 trunc from 0xbd1aa4a to 0x6790da3 2019-12-16T22:45:33.268 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.2-clone7 2019-12-16T22:45:33.273 INFO:teuthology.orchestra.run.smithi177.stdout:708 trunc from 0x6790da3 to 0x8de9433 2019-12-16T22:45:33.290 INFO:teuthology.orchestra.run.smithi177.stdout:1051 writesame 0x57dc5e3 thru 0x57e52c4 data_size 0x3(0x8ce2 bytes) 2019-12-16T22:45:33.301 INFO:teuthology.orchestra.run.smithi177.stdout:710 read 0x5a6120f thru 0x5a6172d (0x51f bytes) 2019-12-16T22:45:33.323 INFO:teuthology.orchestra.run.smithi177.stdout:712 write 0x9857ab4 thru 0x985cc1b (0x5168 bytes) 2019-12-16T22:45:33.331 INFO:teuthology.orchestra.run.smithi177.stdout:713 punch from 0x25f93ea to 0x2608d26, (0xf93c bytes) 2019-12-16T22:45:33.332 INFO:teuthology.orchestra.run.smithi177.stdout:716 writesame 0xd7b54d thru 0xd81571 data_size 0x1(0x6025 bytes) 2019-12-16T22:45:33.332 INFO:teuthology.orchestra.run.smithi177.stdout:1052 write 0x98bf7a7 thru 0x98c57f1 (0x604b bytes) 2019-12-16T22:45:33.345 INFO:teuthology.orchestra.run.smithi177.stdout:706 trunc from 0x6a3eb5 to 0x97e3930 2019-12-16T22:45:33.348 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.348 INFO:teuthology.orchestra.run.smithi177.stdout:718 read 0x440ca30 thru 0x4411b6b (0x513c bytes) 2019-12-16T22:45:33.349 INFO:teuthology.orchestra.run.smithi177.stdout:719 read 0x24e4934 thru 0x24eab07 (0x61d4 bytes) 2019-12-16T22:45:33.354 INFO:teuthology.orchestra.run.smithi177.stdout:720 trunc from 0x985cc1c to 0xbda4185 2019-12-16T22:45:33.362 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.370 INFO:teuthology.orchestra.run.smithi177.stdout:1053 write 0xa0ec504 thru 0xa0f739b (0xae98 bytes) 2019-12-16T22:45:33.377 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #6, image image_cluster1.client.mirror.3-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent7 2019-12-16T22:45:33.382 INFO:teuthology.orchestra.run.smithi177.stdout:1054 read 0x26458f4 thru 0x264d6ef (0x7dfc bytes) 2019-12-16T22:45:33.384 INFO:teuthology.orchestra.run.smithi177.stdout:711 write 0xb67b873 thru 0xb67e2c9 (0x2a57 bytes) 2019-12-16T22:45:33.395 INFO:teuthology.orchestra.run.smithi177.stdout:722 write 0xc5d5d33 thru 0xc5e0bba (0xae88 bytes) 2019-12-16T22:45:33.401 INFO:teuthology.orchestra.run.smithi177.stdout:1056 trunc from 0xa0f739c to 0x19e8d00 2019-12-16T22:45:33.406 INFO:teuthology.orchestra.run.smithi177.stdout:723 write 0xade9fbb thru 0xadeadd3 (0xe19 bytes) 2019-12-16T22:45:33.412 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.413 INFO:teuthology.orchestra.run.smithi177.stdout:725 punch from 0x27fb089 to 0x27ffe99, (0x4e10 bytes) 2019-12-16T22:45:33.421 INFO:teuthology.orchestra.run.smithi177.stdout:712 writesame 0xb87d14d thru 0xb87e25e data_size 0x5(0x1112 bytes) 2019-12-16T22:45:33.421 INFO:teuthology.orchestra.run.smithi177.stdout:713 read 0x63b6177 thru 0x63babcd (0x4a57 bytes) 2019-12-16T22:45:33.421 INFO:teuthology.orchestra.run.smithi177.stdout:714 read 0x6418905 thru 0x6426c29 (0xe325 bytes) 2019-12-16T22:45:33.422 INFO:teuthology.orchestra.run.smithi177.stdout:715 trunc from 0xb87e25f to 0xc742505 2019-12-16T22:45:33.430 INFO:teuthology.orchestra.run.smithi177.stdout:728 trunc from 0xc5e0bbb to 0x2ece02a 2019-12-16T22:45:33.439 INFO:teuthology.orchestra.run.smithi177.stdout:716 writesame 0xb5b5789 thru 0xb5bc5b3 data_size 0x4f(0x6e2b bytes) 2019-12-16T22:45:33.448 INFO:teuthology.orchestra.run.smithi177.stdout:717 read 0xc6ec130 thru 0xc6ed4f0 (0x13c1 bytes) 2019-12-16T22:45:33.455 INFO:teuthology.orchestra.run.smithi177.stdout:1058 trunc from 0x19e8d00 to 0xe7212bf 2019-12-16T22:45:33.465 INFO:teuthology.orchestra.run.smithi177.stdout:729 trunc from 0x2ece02a to 0x5646618 2019-12-16T22:45:33.468 INFO:teuthology.orchestra.run.smithi177.stdout:718 write 0xd5ef708 thru 0xd5f6b24 (0x741d bytes) 2019-12-16T22:45:33.478 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #6, image image_cluster1.client.mirror.2-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent7 2019-12-16T22:45:33.478 INFO:teuthology.orchestra.run.smithi177.stdout:719 read 0xc1f44f1 thru 0xc1fb9dd (0x74ed bytes) 2019-12-16T22:45:33.479 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.479 INFO:teuthology.orchestra.run.smithi177.stdout:978 read 0x22decac thru 0x22e5b22 (0x6e77 bytes) 2019-12-16T22:45:33.491 INFO:teuthology.orchestra.run.smithi177.stdout:1060 trunc from 0xe7212bf to 0x2bff04d 2019-12-16T22:45:33.496 INFO:teuthology.orchestra.run.smithi177.stdout:730 trunc from 0x5646618 to 0xb35304e 2019-12-16T22:45:33.500 INFO:teuthology.orchestra.run.smithi177.stdout:720 trunc from 0xd5f6b25 to 0x157012a 2019-12-16T22:45:33.501 INFO:teuthology.orchestra.run.smithi177.stdout:979 writesame 0xd8dacb6 thru 0xd8dfc86 data_size 0x31(0x4fd1 bytes) 2019-12-16T22:45:33.504 INFO:teuthology.orchestra.run.smithi177.stdout:315 write 0xc4ad421 thru 0xc4b4ca2 (0x7882 bytes) 2019-12-16T22:45:33.509 INFO:teuthology.orchestra.run.smithi177.stdout:980 read 0x790a500 thru 0x7913e62 (0x9963 bytes) 2019-12-16T22:45:33.510 INFO:teuthology.orchestra.run.smithi177.stdout:981 read 0x4293ad4 thru 0x429bc00 (0x812d bytes) 2019-12-16T22:45:33.510 INFO:teuthology.orchestra.run.smithi177.stdout:982 writesame 0xba95616 thru 0xbaa2711 data_size 0x7d(0xd0fc bytes) 2019-12-16T22:45:33.522 INFO:teuthology.orchestra.run.smithi177.stdout:983 writesame 0x1661e92 thru 0x1671e8e data_size 0xd(0xfffd bytes) 2019-12-16T22:45:33.539 INFO:teuthology.orchestra.run.smithi177.stdout:316 punch from 0x50a23e0 to 0x50a48d8, (0x24f8 bytes) 2019-12-16T22:45:33.540 INFO:teuthology.orchestra.run.smithi177.stdout:319 writesame 0x985d873 thru 0x986d6b2 data_size 0x24(0xfe40 bytes) 2019-12-16T22:45:33.544 INFO:teuthology.orchestra.run.smithi177.stdout:1061 write 0x2ccf51b thru 0x2cde364 (0xee4a bytes) 2019-12-16T22:45:33.550 INFO:teuthology.orchestra.run.smithi177.stdout:731 write 0xe1f50ee thru 0xe2000bd (0xafd0 bytes) 2019-12-16T22:45:33.560 INFO:teuthology.orchestra.run.smithi177.stdout:320 punch from 0x35fef8d to 0x36031d2, (0x4245 bytes) 2019-12-16T22:45:33.562 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.562 INFO:teuthology.orchestra.run.smithi177.stdout:987 punch from 0x6744c11 to 0x6749b99, (0x4f88 bytes) 2019-12-16T22:45:33.563 INFO:teuthology.orchestra.run.smithi177.stdout:989 trunc from 0xe33e2ad to 0xdd38964 2019-12-16T22:45:33.566 INFO:teuthology.orchestra.run.smithi177.stdout:733 writesame 0x98d5fe9 thru 0x98df661 data_size 0x1(0x9679 bytes) 2019-12-16T22:45:33.580 INFO:teuthology.orchestra.run.smithi177.stdout:1062 trunc from 0x2cde365 to 0xc4ba92f 2019-12-16T22:45:33.599 INFO:teuthology.orchestra.run.smithi177.stdout:734 punch from 0xbb81171 to 0xbb908d1, (0xf760 bytes) 2019-12-16T22:45:33.600 INFO:teuthology.orchestra.run.smithi177.stdout:735 write 0xba08676 thru 0xba0bc79 (0x3604 bytes) 2019-12-16T22:45:33.600 INFO:teuthology.orchestra.run.smithi177.stdout:990 write 0xd643181 thru 0xd648aa7 (0x5927 bytes) 2019-12-16T22:45:33.600 INFO:teuthology.orchestra.run.smithi177.stdout:722 writesame 0xe9eed51 thru 0xe9fd1e9 data_size 0x1(0xe499 bytes) 2019-12-16T22:45:33.601 INFO:teuthology.orchestra.run.smithi177.stdout:322 writesame 0xca81f37 thru 0xca8861b data_size 0x35(0x66e5 bytes) 2019-12-16T22:45:33.605 INFO:teuthology.orchestra.run.smithi177.stdout:723 read 0xcc0a8bd thru 0xcc191f7 (0xe93b bytes) 2019-12-16T22:45:33.606 INFO:teuthology.orchestra.run.smithi177.stdout:323 write 0xc927184 thru 0xc935b97 (0xea14 bytes) 2019-12-16T22:45:33.610 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.610 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.610 INFO:teuthology.orchestra.run.smithi177.stdout:993 clone 9 order 22 su 65536 sc 2 2019-12-16T22:45:33.615 INFO:teuthology.orchestra.run.smithi177.stdout:724 trunc from 0xe9fd1ea to 0xa581a5b 2019-12-16T22:45:33.622 INFO:teuthology.orchestra.run.smithi177.stdout:324 punch from 0x5ba824b to 0x5bb0bc6, (0x897b bytes) 2019-12-16T22:45:33.622 INFO:teuthology.orchestra.run.smithi177.stdout:325 read 0xab5feb3 thru 0xab6b462 (0xb5b0 bytes) 2019-12-16T22:45:33.623 INFO:teuthology.orchestra.run.smithi177.stdout:326 write 0xc70a88e thru 0xc71a835 (0xffa8 bytes) 2019-12-16T22:45:33.628 INFO:teuthology.orchestra.run.smithi177.stdout:736 trunc from 0xe2000be to 0x3bc1ee2 2019-12-16T22:45:33.632 INFO:teuthology.orchestra.run.smithi177.stdout:1066 writesame 0xe78b723 thru 0xe79a0d6 data_size 0x2(0xe9b4 bytes) 2019-12-16T22:45:33.634 INFO:teuthology.orchestra.run.smithi177.stdout:1067 write 0x8d42e03 thru 0x8d4809b (0x5299 bytes) 2019-12-16T22:45:33.642 INFO:teuthology.orchestra.run.smithi177.stdout:726 read 0x4cecb60 thru 0x4cf9ef1 (0xd392 bytes) 2019-12-16T22:45:33.643 INFO:teuthology.orchestra.run.smithi177.stdout:727 punch from 0x3869105 to 0x386dc71, (0x4b6c bytes) 2019-12-16T22:45:33.643 INFO:teuthology.orchestra.run.smithi177.stdout:728 punch from 0x5b3d3b2 to 0x5b3d516, (0x164 bytes) 2019-12-16T22:45:33.643 INFO:teuthology.orchestra.run.smithi177.stdout:731 write 0x1a599a0 thru 0x1a6486a (0xaecb bytes) 2019-12-16T22:45:33.645 INFO:teuthology.orchestra.run.smithi177.stdout:328 write 0xb5aba9 thru 0xb66726 (0xbb7e bytes) 2019-12-16T22:45:33.648 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.648 INFO:teuthology.orchestra.run.smithi177.stdout:1069 writesame 0x9e65b8f thru 0x9e6e733 data_size 0x1(0x8ba5 bytes) 2019-12-16T22:45:33.662 INFO:teuthology.orchestra.run.smithi177.stdout:733 write 0x48a8342 thru 0x48b5450 (0xd10f bytes) 2019-12-16T22:45:33.674 INFO:teuthology.orchestra.run.smithi177.stdout:734 writesame 0x5038200 thru 0x5038c0a data_size 0x1(0xa0b bytes) 2019-12-16T22:45:33.684 INFO:teuthology.orchestra.run.smithi177.stdout:735 write 0x1f1d64d thru 0x1f2311c (0x5ad0 bytes) 2019-12-16T22:45:33.684 INFO:teuthology.orchestra.run.smithi177.stdout:1070 writesame 0x910f5ed thru 0x91138c8 data_size 0x16(0x42dc bytes) 2019-12-16T22:45:33.684 INFO:teuthology.orchestra.run.smithi177.stdout:739 punch from 0x3b03671 to 0x3b10521, (0xceb0 bytes) 2019-12-16T22:45:33.686 INFO:teuthology.orchestra.run.smithi177.stdout:329 writesame 0xd810c82 thru 0xd81b409 data_size 0xc(0xa788 bytes) 2019-12-16T22:45:33.688 INFO:teuthology.orchestra.run.smithi177.stdout:330 read 0x13c05c thru 0x149b2f (0xdad4 bytes) 2019-12-16T22:45:33.690 INFO:teuthology.orchestra.run.smithi177.stdout:331 write 0x70677a9 thru 0x70736b3 (0xbf0b bytes) 2019-12-16T22:45:33.696 INFO:teuthology.orchestra.run.smithi177.stdout:1072 punch from 0x9c1900e to 0x9c20de8, (0x7dda bytes) 2019-12-16T22:45:33.696 INFO:teuthology.orchestra.run.smithi177.stdout:1073 write 0xa1ebf0d thru 0xa1f0ea6 (0x4f9a bytes) 2019-12-16T22:45:33.711 INFO:teuthology.orchestra.run.smithi177.stdout:333 write 0xca1dd53 thru 0xca2890d (0xabbb bytes) 2019-12-16T22:45:33.722 INFO:teuthology.orchestra.run.smithi177.stdout:1074 trunc from 0xe79a0d7 to 0x565d918 2019-12-16T22:45:33.725 INFO:teuthology.orchestra.run.smithi177.stdout:736 write 0xb0267b1 thru 0xb0350b3 (0xe903 bytes) 2019-12-16T22:45:33.727 INFO:teuthology.orchestra.run.smithi177.stdout:740 write 0xd10db0a thru 0xd116e94 (0x938b bytes) 2019-12-16T22:45:33.736 INFO:teuthology.orchestra.run.smithi177.stdout:741 write 0x7530805 thru 0x7531bb6 (0x13b2 bytes) 2019-12-16T22:45:33.749 INFO:teuthology.orchestra.run.smithi177.stdout:742 clone 8 order 24 su 65536 sc 7 2019-12-16T22:45:33.750 INFO:teuthology.orchestra.run.smithi177.stdout:334 writesame 0xd879f9d thru 0xd8849e2 data_size 0xf(0xaa46 bytes) 2019-12-16T22:45:33.750 INFO:teuthology.orchestra.run.smithi177.stdout:336 write 0xce3fdb0 thru 0xce495c9 (0x981a bytes) 2019-12-16T22:45:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:337 punch from 0x4ee37b8 to 0x4ee519b, (0x19e3 bytes) 2019-12-16T22:45:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:338 punch from 0x4725811 to 0x4726783, (0xf72 bytes) 2019-12-16T22:45:33.759 INFO:teuthology.orchestra.run.smithi177.stdout:339 writesame 0x64aff9d thru 0x64b4045 data_size 0x1(0x40a9 bytes) 2019-12-16T22:45:33.763 INFO:teuthology.orchestra.run.smithi177.stdout:738 write 0xbe9a0b3 thru 0xbe9ff3d (0x5e8b bytes) 2019-12-16T22:45:33.764 INFO:teuthology.orchestra.run.smithi177.stdout:1075 trunc from 0x565d918 to 0xc62108 2019-12-16T22:45:33.778 INFO:teuthology.orchestra.run.smithi177.stdout:340 read 0xc9de4a0 thru 0xc9e8d1c (0xa87d bytes) 2019-12-16T22:45:33.779 INFO:teuthology.orchestra.run.smithi177.stdout:341 punch from 0xa774b7a to 0xa77f892, (0xad18 bytes) 2019-12-16T22:45:33.779 INFO:teuthology.orchestra.run.smithi177.stdout:343 read 0x3de0644 thru 0x3dee1bd (0xdb7a bytes) 2019-12-16T22:45:33.780 INFO:teuthology.orchestra.run.smithi177.stdout:344 read 0x1a4f91a thru 0x1a5852b (0x8c12 bytes) 2019-12-16T22:45:33.780 INFO:teuthology.orchestra.run.smithi177.stdout:345 read 0x54eeae2 thru 0x54f1d47 (0x3266 bytes) 2019-12-16T22:45:33.780 INFO:teuthology.orchestra.run.smithi177.stdout:346 read 0xb629dc3 thru 0xb638d74 (0xefb2 bytes) 2019-12-16T22:45:33.781 INFO:teuthology.orchestra.run.smithi177.stdout:347 punch from 0x3f571a2 to 0x3f59328, (0x2186 bytes) 2019-12-16T22:45:33.781 INFO:teuthology.orchestra.run.smithi177.stdout:348 read 0xa45b443 thru 0xa461548 (0x6106 bytes) 2019-12-16T22:45:33.781 INFO:teuthology.orchestra.run.smithi177.stdout:349 read 0xca860b thru 0xcb20bc (0x9ab2 bytes) 2019-12-16T22:45:33.782 INFO:teuthology.orchestra.run.smithi177.stdout:350 writesame 0x52e0e9b thru 0x52ea700 data_size 0x1(0x9866 bytes) 2019-12-16T22:45:33.792 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.793 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.809 INFO:teuthology.orchestra.run.smithi177.stdout:353 read 0x525a934 thru 0x5268f87 (0xe654 bytes) 2019-12-16T22:45:33.815 INFO:teuthology.orchestra.run.smithi177.stdout:739 write 0xd2b53a4 thru 0xd2bcacf (0x772c bytes) 2019-12-16T22:45:33.818 INFO:teuthology.orchestra.run.smithi177.stdout:1083 write 0x10b5783 thru 0x10bb673 (0x5ef1 bytes) 2019-12-16T22:45:33.823 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.823 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.824 INFO:teuthology.orchestra.run.smithi177.stdout:1087 read 0xf84037 thru 0xf8f14d (0xb117 bytes) 2019-12-16T22:45:33.824 INFO:teuthology.orchestra.run.smithi177.stdout:1088 read 0x9ea0b1 thru 0x9f4f10 (0xae60 bytes) 2019-12-16T22:45:33.837 INFO:teuthology.orchestra.run.smithi177.stdout:354 trunc from 0xd8849e3 to 0x1a9244f 2019-12-16T22:45:33.844 INFO:teuthology.orchestra.run.smithi177.stdout:1089 trunc from 0x10bb674 to 0x954365c 2019-12-16T22:45:33.846 INFO:teuthology.orchestra.run.smithi177.stdout:743 trunc from 0xd2bcad0 to 0x11793ec 2019-12-16T22:45:33.891 INFO:teuthology.orchestra.run.smithi177.stdout:1090 write 0xa31f287 thru 0xa328a82 (0x97fc bytes) 2019-12-16T22:45:33.895 INFO:teuthology.orchestra.run.smithi177.stdout:356 read 0x3e43d9 thru 0x3ef8f1 (0xb519 bytes) 2019-12-16T22:45:33.897 INFO:teuthology.orchestra.run.smithi177.stdout:1091 read 0x69128bf thru 0x6918325 (0x5a67 bytes) 2019-12-16T22:45:33.912 INFO:teuthology.orchestra.run.smithi177.stdout:745 write 0x58c8bef thru 0x58c8ca1 (0xb3 bytes) 2019-12-16T22:45:33.917 INFO:teuthology.orchestra.run.smithi177.stdout:746 read 0x56481fe thru 0x564ab2d (0x2930 bytes) 2019-12-16T22:45:33.917 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:33.924 INFO:teuthology.orchestra.run.smithi177.stdout:1092 trunc from 0xa328a83 to 0x608ea1 2019-12-16T22:45:33.938 INFO:teuthology.orchestra.run.smithi177.stdout:357 write 0x8bd0408 thru 0x8bdc3b9 (0xbfb2 bytes) 2019-12-16T22:45:33.943 INFO:teuthology.orchestra.run.smithi177.stdout:748 write 0x643095f thru 0x643b823 (0xaec5 bytes) 2019-12-16T22:45:33.953 INFO:teuthology.orchestra.run.smithi177.stdout:749 read 0x582508 thru 0x58fed9 (0xd9d2 bytes) 2019-12-16T22:45:33.998 INFO:teuthology.orchestra.run.smithi177.stdout:750 write 0xe6ca34e thru 0xe6d0922 (0x65d5 bytes) 2019-12-16T22:45:33.998 INFO:teuthology.orchestra.run.smithi177.stdout:358 writesame 0xe4faea9 thru 0xe508411 data_size 0x1(0xd569 bytes) 2019-12-16T22:45:34.000 INFO:teuthology.orchestra.run.smithi177.stdout:359 punch from 0xb620f53 to 0xb62b385, (0xa432 bytes) 2019-12-16T22:45:34.000 INFO:teuthology.orchestra.run.smithi177.stdout:360 writesame 0x11f7af1 thru 0x11fef6e data_size 0x1f(0x747e bytes) 2019-12-16T22:45:34.004 INFO:teuthology.orchestra.run.smithi177.stdout:1093 write 0xcc2a55a thru 0xcc30898 (0x633f bytes) 2019-12-16T22:45:34.013 INFO:teuthology.orchestra.run.smithi177.stdout:753 read 0x76f8efc thru 0x76feabf (0x5bc4 bytes) 2019-12-16T22:45:34.014 INFO:teuthology.orchestra.run.smithi177.stdout:754 writesame 0xbed029 thru 0xbf391c data_size 0x6(0x68f4 bytes) 2019-12-16T22:45:34.021 INFO:teuthology.orchestra.run.smithi177.stdout:755 read 0x707b14c thru 0x70859c6 (0xa87b bytes) 2019-12-16T22:45:34.022 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.022 INFO:teuthology.orchestra.run.smithi177.stdout:757 writesame 0xaacdae7 thru 0xaad90b5 data_size 0x3d(0xb5cf bytes) 2019-12-16T22:45:34.037 INFO:teuthology.orchestra.run.smithi177.stdout:758 writesame 0x99e172 thru 0x99eb54 data_size 0x1(0x9e3 bytes) 2019-12-16T22:45:34.037 INFO:teuthology.orchestra.run.smithi177.stdout:1095 trunc from 0xcc30899 to 0x6f14e58 2019-12-16T22:45:34.038 INFO:teuthology.orchestra.run.smithi177.stdout:759 read 0x50d4ef1 thru 0x50e40c6 (0xf1d6 bytes) 2019-12-16T22:45:34.038 INFO:teuthology.orchestra.run.smithi177.stdout:760 write 0x25328b9 thru 0x253a101 (0x7849 bytes) 2019-12-16T22:45:34.044 INFO:teuthology.orchestra.run.smithi177.stdout:361 trunc from 0xe508412 to 0x3381c1e 2019-12-16T22:45:34.051 INFO:teuthology.orchestra.run.smithi177.stdout:761 write 0xb24a774 thru 0xb25531e (0xabab bytes) 2019-12-16T22:45:34.058 INFO:teuthology.orchestra.run.smithi177.stdout:763 write 0x46a8f15 thru 0x46b7977 (0xea63 bytes) 2019-12-16T22:45:34.069 INFO:teuthology.orchestra.run.smithi177.stdout:1096 write 0x29bf798 thru 0x29c02d9 (0xb42 bytes) 2019-12-16T22:45:34.072 INFO:teuthology.orchestra.run.smithi177.stdout:764 write 0x29407c0 thru 0x294572f (0x4f70 bytes) 2019-12-16T22:45:34.075 INFO:teuthology.orchestra.run.smithi177.stdout:1098 writesame 0x1063f55 thru 0x1064ecd data_size 0x1(0xf79 bytes) 2019-12-16T22:45:34.077 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.078 INFO:teuthology.orchestra.run.smithi177.stdout:363 read 0x7b603b thru 0x7befc4 (0x8f8a bytes) 2019-12-16T22:45:34.078 INFO:teuthology.orchestra.run.smithi177.stdout:364 read 0x3195d75 thru 0x3196a98 (0xd24 bytes) 2019-12-16T22:45:34.078 INFO:teuthology.orchestra.run.smithi177.stdout:365 read 0x2fd14b3 thru 0x2fdb171 (0x9cbf bytes) 2019-12-16T22:45:34.079 INFO:teuthology.orchestra.run.smithi177.stdout:366 read 0x2d1c254 thru 0x2d1d052 (0xdff bytes) 2019-12-16T22:45:34.081 INFO:teuthology.orchestra.run.smithi177.stdout:1099 read 0x6e4bc6c thru 0x6e4c5f7 (0x98c bytes) 2019-12-16T22:45:34.081 INFO:teuthology.orchestra.run.smithi177.stdout:1102 write 0x45fcc17 thru 0x46069a7 (0x9d91 bytes) 2019-12-16T22:45:34.083 INFO:teuthology.orchestra.run.smithi177.stdout:765 trunc from 0xe6d0923 to 0xd541f93 2019-12-16T22:45:34.095 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.095 INFO:teuthology.orchestra.run.smithi177.stdout:1104 write 0x6d18457 thru 0x6d233b7 (0xaf61 bytes) 2019-12-16T22:45:34.111 INFO:teuthology.orchestra.run.smithi177.stdout:367 writesame 0x888a8a1 thru 0x8896d15 data_size 0x1(0xc475 bytes) 2019-12-16T22:45:34.115 INFO:teuthology.orchestra.run.smithi177.stdout:369 punch from 0x51d9486 to 0x51dfc08, (0x6782 bytes) 2019-12-16T22:45:34.116 INFO:teuthology.orchestra.run.smithi177.stdout:370 writesame 0x1169d8b thru 0x1173a8f data_size 0x1(0x9d05 bytes) 2019-12-16T22:45:34.122 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.123 INFO:teuthology.orchestra.run.smithi177.stdout:767 read 0x8f313b5 thru 0x8f32f9b (0x1be7 bytes) 2019-12-16T22:45:34.129 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone7 from 0xd116e95 (overlap 0xae9847) to 0x68c1c4 2019-12-16T22:45:34.134 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.3-clone8 2019-12-16T22:45:34.165 INFO:teuthology.orchestra.run.smithi177.stdout:769 writesame 0xd99517e thru 0xd998603 data_size 0x1b(0x3486 bytes) 2019-12-16T22:45:34.165 INFO:teuthology.orchestra.run.smithi177.stdout:371 trunc from 0x8896d16 to 0xbdbd2c2 2019-12-16T22:45:34.171 INFO:teuthology.orchestra.run.smithi177.stdout:770 punch from 0x99fcd5d to 0x9a02acb, (0x5d6e bytes) 2019-12-16T22:45:34.171 INFO:teuthology.orchestra.run.smithi177.stdout:771 write 0xd77796d thru 0xd783e3f (0xc4d3 bytes) 2019-12-16T22:45:34.194 INFO:teuthology.orchestra.run.smithi177.stdout:1105 writesame 0xea5897c thru 0xea67149 data_size 0x1(0xe7ce bytes) 2019-12-16T22:45:34.215 INFO:teuthology.orchestra.run.smithi177.stdout:1106 read 0xa04978c thru 0xa0571cb (0xda40 bytes) 2019-12-16T22:45:34.215 INFO:teuthology.orchestra.run.smithi177.stdout:1107 writesame 0xf0bb08 thru 0xf1863a data_size 0x1(0xcb33 bytes) 2019-12-16T22:45:34.231 INFO:teuthology.orchestra.run.smithi177.stdout:773 read 0x57af751 thru 0x57b0fc4 (0x1874 bytes) 2019-12-16T22:45:34.231 INFO:teuthology.orchestra.run.smithi177.stdout:777 writesame 0xc9f14bf thru 0xc9fcff5 data_size 0x1(0xbb37 bytes) 2019-12-16T22:45:34.236 INFO:teuthology.orchestra.run.smithi177.stdout:372 writesame 0x40afb4a thru 0x40b1e6f data_size 0xb(0x2326 bytes) 2019-12-16T22:45:34.265 INFO:teuthology.orchestra.run.smithi177.stdout:780 write 0x22479c4 thru 0x2248bcd (0x120a bytes) 2019-12-16T22:45:34.272 INFO:teuthology.orchestra.run.smithi177.stdout:373 punch from 0x25f445f to 0x25f7b3d, (0x36de bytes) 2019-12-16T22:45:34.272 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.272 INFO:teuthology.orchestra.run.smithi177.stdout:375 read 0x4891b2 thru 0x48d34a (0x4199 bytes) 2019-12-16T22:45:34.272 INFO:teuthology.orchestra.run.smithi177.stdout:376 writesame 0x263ba23 thru 0x2640fd5 data_size 0x47(0x55b3 bytes) 2019-12-16T22:45:34.281 INFO:teuthology.orchestra.run.smithi177.stdout:781 read 0xd125666 thru 0xd1285e9 (0x2f84 bytes) 2019-12-16T22:45:34.282 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.282 INFO:teuthology.orchestra.run.smithi177.stdout:783 punch from 0x8c2d910 to 0x8c35946, (0x8036 bytes) 2019-12-16T22:45:34.284 INFO:teuthology.orchestra.run.smithi177.stdout:377 punch from 0x99a2776 to 0x99aad14, (0x859e bytes) 2019-12-16T22:45:34.284 INFO:teuthology.orchestra.run.smithi177.stdout:379 write 0x4e55315 thru 0x4e5d421 (0x810d bytes) 2019-12-16T22:45:34.287 INFO:teuthology.orchestra.run.smithi177.stdout:784 trunc from 0xd998604 to 0xb5c2be4 2019-12-16T22:45:34.288 INFO:teuthology.orchestra.run.smithi177.stdout:1108 trunc from 0xea6714a to 0x82414cf 2019-12-16T22:45:34.296 INFO:teuthology.orchestra.run.smithi177.stdout:380 write 0x9ba5f14 thru 0x9baef11 (0x8ffe bytes) 2019-12-16T22:45:34.313 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.0-clone7 2019-12-16T22:45:34.313 INFO:teuthology.orchestra.run.smithi177.stdout:381 writesame 0xa803833 thru 0xa80b6e5 data_size 0xd(0x7eb3 bytes) 2019-12-16T22:45:34.316 INFO:teuthology.orchestra.run.smithi177.stdout:1109 read 0x669bb6e thru 0x66a12df (0x5772 bytes) 2019-12-16T22:45:34.316 INFO:teuthology.orchestra.run.smithi177.stdout:1110 punch from 0x14725cf to 0x1473aa9, (0x14da bytes) 2019-12-16T22:45:34.316 INFO:teuthology.orchestra.run.smithi177.stdout:1111 writesame 0x363422c thru 0x3641cf2 data_size 0x7f(0xdac7 bytes) 2019-12-16T22:45:34.330 INFO:teuthology.orchestra.run.smithi177.stdout:383 read 0x7be89de thru 0x7bec701 (0x3d24 bytes) 2019-12-16T22:45:34.339 INFO:teuthology.orchestra.run.smithi177.stdout:785 writesame 0x9b91c98 thru 0x9ba158c data_size 0x1(0xf8f5 bytes) 2019-12-16T22:45:34.371 INFO:teuthology.orchestra.run.smithi177.stdout:1112 write 0xac1968c thru 0xac23501 (0x9e76 bytes) 2019-12-16T22:45:34.371 INFO:teuthology.orchestra.run.smithi177.stdout:386 write 0xc9fb9a9 thru 0xc9ff0bc (0x3714 bytes) 2019-12-16T22:45:34.377 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.377 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.377 INFO:teuthology.orchestra.run.smithi177.stdout:788 read 0xaa01a8b thru 0xaa0b5f3 (0x9b69 bytes) 2019-12-16T22:45:34.377 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xed4ba5d 2019-12-16T22:45:34.379 INFO:teuthology.orchestra.run.smithi177.stdout:388 write 0x3a9656d thru 0x3a9e29c (0x7d30 bytes) 2019-12-16T22:45:34.379 INFO:teuthology.orchestra.run.smithi177.stdout:1114 writesame 0x6ed3e0d thru 0x6ee3cd8 data_size 0x2e(0xfecc bytes) 2019-12-16T22:45:34.382 INFO:teuthology.orchestra.run.smithi177.stdout:791 trunc from 0xb5c2be4 to 0xed4ba5d 2019-12-16T22:45:34.389 INFO:teuthology.orchestra.run.smithi177.stdout:1115 writesame 0x912ffee thru 0x9134063 data_size 0x25(0x4076 bytes) 2019-12-16T22:45:34.390 INFO:teuthology.orchestra.run.smithi177.stdout:390 punch from 0x359a141 to 0x35a7cd8, (0xdb97 bytes) 2019-12-16T22:45:34.391 INFO:teuthology.orchestra.run.smithi177.stdout:392 writesame 0x9addb11 thru 0x9ae5e86 data_size 0x6(0x8376 bytes) 2019-12-16T22:45:34.399 INFO:teuthology.orchestra.run.smithi177.stdout:1116 read 0x9c16d6f thru 0x9c1abd3 (0x3e65 bytes) 2019-12-16T22:45:34.399 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.399 INFO:teuthology.orchestra.run.smithi177.stdout:1119 punch from 0x78cb8f7 to 0x78cfffb, (0x4704 bytes) 2019-12-16T22:45:34.399 INFO:teuthology.orchestra.run.smithi177.stdout:1121 writesame 0x35c137e thru 0x35cee54 data_size 0xb(0xdad7 bytes) 2019-12-16T22:45:34.403 INFO:teuthology.orchestra.run.smithi177.stdout:393 read 0x6af911a thru 0x6b01352 (0x8239 bytes) 2019-12-16T22:45:34.403 INFO:teuthology.orchestra.run.smithi177.stdout:395 write 0x5287b80 thru 0x5291512 (0x9993 bytes) 2019-12-16T22:45:34.406 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #6, image image_cluster1.client.mirror.5-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent7 2019-12-16T22:45:34.410 INFO:teuthology.orchestra.run.smithi177.stdout:1123 read 0x2ebe927 thru 0x2ec532a (0x6a04 bytes) 2019-12-16T22:45:34.410 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.410 INFO:teuthology.orchestra.run.smithi177.stdout:1130 punch from 0x5d2b834 to 0x5d39316, (0xdae2 bytes) 2019-12-16T22:45:34.410 INFO:teuthology.orchestra.run.smithi177.stdout:1131 read 0x81a4c93 thru 0x81a84e3 (0x3851 bytes) 2019-12-16T22:45:34.410 INFO:teuthology.orchestra.run.smithi177.stdout:1132 punch from 0x487b866 to 0x4888fa0, (0xd73a bytes) 2019-12-16T22:45:34.411 INFO:teuthology.orchestra.run.smithi177.stdout:1133 writesame 0xa24ed54 thru 0xa2522aa data_size 0x1(0x3557 bytes) 2019-12-16T22:45:34.416 INFO:teuthology.orchestra.run.smithi177.stdout:792 punch from 0x2169516 to 0x216e1e6, (0x4cd0 bytes) 2019-12-16T22:45:34.416 INFO:teuthology.orchestra.run.smithi177.stdout:793 write 0xb86b6f2 thru 0xb8728d7 (0x71e6 bytes) 2019-12-16T22:45:34.418 INFO:teuthology.orchestra.run.smithi177.stdout:396 punch from 0x402125d to 0x40250ea, (0x3e8d bytes) 2019-12-16T22:45:34.418 INFO:teuthology.orchestra.run.smithi177.stdout:397 write 0x9726638 thru 0x9732691 (0xc05a bytes) 2019-12-16T22:45:34.426 INFO:teuthology.orchestra.run.smithi177.stdout:794 writesame 0x41a8174 thru 0x41af57b data_size 0x8(0x7408 bytes) 2019-12-16T22:45:34.428 INFO:teuthology.orchestra.run.smithi177.stdout:1134 read 0x7d0fa92 thru 0x7d169a5 (0x6f14 bytes) 2019-12-16T22:45:34.428 INFO:teuthology.orchestra.run.smithi177.stdout:1135 write 0x8023ffc thru 0x802e283 (0xa288 bytes) 2019-12-16T22:45:34.437 INFO:teuthology.orchestra.run.smithi177.stdout:398 write 0x77bb518 thru 0x77be343 (0x2e2c bytes) 2019-12-16T22:45:34.437 INFO:teuthology.orchestra.run.smithi177.stdout:743 punch from 0xb5b7917 to 0xb5c0a71, (0x915a bytes) 2019-12-16T22:45:34.438 INFO:teuthology.orchestra.run.smithi177.stdout:1137 writesame 0x5c1ce8e thru 0x5c281ea data_size 0x25(0xb35d bytes) 2019-12-16T22:45:34.442 INFO:teuthology.orchestra.run.smithi177.stdout:399 write 0x8b94afd thru 0x8b9b8b2 (0x6db6 bytes) 2019-12-16T22:45:34.457 INFO:teuthology.orchestra.run.smithi177.stdout:1138 write 0xa0543e3 thru 0xa05c9c9 (0x85e7 bytes) 2019-12-16T22:45:34.458 INFO:teuthology.orchestra.run.smithi177.stdout:795 trunc from 0xed4ba5d to 0x79ecc83 2019-12-16T22:45:34.458 INFO:teuthology.orchestra.run.smithi177.stdout:745 punch from 0xaa22c98 to 0xaa2a5cf, (0x7937 bytes) 2019-12-16T22:45:34.458 INFO:teuthology.orchestra.run.smithi177.stdout:747 trunc from 0xd116e95 to 0xb5817da 2019-12-16T22:45:34.458 INFO:teuthology.orchestra.run.smithi177.stdout:400 trunc from 0xc9ff0bd to 0xdba8cbf 2019-12-16T22:45:34.482 INFO:teuthology.orchestra.run.smithi177.stdout:402 writesame 0xd6e4bf6 thru 0xd6e9c9a data_size 0x1(0x50a5 bytes) 2019-12-16T22:45:34.483 INFO:teuthology.orchestra.run.smithi177.stdout:1139 writesame 0xb8ee38b thru 0xb8f8258 data_size 0x1(0x9ece bytes) 2019-12-16T22:45:34.483 INFO:teuthology.orchestra.run.smithi177.stdout:797 trunc from 0x79ecc83 to 0x7eb80dc 2019-12-16T22:45:34.492 INFO:teuthology.orchestra.run.smithi177.stdout:1140 write 0x8d09811 thru 0x8d1965e (0xfe4e bytes) 2019-12-16T22:45:34.506 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #6, image image_cluster1.client.mirror.0-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent7 2019-12-16T22:45:34.507 INFO:teuthology.orchestra.run.smithi177.stdout:403 read 0x99255c3 thru 0x992c5fb (0x7039 bytes) 2019-12-16T22:45:34.507 INFO:teuthology.orchestra.run.smithi177.stdout:404 read 0x4ec323c thru 0x4ec70ec (0x3eb1 bytes) 2019-12-16T22:45:34.507 INFO:teuthology.orchestra.run.smithi177.stdout:405 read 0xcbcf5ee thru 0xcbdb636 (0xc049 bytes) 2019-12-16T22:45:34.508 INFO:teuthology.orchestra.run.smithi177.stdout:407 read 0x8a15c6 thru 0x8a3bdc (0x2617 bytes) 2019-12-16T22:45:34.508 INFO:teuthology.orchestra.run.smithi177.stdout:409 writesame 0x89cf192 thru 0x89d8885 data_size 0x2(0x96f4 bytes) 2019-12-16T22:45:34.514 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.514 INFO:teuthology.orchestra.run.smithi177.stdout:800 read 0x58f775b thru 0x5904c8a (0xd530 bytes) 2019-12-16T22:45:34.515 INFO:teuthology.orchestra.run.smithi177.stdout:748 write 0xb4d12f9 thru 0xb4d6a00 (0x5708 bytes) 2019-12-16T22:45:34.524 INFO:teuthology.orchestra.run.smithi177.stdout:749 punch from 0x2ca945f to 0x2cb3b17, (0xa6b8 bytes) 2019-12-16T22:45:34.533 INFO:teuthology.orchestra.run.smithi177.stdout:1141 write 0xeca59ab thru 0xecad637 (0x7c8d bytes) 2019-12-16T22:45:34.541 INFO:teuthology.orchestra.run.smithi177.stdout:1106 trunc from 0x4287d04 to 0x56a928d 2019-12-16T22:45:34.542 INFO:teuthology.orchestra.run.smithi177.stdout:1144 read 0x9bff637 thru 0x9c0a9c6 (0xb390 bytes) 2019-12-16T22:45:34.543 INFO:teuthology.orchestra.run.smithi177.stdout:1146 punch from 0x8db6b6d to 0x8dc5e46, (0xf2d9 bytes) 2019-12-16T22:45:34.543 INFO:teuthology.orchestra.run.smithi177.stdout:1147 read 0x10c603c thru 0x10c7f6a (0x1f2f bytes) 2019-12-16T22:45:34.543 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.543 INFO:teuthology.orchestra.run.smithi177.stdout:1153 writesame 0xb4a3035 thru 0xb4adead data_size 0x1(0xae79 bytes) 2019-12-16T22:45:34.544 INFO:teuthology.orchestra.run.smithi177.stdout:750 write 0xb7d0190 thru 0xb7df820 (0xf691 bytes) 2019-12-16T22:45:34.546 INFO:teuthology.orchestra.run.smithi177.stdout:410 trunc from 0xdba8cbf to 0x3f5d36 2019-12-16T22:45:34.547 INFO:teuthology.orchestra.run.smithi177.stdout:802 writesame 0xee4ba70 thru 0xee4d419 data_size 0x12(0x19aa bytes) 2019-12-16T22:45:34.552 INFO:teuthology.orchestra.run.smithi177.stdout:804 read 0x2610681 thru 0x2611d49 (0x16c9 bytes) 2019-12-16T22:45:34.553 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.553 INFO:teuthology.orchestra.run.smithi177.stdout:807 write 0x872392c thru 0x872b8ce (0x7fa3 bytes) 2019-12-16T22:45:34.554 INFO:teuthology.orchestra.run.smithi177.stdout:751 read 0xa80a99d thru 0xa816f00 (0xc564 bytes) 2019-12-16T22:45:34.555 INFO:teuthology.orchestra.run.smithi177.stdout:752 writesame 0x6e532ff thru 0x6e5f5a0 data_size 0x7(0xc2a2 bytes) 2019-12-16T22:45:34.585 INFO:teuthology.orchestra.run.smithi177.stdout:808 write 0xb4fee10 thru 0xb503457 (0x4648 bytes) 2019-12-16T22:45:34.585 INFO:teuthology.orchestra.run.smithi177.stdout:754 read 0x6116f26 thru 0x611ed67 (0x7e42 bytes) 2019-12-16T22:45:34.585 INFO:teuthology.orchestra.run.smithi177.stdout:755 read 0x5e49841 thru 0x5e54d41 (0xb501 bytes) 2019-12-16T22:45:34.586 INFO:teuthology.orchestra.run.smithi177.stdout:756 write 0x7ca425 thru 0x7d2241 (0x7e1d bytes) 2019-12-16T22:45:34.586 INFO:teuthology.orchestra.run.smithi177.stdout:1154 write 0x3efa93a thru 0x3efc84e (0x1f15 bytes) 2019-12-16T22:45:34.587 INFO:teuthology.orchestra.run.smithi177.stdout:810 read 0xe05197f thru 0xe056e67 (0x54e9 bytes) 2019-12-16T22:45:34.605 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.606 INFO:teuthology.orchestra.run.smithi177.stdout:1159 read 0x29e3bd3 thru 0x29e41fa (0x628 bytes) 2019-12-16T22:45:34.606 INFO:teuthology.orchestra.run.smithi177.stdout:1160 write 0xd74785d thru 0xd753cd1 (0xc475 bytes) 2019-12-16T22:45:34.612 INFO:teuthology.orchestra.run.smithi177.stdout:814 trunc from 0xee4d41a to 0x11eb6ab 2019-12-16T22:45:34.625 INFO:teuthology.orchestra.run.smithi177.stdout:1161 read 0x90f3ba9 thru 0x90f4b44 (0xf9c bytes) 2019-12-16T22:45:34.632 INFO:teuthology.orchestra.run.smithi177.stdout:757 write 0x19f4845 thru 0x1a01789 (0xcf45 bytes) 2019-12-16T22:45:34.636 INFO:teuthology.orchestra.run.smithi177.stdout:1162 trunc from 0xecad638 to 0x871d510 2019-12-16T22:45:34.666 INFO:teuthology.orchestra.run.smithi177.stdout:411 read 0x2f19bc thru 0x2fbce7 (0xa32c bytes) 2019-12-16T22:45:34.667 INFO:teuthology.orchestra.run.smithi177.stdout:1108 writesame 0xe15fce2 thru 0xe1690b0 data_size 0x1(0x93cf bytes) 2019-12-16T22:45:34.668 INFO:teuthology.orchestra.run.smithi177.stdout:815 read 0x11bb505 thru 0x11c0e09 (0x5905 bytes) 2019-12-16T22:45:34.669 INFO:teuthology.orchestra.run.smithi177.stdout:1109 read 0xc4ec3f3 thru 0xc4f8e34 (0xca42 bytes) 2019-12-16T22:45:34.669 INFO:teuthology.orchestra.run.smithi177.stdout:1111 read 0x758e7d7 thru 0x759c38d (0xdbb7 bytes) 2019-12-16T22:45:34.670 INFO:teuthology.orchestra.run.smithi177.stdout:1112 write 0xb410bf3 thru 0xb419a1a (0x8e28 bytes) 2019-12-16T22:45:34.676 INFO:teuthology.orchestra.run.smithi177.stdout:758 write 0xb77dfcb thru 0xb78d59e (0xf5d4 bytes) 2019-12-16T22:45:34.682 INFO:teuthology.orchestra.run.smithi177.stdout:816 trunc from 0x11eb6ab to 0x8602530 2019-12-16T22:45:34.683 INFO:teuthology.orchestra.run.smithi177.stdout:1163 read 0x17c3dac thru 0x17ce3c2 (0xa617 bytes) 2019-12-16T22:45:34.684 INFO:teuthology.orchestra.run.smithi177.stdout:1113 write 0x8f5ff3c thru 0x8f68055 (0x811a bytes) 2019-12-16T22:45:34.688 INFO:teuthology.orchestra.run.smithi177.stdout:761 read 0xb058507 thru 0xb0596b5 (0x11af bytes) 2019-12-16T22:45:34.690 INFO:teuthology.orchestra.run.smithi177.stdout:763 punch from 0xaaaec8d to 0xaab2e88, (0x41fb bytes) 2019-12-16T22:45:34.690 INFO:teuthology.orchestra.run.smithi177.stdout:764 write 0x24d7563 thru 0x24e1b60 (0xa5fe bytes) 2019-12-16T22:45:34.692 INFO:teuthology.orchestra.run.smithi177.stdout:1116 punch from 0x12c5550 to 0x12cc08a, (0x6b3a bytes) 2019-12-16T22:45:34.697 INFO:teuthology.orchestra.run.smithi177.stdout:1117 trunc from 0xe1690b1 to 0xbd34a89 2019-12-16T22:45:34.700 INFO:teuthology.orchestra.run.smithi177.stdout:765 write 0x7c7d39e thru 0x7c80593 (0x31f6 bytes) 2019-12-16T22:45:34.706 INFO:teuthology.orchestra.run.smithi177.stdout:414 write 0xa46cafd thru 0xa46ee0b (0x230f bytes) 2019-12-16T22:45:34.707 INFO:teuthology.orchestra.run.smithi177.stdout:766 clone 9 order 24 su 8388608 sc 8 2019-12-16T22:45:34.712 INFO:teuthology.orchestra.run.smithi177.stdout:1165 write 0xbd7fdbf thru 0xbd8da1c (0xdc5e bytes) 2019-12-16T22:45:34.716 INFO:teuthology.orchestra.run.smithi177.stdout:415 read 0x5b8bdab thru 0x5b8e4ed (0x2743 bytes) 2019-12-16T22:45:34.716 INFO:teuthology.orchestra.run.smithi177.stdout:416 punch from 0x3afe918 to 0x3b0db99, (0xf281 bytes) 2019-12-16T22:45:34.716 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.716 INFO:teuthology.orchestra.run.smithi177.stdout:420 write 0x2676b7d thru 0x268647c (0xf900 bytes) 2019-12-16T22:45:34.728 INFO:teuthology.orchestra.run.smithi177.stdout:1118 read 0x25f66a6 thru 0x26048a2 (0xe1fd bytes) 2019-12-16T22:45:34.728 INFO:teuthology.orchestra.run.smithi177.stdout:1168 write 0xbcd34df thru 0xbcd68cb (0x33ed bytes) 2019-12-16T22:45:34.730 INFO:teuthology.orchestra.run.smithi177.stdout:817 writesame 0xced7bec thru 0xced927f data_size 0xa(0x1694 bytes) 2019-12-16T22:45:34.732 INFO:teuthology.orchestra.run.smithi177.stdout:421 writesame 0x2d0c12d thru 0x2d0f265 data_size 0x1(0x3139 bytes) 2019-12-16T22:45:34.732 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.732 INFO:teuthology.orchestra.run.smithi177.stdout:819 write 0x6d6d thru 0xa905 (0x3b99 bytes) 2019-12-16T22:45:34.736 INFO:teuthology.orchestra.run.smithi177.stdout:1170 write 0x8a62c47 thru 0x8a71b84 (0xef3e bytes) 2019-12-16T22:45:34.737 INFO:teuthology.orchestra.run.smithi177.stdout:821 writesame 0x3d99338 thru 0x3da150e data_size 0x1(0x81d7 bytes) 2019-12-16T22:45:34.747 INFO:teuthology.orchestra.run.smithi177.stdout:422 writesame 0x8ef240e thru 0x8efc684 data_size 0xb(0xa277 bytes) 2019-12-16T22:45:34.748 INFO:teuthology.orchestra.run.smithi177.stdout:1171 write 0x98fbf15 thru 0x990883f (0xc92b bytes) 2019-12-16T22:45:34.764 INFO:teuthology.orchestra.run.smithi177.stdout:423 read 0x95f6b48 thru 0x95fde47 (0x7300 bytes) 2019-12-16T22:45:34.765 INFO:teuthology.orchestra.run.smithi177.stdout:424 punch from 0x8ce004c to 0x8cef1d3, (0xf187 bytes) 2019-12-16T22:45:34.766 INFO:teuthology.orchestra.run.smithi177.stdout:822 read 0x72f39aa thru 0x72fb577 (0x7bce bytes) 2019-12-16T22:45:34.767 INFO:teuthology.orchestra.run.smithi177.stdout:823 read 0xc9153ed thru 0xc91b9a3 (0x65b7 bytes) 2019-12-16T22:45:34.767 INFO:teuthology.orchestra.run.smithi177.stdout:1119 writesame 0xd00f9c9 thru 0xd019205 data_size 0xb(0x983d bytes) 2019-12-16T22:45:34.767 INFO:teuthology.orchestra.run.smithi177.stdout:824 write 0x2713902 thru 0x27214e6 (0xdbe5 bytes) 2019-12-16T22:45:34.769 INFO:teuthology.orchestra.run.smithi177.stdout:1173 write 0x1994726 thru 0x199f19c (0xaa77 bytes) 2019-12-16T22:45:34.775 INFO:teuthology.orchestra.run.smithi177.stdout:1174 read 0x9ccb61 thru 0x9d6cd6 (0xa176 bytes) 2019-12-16T22:45:34.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.777 INFO:teuthology.orchestra.run.smithi177.stdout:1178 punch from 0xa49b770 to 0xa4aa024, (0xe8b4 bytes) 2019-12-16T22:45:34.777 INFO:teuthology.orchestra.run.smithi177.stdout:1179 read 0x89ab24e thru 0x89ae6b3 (0x3466 bytes) 2019-12-16T22:45:34.784 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.784 INFO:teuthology.orchestra.run.smithi177.stdout:826 write 0x8a58344 thru 0x8a5cfaa (0x4c67 bytes) 2019-12-16T22:45:34.790 INFO:teuthology.orchestra.run.smithi177.stdout:426 writesame 0xa71d0ca thru 0xa72254e data_size 0xb(0x5485 bytes) 2019-12-16T22:45:34.792 INFO:teuthology.orchestra.run.smithi177.stdout:827 write 0xcbd06ed thru 0xcbd3b61 (0x3475 bytes) 2019-12-16T22:45:34.792 INFO:teuthology.orchestra.run.smithi177.stdout:427 write 0x7a59d6c thru 0x7a63a3c (0x9cd1 bytes) 2019-12-16T22:45:34.795 INFO:teuthology.orchestra.run.smithi177.stdout:1120 write 0xd05cef2 thru 0xd05d81f (0x92e bytes) 2019-12-16T22:45:34.800 INFO:teuthology.orchestra.run.smithi177.stdout:828 read 0x298b49f thru 0x2994ee0 (0x9a42 bytes) 2019-12-16T22:45:34.801 INFO:teuthology.orchestra.run.smithi177.stdout:829 flatten 2019-12-16T22:45:34.801 INFO:teuthology.orchestra.run.smithi177.stdout:1181 write 0xc25eef0 thru 0xc264635 (0x5746 bytes) 2019-12-16T22:45:34.804 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.804 INFO:teuthology.orchestra.run.smithi177.stdout:1122 writesame 0x39a9092 thru 0x39b7f06 data_size 0x1d(0xee75 bytes) 2019-12-16T22:45:34.808 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.809 INFO:teuthology.orchestra.run.smithi177.stdout:1183 write 0x9c31c0d thru 0x9c36c92 (0x5086 bytes) 2019-12-16T22:45:34.816 INFO:teuthology.orchestra.run.smithi177.stdout:1185 read 0x1865f3e thru 0x186d824 (0x78e7 bytes) 2019-12-16T22:45:34.827 INFO:teuthology.orchestra.run.smithi177.stdout:1123 trunc from 0xd05d820 to 0x80e4cea 2019-12-16T22:45:34.830 INFO:teuthology.orchestra.run.smithi177.stdout:428 write 0xb5aec74 thru 0xb5b593d (0x6cca bytes) 2019-12-16T22:45:34.832 INFO:teuthology.orchestra.run.smithi177.stdout:1186 trunc from 0xc264636 to 0x5ec1e45 2019-12-16T22:45:34.838 INFO:teuthology.orchestra.run.smithi177.stdout:430 write 0x3692d0d thru 0x36a2750 (0xfa44 bytes) 2019-12-16T22:45:34.844 INFO:teuthology.orchestra.run.smithi177.stdout:832 trunc from 0xced9280 to 0x438a1fa 2019-12-16T22:45:34.857 INFO:teuthology.orchestra.run.smithi177.stdout:1125 read 0x2b587ac thru 0x2b6255e (0x9db3 bytes) 2019-12-16T22:45:34.858 INFO:teuthology.orchestra.run.smithi177.stdout:1126 write 0x78cb657 thru 0x78cb73d (0xe7 bytes) 2019-12-16T22:45:34.864 INFO:teuthology.orchestra.run.smithi177.stdout:1127 punch from 0x28d89b4 to 0x28e8768, (0xfdb4 bytes) 2019-12-16T22:45:34.865 INFO:teuthology.orchestra.run.smithi177.stdout:1128 write 0x2697e56 thru 0x26997fe (0x19a9 bytes) 2019-12-16T22:45:34.878 INFO:teuthology.orchestra.run.smithi177.stdout:431 writesame 0xc5aadd5 thru 0xc5b4b17 data_size 0x1(0x9d43 bytes) 2019-12-16T22:45:34.878 INFO:teuthology.orchestra.run.smithi177.stdout:1129 trunc from 0x80e4cea to 0xa631460 2019-12-16T22:45:34.879 INFO:teuthology.orchestra.run.smithi177.stdout:432 read 0x8f1a6de thru 0x8f2a09f (0xf9c2 bytes) 2019-12-16T22:45:34.880 INFO:teuthology.orchestra.run.smithi177.stdout:433 punch from 0x13db103 to 0x13e7e9a, (0xcd97 bytes) 2019-12-16T22:45:34.883 INFO:teuthology.orchestra.run.smithi177.stdout:833 trunc from 0x438a1fa to 0x8137c08 2019-12-16T22:45:34.898 INFO:teuthology.orchestra.run.smithi177.stdout:1189 write 0x8c8244b thru 0x8c8c58d (0xa143 bytes) 2019-12-16T22:45:34.900 INFO:teuthology.orchestra.run.smithi177.stdout:435 write 0xcb659a1 thru 0xcb74fd8 (0xf638 bytes) 2019-12-16T22:45:34.900 INFO:teuthology.orchestra.run.smithi177.stdout:834 read 0x391c89 thru 0x39667e (0x49f6 bytes) 2019-12-16T22:45:34.900 INFO:teuthology.orchestra.run.smithi177.stdout:1131 punch from 0x5d3eee to 0x5d684e, (0x2960 bytes) 2019-12-16T22:45:34.901 INFO:teuthology.orchestra.run.smithi177.stdout:1133 write 0xa504c5 thru 0xa5a9d9 (0xa515 bytes) 2019-12-16T22:45:34.901 INFO:teuthology.orchestra.run.smithi177.stdout:835 read 0x4b68084 thru 0x4b702b5 (0x8232 bytes) 2019-12-16T22:45:34.902 INFO:teuthology.orchestra.run.smithi177.stdout:836 write 0x71d2bd2 thru 0x71e0e56 (0xe285 bytes) 2019-12-16T22:45:34.912 INFO:teuthology.orchestra.run.smithi177.stdout:1192 trunc from 0x8c8c58e to 0xa363858 2019-12-16T22:45:34.917 INFO:teuthology.orchestra.run.smithi177.stdout:1135 write 0x375e4c4 thru 0x37688e2 (0xa41f bytes) 2019-12-16T22:45:34.917 INFO:teuthology.orchestra.run.smithi177.stdout:436 read 0x89da921 thru 0x89e9917 (0xeff7 bytes) 2019-12-16T22:45:34.926 INFO:teuthology.orchestra.run.smithi177.stdout:837 read 0x6dc6d79 thru 0x6dc9b86 (0x2e0e bytes) 2019-12-16T22:45:34.927 INFO:teuthology.orchestra.run.smithi177.stdout:840 read 0x56731f0 thru 0x567a521 (0x7332 bytes) 2019-12-16T22:45:34.927 INFO:teuthology.orchestra.run.smithi177.stdout:841 writesame 0x6adc158 thru 0x6ae853b data_size 0x15(0xc3e4 bytes) 2019-12-16T22:45:34.928 INFO:teuthology.orchestra.run.smithi177.stdout:1136 write 0x39eca70 thru 0x39f68fa (0x9e8b bytes) 2019-12-16T22:45:34.944 INFO:teuthology.orchestra.run.smithi177.stdout:1137 read 0x61ba983 thru 0x61bf7d8 (0x4e56 bytes) 2019-12-16T22:45:34.944 INFO:teuthology.orchestra.run.smithi177.stdout:1138 read 0x11d4343 thru 0x11db13d (0x6dfb bytes) 2019-12-16T22:45:34.944 INFO:teuthology.orchestra.run.smithi177.stdout:842 read 0x79659d0 thru 0x796a3aa (0x49db bytes) 2019-12-16T22:45:34.945 INFO:teuthology.orchestra.run.smithi177.stdout:843 read 0x57e3c70 thru 0x57e5015 (0x13a6 bytes) 2019-12-16T22:45:34.945 INFO:teuthology.orchestra.run.smithi177.stdout:845 read 0x47f3c28 thru 0x47fbe08 (0x81e1 bytes) 2019-12-16T22:45:34.945 INFO:teuthology.orchestra.run.smithi177.stdout:1193 writesame 0x5c5e6f thru 0x5d5e1e data_size 0x8(0xffb0 bytes) 2019-12-16T22:45:34.946 INFO:teuthology.orchestra.run.smithi177.stdout:1140 read 0x881700b thru 0x8819e91 (0x2e87 bytes) 2019-12-16T22:45:34.946 INFO:teuthology.orchestra.run.smithi177.stdout:1141 punch from 0x8144997 to 0x81544ac, (0xfb15 bytes) 2019-12-16T22:45:34.946 INFO:teuthology.orchestra.run.smithi177.stdout:1142 read 0x63f857b thru 0x63fa05a (0x1ae0 bytes) 2019-12-16T22:45:34.946 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.947 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.947 INFO:teuthology.orchestra.run.smithi177.stdout:1147 write 0x46dbd3c thru 0x46ddf76 (0x223b bytes) 2019-12-16T22:45:34.950 INFO:teuthology.orchestra.run.smithi177.stdout:437 write 0xde9a2be thru 0xdea0b57 (0x689a bytes) 2019-12-16T22:45:34.952 INFO:teuthology.orchestra.run.smithi177.stdout:1194 punch from 0x5b3a83e to 0x5b42d4c, (0x850e bytes) 2019-12-16T22:45:34.955 INFO:teuthology.orchestra.run.smithi177.stdout:1148 write 0x678a123 thru 0x6794de9 (0xacc7 bytes) 2019-12-16T22:45:34.969 INFO:teuthology.orchestra.run.smithi177.stdout:438 read 0x80c0910 thru 0x80cf7eb (0xeedc bytes) 2019-12-16T22:45:34.970 INFO:teuthology.orchestra.run.smithi177.stdout:439 write 0xdbf0450 thru 0xdbf4bbc (0x476d bytes) 2019-12-16T22:45:34.970 INFO:teuthology.orchestra.run.smithi177.stdout:1151 read 0x97be712 thru 0x97c767e (0x8f6d bytes) 2019-12-16T22:45:34.970 INFO:teuthology.orchestra.run.smithi177.stdout:1152 read 0xa1ec61 thru 0xa24e16 (0x61b6 bytes) 2019-12-16T22:45:34.971 INFO:teuthology.orchestra.run.smithi177.stdout:1153 read 0x1d8556f thru 0x1d89dae (0x4840 bytes) 2019-12-16T22:45:34.971 INFO:teuthology.orchestra.run.smithi177.stdout:1154 read 0x988634e thru 0x9887a0d (0x16c0 bytes) 2019-12-16T22:45:34.971 INFO:teuthology.orchestra.run.smithi177.stdout:1156 punch from 0x5ccee88 to 0x5cd0a3d, (0x1bb5 bytes) 2019-12-16T22:45:34.980 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:34.980 INFO:teuthology.orchestra.run.smithi177.stdout:442 punch from 0x8232a2f to 0x823504c, (0x261d bytes) 2019-12-16T22:45:34.980 INFO:teuthology.orchestra.run.smithi177.stdout:443 writesame 0xab87cb8 thru 0xab88edd data_size 0x17(0x1226 bytes) 2019-12-16T22:45:34.981 INFO:teuthology.orchestra.run.smithi177.stdout:1157 trunc from 0xa631460 to 0xe9f0ecc 2019-12-16T22:45:34.983 INFO:teuthology.orchestra.run.smithi177.stdout:1195 write 0xd1d5be9 thru 0xd1e082c (0xac44 bytes) 2019-12-16T22:45:34.986 INFO:teuthology.orchestra.run.smithi177.stdout:847 write 0xebfcde1 thru 0xec09c3d (0xce5d bytes) 2019-12-16T22:45:34.998 INFO:teuthology.orchestra.run.smithi177.stdout:445 punch from 0xc0c4a69 to 0xc0c54e1, (0xa78 bytes) 2019-12-16T22:45:34.998 INFO:teuthology.orchestra.run.smithi177.stdout:446 write 0x630bd6d thru 0x630e253 (0x24e7 bytes) 2019-12-16T22:45:35.004 INFO:teuthology.orchestra.run.smithi177.stdout:1196 punch from 0xc4595fd to 0xc45d814, (0x4217 bytes) 2019-12-16T22:45:35.005 INFO:teuthology.orchestra.run.smithi177.stdout:1198 write 0x8bc9215 thru 0x8bca311 (0x10fd bytes) 2019-12-16T22:45:35.018 INFO:teuthology.orchestra.run.smithi177.stdout:1200 read 0x4947b50 thru 0x4955fcb (0xe47c bytes) 2019-12-16T22:45:35.018 INFO:teuthology.orchestra.run.smithi177.stdout:1201 writesame 0x873ae30 thru 0x873e576 data_size 0x35(0x3747 bytes) 2019-12-16T22:45:35.018 INFO:teuthology.orchestra.run.smithi177.stdout:447 punch from 0x988e219 to 0x989543b, (0x7222 bytes) 2019-12-16T22:45:35.018 INFO:teuthology.orchestra.run.smithi177.stdout:449 write 0x85d07be thru 0x85d1a96 (0x12d9 bytes) 2019-12-16T22:45:35.019 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.019 INFO:teuthology.orchestra.run.smithi177.stdout:451 writesame 0x1e2938d thru 0x1e2f75e data_size 0x3(0x63d2 bytes) 2019-12-16T22:45:35.019 INFO:teuthology.orchestra.run.smithi177.stdout:848 writesame 0x79e09d8 thru 0x79ed5dc data_size 0x1(0xcc05 bytes) 2019-12-16T22:45:35.019 INFO:teuthology.orchestra.run.smithi177.stdout:1158 read 0x829fde0 thru 0x82a9ba9 (0x9dca bytes) 2019-12-16T22:45:35.019 INFO:teuthology.orchestra.run.smithi177.stdout:1160 write 0x6db9f49 thru 0x6dbd8a3 (0x395b bytes) 2019-12-16T22:45:35.022 INFO:teuthology.orchestra.run.smithi177.stdout:1203 read 0x859c9a3 thru 0x85a7fa5 (0xb603 bytes) 2019-12-16T22:45:35.023 INFO:teuthology.orchestra.run.smithi177.stdout:1204 read 0x441706a thru 0x441e1a9 (0x7140 bytes) 2019-12-16T22:45:35.028 INFO:teuthology.orchestra.run.smithi177.stdout:1205 trunc from 0xd1e082d to 0xa2c76eb 2019-12-16T22:45:35.040 INFO:teuthology.orchestra.run.smithi177.stdout:850 write 0x6971b31 thru 0x697a7b1 (0x8c81 bytes) 2019-12-16T22:45:35.042 INFO:teuthology.orchestra.run.smithi177.stdout:452 read 0x6cb8575 thru 0x6cc050b (0x7f97 bytes) 2019-12-16T22:45:35.044 INFO:teuthology.orchestra.run.smithi177.stdout:1161 write 0x12c2673 thru 0x12c3180 (0xb0e bytes) 2019-12-16T22:45:35.051 INFO:teuthology.orchestra.run.smithi177.stdout:851 writesame 0x79b17cb thru 0x79b7ed0 data_size 0x1(0x6706 bytes) 2019-12-16T22:45:35.054 INFO:teuthology.orchestra.run.smithi177.stdout:1162 read 0xa5a2c01 thru 0xa5b0922 (0xdd22 bytes) 2019-12-16T22:45:35.065 INFO:teuthology.orchestra.run.smithi177.stdout:453 writesame 0xe22a655 thru 0xe22ff6c data_size 0x4(0x5918 bytes) 2019-12-16T22:45:35.067 INFO:teuthology.orchestra.run.smithi177.stdout:454 writesame 0x3b2bb35 thru 0x3b36eb7 data_size 0x5b(0xb383 bytes) 2019-12-16T22:45:35.070 INFO:teuthology.orchestra.run.smithi177.stdout:1206 write 0x240b66b thru 0x2414a6f (0x9405 bytes) 2019-12-16T22:45:35.076 INFO:teuthology.orchestra.run.smithi177.stdout:852 punch from 0xd3c8585 to 0xd3ce408, (0x5e83 bytes) 2019-12-16T22:45:35.080 INFO:teuthology.orchestra.run.smithi177.stdout:853 read 0x962d177 thru 0x9636eff (0x9d89 bytes) 2019-12-16T22:45:35.080 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.081 INFO:teuthology.orchestra.run.smithi177.stdout:856 read 0x94eacb thru 0x95a237 (0xb76d bytes) 2019-12-16T22:45:35.081 INFO:teuthology.orchestra.run.smithi177.stdout:1163 trunc from 0xe9f0ecc to 0x3550145 2019-12-16T22:45:35.082 INFO:teuthology.orchestra.run.smithi177.stdout:455 write 0xd57f454 thru 0xd58e4e5 (0xf092 bytes) 2019-12-16T22:45:35.082 INFO:teuthology.orchestra.run.smithi177.stdout:861 trunc from 0xec09c3e to 0xdd10b32 2019-12-16T22:45:35.094 INFO:teuthology.orchestra.run.smithi177.stdout:456 read 0x7187fec thru 0x7193d47 (0xbd5c bytes) 2019-12-16T22:45:35.094 INFO:teuthology.orchestra.run.smithi177.stdout:457 read 0xacfcd0 thru 0xad9401 (0x9732 bytes) 2019-12-16T22:45:35.095 INFO:teuthology.orchestra.run.smithi177.stdout:458 punch from 0xb31f955 to 0xb31fbcd, (0x278 bytes) 2019-12-16T22:45:35.095 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.095 INFO:teuthology.orchestra.run.smithi177.stdout:460 read 0xabdc518 thru 0xabe4623 (0x810c bytes) 2019-12-16T22:45:35.095 INFO:teuthology.orchestra.run.smithi177.stdout:464 write 0x46daf01 thru 0x46e2e79 (0x7f79 bytes) 2019-12-16T22:45:35.105 INFO:teuthology.orchestra.run.smithi177.stdout:1207 write 0xa9e33f6 thru 0xa9e4983 (0x158e bytes) 2019-12-16T22:45:35.109 INFO:teuthology.orchestra.run.smithi177.stdout:465 write 0x86b7be7 thru 0x86c18c8 (0x9ce2 bytes) 2019-12-16T22:45:35.122 INFO:teuthology.orchestra.run.smithi177.stdout:862 read 0x8a9eb92 thru 0x8aa2648 (0x3ab7 bytes) 2019-12-16T22:45:35.122 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.122 INFO:teuthology.orchestra.run.smithi177.stdout:864 write 0x96a5bb5 thru 0x96aca4e (0x6e9a bytes) 2019-12-16T22:45:35.128 INFO:teuthology.orchestra.run.smithi177.stdout:467 read 0x4457a17 thru 0x4463ad2 (0xc0bc bytes) 2019-12-16T22:45:35.129 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.129 INFO:teuthology.orchestra.run.smithi177.stdout:470 write 0xd433077 thru 0xd44103f (0xdfc9 bytes) 2019-12-16T22:45:35.133 INFO:teuthology.orchestra.run.smithi177.stdout:866 punch from 0x24cf68e to 0x24d2f18, (0x388a bytes) 2019-12-16T22:45:35.133 INFO:teuthology.orchestra.run.smithi177.stdout:867 write 0xb76fb48 thru 0xb77ba36 (0xbeef bytes) 2019-12-16T22:45:35.134 INFO:teuthology.orchestra.run.smithi177.stdout:1208 trunc from 0xa9e4984 to 0x33b00fd 2019-12-16T22:45:35.144 INFO:teuthology.orchestra.run.smithi177.stdout:471 trunc from 0xe22ff6d to 0xcdc69e6 2019-12-16T22:45:35.145 INFO:teuthology.orchestra.run.smithi177.stdout:868 read 0x7fc9fc5 thru 0x7fd35ef (0x962b bytes) 2019-12-16T22:45:35.145 INFO:teuthology.orchestra.run.smithi177.stdout:869 write 0x456d419 thru 0x457bdb1 (0xe999 bytes) 2019-12-16T22:45:35.147 INFO:teuthology.orchestra.run.smithi177.stdout:1164 punch from 0x1719543 to 0x1727ab8, (0xe575 bytes) 2019-12-16T22:45:35.166 INFO:teuthology.orchestra.run.smithi177.stdout:871 read 0x88fe40 thru 0x89d5a3 (0xd764 bytes) 2019-12-16T22:45:35.203 INFO:teuthology.orchestra.run.smithi177.stdout:872 read 0x8cad1f8 thru 0x8cb149c (0x42a5 bytes) 2019-12-16T22:45:35.203 INFO:teuthology.orchestra.run.smithi177.stdout:873 read 0x2c9f414 thru 0x2caaed3 (0xbac0 bytes) 2019-12-16T22:45:35.203 INFO:teuthology.orchestra.run.smithi177.stdout:874 read 0xd1027b1 thru 0xd111263 (0xeab3 bytes) 2019-12-16T22:45:35.203 INFO:teuthology.orchestra.run.smithi177.stdout:878 trunc from 0xdd10b32 to 0x1d6adc1 2019-12-16T22:45:35.203 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.204 INFO:teuthology.orchestra.run.smithi177.stdout:1211 punch from 0x170f807 to 0x171a45e, (0xac57 bytes) 2019-12-16T22:45:35.204 INFO:teuthology.orchestra.run.smithi177.stdout:1165 writesame 0xbfe2183 thru 0xbfef3fc data_size 0x1d(0xd27a bytes) 2019-12-16T22:45:35.204 INFO:teuthology.orchestra.run.smithi177.stdout:472 read 0x864391c thru 0x86469cd (0x30b2 bytes) 2019-12-16T22:45:35.204 INFO:teuthology.orchestra.run.smithi177.stdout:473 writesame 0x5536b10 thru 0x553f603 data_size 0x2(0x8af4 bytes) 2019-12-16T22:45:35.217 INFO:teuthology.orchestra.run.smithi177.stdout:1167 write 0xd5959a9 thru 0xd595e32 (0x48a bytes) 2019-12-16T22:45:35.218 INFO:teuthology.orchestra.run.smithi177.stdout:1212 writesame 0xc2859ba thru 0xc2952a9 data_size 0x38(0xf8f0 bytes) 2019-12-16T22:45:35.223 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.223 INFO:teuthology.orchestra.run.smithi177.stdout:1215 write 0x91a9042 thru 0x91b1076 (0x8035 bytes) 2019-12-16T22:45:35.228 INFO:teuthology.orchestra.run.smithi177.stdout:474 write 0xdb583a1 thru 0xdb653e0 (0xd040 bytes) 2019-12-16T22:45:35.235 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.235 INFO:teuthology.orchestra.run.smithi177.stdout:1217 write 0x9efb12a thru 0x9f06278 (0xb14f bytes) 2019-12-16T22:45:35.240 INFO:teuthology.orchestra.run.smithi177.stdout:880 punch from 0x97968b to 0x985214, (0xbb89 bytes) 2019-12-16T22:45:35.240 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.240 INFO:teuthology.orchestra.run.smithi177.stdout:882 read 0x146704e thru 0x14739d1 (0xc984 bytes) 2019-12-16T22:45:35.245 INFO:teuthology.orchestra.run.smithi177.stdout:1168 trunc from 0xd595e33 to 0x2319135 2019-12-16T22:45:35.245 INFO:teuthology.orchestra.run.smithi177.stdout:883 trunc from 0x1d6adc1 to 0x54a9099 2019-12-16T22:45:35.250 INFO:teuthology.orchestra.run.smithi177.stdout:1218 read 0x40fb6e8 thru 0x410afb2 (0xf8cb bytes) 2019-12-16T22:45:35.250 INFO:teuthology.orchestra.run.smithi177.stdout:1219 writesame 0x4a4eba0 thru 0x4a5767c data_size 0x1(0x8add bytes) 2019-12-16T22:45:35.263 INFO:teuthology.orchestra.run.smithi177.stdout:884 punch from 0x2879190 to 0x28888f5, (0xf765 bytes) 2019-12-16T22:45:35.283 INFO:teuthology.orchestra.run.smithi177.stdout:1220 write 0xb094ead thru 0xb095672 (0x7c6 bytes) 2019-12-16T22:45:35.283 INFO:teuthology.orchestra.run.smithi177.stdout:887 write 0x771d354 thru 0x7728dc1 (0xba6e bytes) 2019-12-16T22:45:35.294 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.294 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.294 INFO:teuthology.orchestra.run.smithi177.stdout:1224 write 0xbb052cc thru 0xbb0ef56 (0x9c8b bytes) 2019-12-16T22:45:35.305 INFO:teuthology.orchestra.run.smithi177.stdout:1226 read 0x664bbd7 thru 0x6655896 (0x9cc0 bytes) 2019-12-16T22:45:35.306 INFO:teuthology.orchestra.run.smithi177.stdout:888 punch from 0x5e612bd to 0x5e6f9fa, (0xe73d bytes) 2019-12-16T22:45:35.306 INFO:teuthology.orchestra.run.smithi177.stdout:889 read 0x42c2400 thru 0x42cefa5 (0xcba6 bytes) 2019-12-16T22:45:35.307 INFO:teuthology.orchestra.run.smithi177.stdout:891 read 0x26182ba thru 0x26282b3 (0xfffa bytes) 2019-12-16T22:45:35.308 INFO:teuthology.orchestra.run.smithi177.stdout:475 writesame 0xe7a93eb thru 0xe7acd7d data_size 0x11(0x3993 bytes) 2019-12-16T22:45:35.311 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.311 INFO:teuthology.orchestra.run.smithi177.stdout:477 read 0xa37ddec thru 0xa384f2a (0x713f bytes) 2019-12-16T22:45:35.312 INFO:teuthology.orchestra.run.smithi177.stdout:478 writesame 0xc9985f9 thru 0xc99e898 data_size 0x30(0x62a0 bytes) 2019-12-16T22:45:35.312 INFO:teuthology.orchestra.run.smithi177.stdout:892 trunc from 0x7728dc2 to 0x5e6b464 2019-12-16T22:45:35.325 INFO:teuthology.orchestra.run.smithi177.stdout:1227 trunc from 0xc2952aa to 0x7af8907 2019-12-16T22:45:35.325 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.326 INFO:teuthology.orchestra.run.smithi177.stdout:480 punch from 0x53e5df9 to 0x53eee6b, (0x9072 bytes) 2019-12-16T22:45:35.336 INFO:teuthology.orchestra.run.smithi177.stdout:483 trunc from 0xe7acd7e to 0x50a87a3 2019-12-16T22:45:35.338 INFO:teuthology.orchestra.run.smithi177.stdout:893 write 0x16a82e8 thru 0x16a8d8b (0xaa4 bytes) 2019-12-16T22:45:35.346 INFO:teuthology.orchestra.run.smithi177.stdout:894 write 0x33e4697 thru 0x33e554b (0xeb5 bytes) 2019-12-16T22:45:35.354 INFO:teuthology.orchestra.run.smithi177.stdout:1169 write 0x514c452 thru 0x515a3ce (0xdf7d bytes) 2019-12-16T22:45:35.369 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.369 INFO:teuthology.orchestra.run.smithi177.stdout:1171 read 0x49c0b6 thru 0x49e9df (0x292a bytes) 2019-12-16T22:45:35.371 INFO:teuthology.orchestra.run.smithi177.stdout:1172 write 0x2de1e1b thru 0x2debf52 (0xa138 bytes) 2019-12-16T22:45:35.377 INFO:teuthology.orchestra.run.smithi177.stdout:895 trunc from 0x5e6b464 to 0xd34c105 2019-12-16T22:45:35.382 INFO:teuthology.orchestra.run.smithi177.stdout:1173 write 0x3c9e09f thru 0x3ca22db (0x423d bytes) 2019-12-16T22:45:35.385 INFO:teuthology.orchestra.run.smithi177.stdout:485 punch from 0x128e67b to 0x1292cf1, (0x4676 bytes) 2019-12-16T22:45:35.391 INFO:teuthology.orchestra.run.smithi177.stdout:1176 read 0x44183e1 thru 0x4419c3b (0x185b bytes) 2019-12-16T22:45:35.391 INFO:teuthology.orchestra.run.smithi177.stdout:486 trunc from 0x50a87a3 to 0x20899d6 2019-12-16T22:45:35.392 INFO:teuthology.orchestra.run.smithi177.stdout:1228 write 0xabb0888 thru 0xabbf823 (0xef9c bytes) 2019-12-16T22:45:35.407 INFO:teuthology.orchestra.run.smithi177.stdout:897 punch from 0x30c7360 to 0x30c957f, (0x221f bytes) 2019-12-16T22:45:35.407 INFO:teuthology.orchestra.run.smithi177.stdout:898 read 0xb03f6e6 thru 0xb04b3ba (0xbcd5 bytes) 2019-12-16T22:45:35.407 INFO:teuthology.orchestra.run.smithi177.stdout:899 write 0x639f65b thru 0x63a6a7b (0x7421 bytes) 2019-12-16T22:45:35.408 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.420 INFO:teuthology.orchestra.run.smithi177.stdout:900 write 0xb82ec25 thru 0xb830310 (0x16ec bytes) 2019-12-16T22:45:35.424 INFO:teuthology.orchestra.run.smithi177.stdout:1177 writesame 0x696c461 thru 0x69710c4 data_size 0x2(0x4c64 bytes) 2019-12-16T22:45:35.429 INFO:teuthology.orchestra.run.smithi177.stdout:1179 writesame 0x1b963ba thru 0x1b9a417 data_size 0x16(0x405e bytes) 2019-12-16T22:45:35.430 INFO:teuthology.orchestra.run.smithi177.stdout:901 write 0xbfe6b47 thru 0xbfe9cfa (0x31b4 bytes) 2019-12-16T22:45:35.432 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #7, image image_cluster1.client.mirror.3-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent8 2019-12-16T22:45:35.434 INFO:teuthology.orchestra.run.smithi177.stdout:1233 write 0xb816b0c thru 0xb8195b0 (0x2aa5 bytes) 2019-12-16T22:45:35.438 INFO:teuthology.orchestra.run.smithi177.stdout:1180 write 0x2699518 thru 0x26a7585 (0xe06e bytes) 2019-12-16T22:45:35.440 INFO:teuthology.orchestra.run.smithi177.stdout:902 punch from 0x82f4ad0 to 0x82fb0f9, (0x6629 bytes) 2019-12-16T22:45:35.444 INFO:teuthology.orchestra.run.smithi177.stdout:1234 write 0x64c5fb9 thru 0x64caa6a (0x4ab2 bytes) 2019-12-16T22:45:35.446 INFO:teuthology.orchestra.run.smithi177.stdout:1181 read 0x58ac71d thru 0x58b6263 (0x9b47 bytes) 2019-12-16T22:45:35.446 INFO:teuthology.orchestra.run.smithi177.stdout:1182 read 0x3e02cfc thru 0x3e0cba0 (0x9ea5 bytes) 2019-12-16T22:45:35.447 INFO:teuthology.orchestra.run.smithi177.stdout:903 trunc from 0xd34c105 to 0x9a866d6 2019-12-16T22:45:35.452 INFO:teuthology.orchestra.run.smithi177.stdout:1235 writesame 0x4ec9cf0 thru 0x4ecef00 data_size 0x2f(0x5211 bytes) 2019-12-16T22:45:35.462 INFO:teuthology.orchestra.run.smithi177.stdout:489 write 0x6f539d8 thru 0x6f5731d (0x3946 bytes) 2019-12-16T22:45:35.466 INFO:teuthology.orchestra.run.smithi177.stdout:994 punch from 0x95dfcb to 0x968ca6, (0xacdb bytes) 2019-12-16T22:45:35.470 INFO:teuthology.orchestra.run.smithi177.stdout:490 write 0x3565b0b thru 0x357391e (0xde14 bytes) 2019-12-16T22:45:35.478 INFO:teuthology.orchestra.run.smithi177.stdout:1183 write 0x93274b8 thru 0x933200c (0xab55 bytes) 2019-12-16T22:45:35.484 INFO:teuthology.orchestra.run.smithi177.stdout:905 writesame 0x55266ad thru 0x552888c data_size 0x10(0x21e0 bytes) 2019-12-16T22:45:35.486 INFO:teuthology.orchestra.run.smithi177.stdout:996 read 0xbb9799d thru 0xbb99fcb (0x262f bytes) 2019-12-16T22:45:35.489 INFO:teuthology.orchestra.run.smithi177.stdout:1185 read 0x71b9e7d thru 0x71c68ec (0xca70 bytes) 2019-12-16T22:45:35.490 INFO:teuthology.orchestra.run.smithi177.stdout:1186 read 0x51ed934 thru 0x51fd7dd (0xfeaa bytes) 2019-12-16T22:45:35.490 INFO:teuthology.orchestra.run.smithi177.stdout:1188 write 0x5cbe1d4 thru 0x5cc7f34 (0x9d61 bytes) 2019-12-16T22:45:35.492 INFO:teuthology.orchestra.run.smithi177.stdout:1236 write 0xba5643e thru 0xba5a492 (0x4055 bytes) 2019-12-16T22:45:35.493 INFO:teuthology.orchestra.run.smithi177.stdout:491 punch from 0x2974748 to 0x2979658, (0x4f10 bytes) 2019-12-16T22:45:35.493 INFO:teuthology.orchestra.run.smithi177.stdout:492 writesame 0x6a5ecab thru 0x6a651da data_size 0x8(0x6530 bytes) 2019-12-16T22:45:35.505 INFO:teuthology.orchestra.run.smithi177.stdout:1190 read 0x62d355d thru 0x62dee3e (0xb8e2 bytes) 2019-12-16T22:45:35.506 INFO:teuthology.orchestra.run.smithi177.stdout:1191 read 0x28fc8a0 thru 0x28ffe83 (0x35e4 bytes) 2019-12-16T22:45:35.506 INFO:teuthology.orchestra.run.smithi177.stdout:1192 read 0x8ab9658 thru 0x8abfdaa (0x6753 bytes) 2019-12-16T22:45:35.506 INFO:teuthology.orchestra.run.smithi177.stdout:1193 writesame 0x150dc56 thru 0x1510889 data_size 0x52(0x2c34 bytes) 2019-12-16T22:45:35.506 INFO:teuthology.orchestra.run.smithi177.stdout:1237 read 0xc7655e thru 0xc7f4ca (0x8f6d bytes) 2019-12-16T22:45:35.507 INFO:teuthology.orchestra.run.smithi177.stdout:1238 punch from 0x41421e1 to 0x4150932, (0xe751 bytes) 2019-12-16T22:45:35.508 INFO:teuthology.orchestra.run.smithi177.stdout:1239 write 0xe5c872 thru 0xe5ed4e (0x24dd bytes) 2019-12-16T22:45:35.511 INFO:teuthology.orchestra.run.smithi177.stdout:1240 read 0x9ca0e0b thru 0x9ca3b86 (0x2d7c bytes) 2019-12-16T22:45:35.511 INFO:teuthology.orchestra.run.smithi177.stdout:1242 write 0xb44193f thru 0xb44a625 (0x8ce7 bytes) 2019-12-16T22:45:35.514 INFO:teuthology.orchestra.run.smithi177.stdout:1194 punch from 0x1925f6e to 0x192ccff, (0x6d91 bytes) 2019-12-16T22:45:35.514 INFO:teuthology.orchestra.run.smithi177.stdout:1195 write 0x14f47da thru 0x14fe302 (0x9b29 bytes) 2019-12-16T22:45:35.514 INFO:teuthology.orchestra.run.smithi177.stdout:997 trunc from 0xdd38964 to 0x189be2b 2019-12-16T22:45:35.524 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.525 INFO:teuthology.orchestra.run.smithi177.stdout:1200 write 0x7d37670 thru 0x7d41c09 (0xa59a bytes) 2019-12-16T22:45:35.525 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.525 INFO:teuthology.orchestra.run.smithi177.stdout:1244 punch from 0x7545068 to 0x7549c70, (0x4c08 bytes) 2019-12-16T22:45:35.525 INFO:teuthology.orchestra.run.smithi177.stdout:1245 read 0x10beb4b thru 0x10c7708 (0x8bbe bytes) 2019-12-16T22:45:35.526 INFO:teuthology.orchestra.run.smithi177.stdout:1246 read 0x6a868ab thru 0x6a9468a (0xdde0 bytes) 2019-12-16T22:45:35.526 INFO:teuthology.orchestra.run.smithi177.stdout:1248 read 0xb8032c6 thru 0xb80c728 (0x9463 bytes) 2019-12-16T22:45:35.527 INFO:teuthology.orchestra.run.smithi177.stdout:1252 write 0x1691a72 thru 0x16a0f09 (0xf498 bytes) 2019-12-16T22:45:35.535 INFO:teuthology.orchestra.run.smithi177.stdout:906 writesame 0xd578293 thru 0xd578348 data_size 0x7(0xb6 bytes) 2019-12-16T22:45:35.544 INFO:teuthology.orchestra.run.smithi177.stdout:1253 trunc from 0xba5a493 to 0x9ec4f0f 2019-12-16T22:45:35.544 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.545 INFO:teuthology.orchestra.run.smithi177.stdout:908 writesame 0x7143cb1 thru 0x71460c1 data_size 0x1(0x2411 bytes) 2019-12-16T22:45:35.553 INFO:teuthology.orchestra.run.smithi177.stdout:909 write 0x4c807cd thru 0x4c88960 (0x8194 bytes) 2019-12-16T22:45:35.554 INFO:teuthology.orchestra.run.smithi177.stdout:493 write 0xe540fd9 thru 0xe54457d (0x35a5 bytes) 2019-12-16T22:45:35.554 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone8 from 0xb7df821 (overlap 0xb5817da) to 0x6ce74b6 2019-12-16T22:45:35.566 INFO:teuthology.orchestra.run.smithi177.stdout:494 trunc from 0xe54457e to 0xe1cb9b4 2019-12-16T22:45:35.574 INFO:teuthology.orchestra.run.smithi177.stdout:913 punch from 0x1380e78 to 0x1384118, (0x32a0 bytes) 2019-12-16T22:45:35.575 INFO:teuthology.orchestra.run.smithi177.stdout:914 write 0x13afe89 thru 0x13b49dd (0x4b55 bytes) 2019-12-16T22:45:35.583 INFO:teuthology.orchestra.run.smithi177.stdout:998 read 0x1715ac0 thru 0x1720704 (0xac45 bytes) 2019-12-16T22:45:35.584 INFO:teuthology.orchestra.run.smithi177.stdout:999 trunc from 0x189be2b to 0x17d690c 2019-12-16T22:45:35.605 INFO:teuthology.orchestra.run.smithi177.stdout:1254 punch from 0x703e26e to 0x7042889, (0x461b bytes) 2019-12-16T22:45:35.605 INFO:teuthology.orchestra.run.smithi177.stdout:1255 writesame 0x381faac thru 0x382a760 data_size 0x13(0xacb5 bytes) 2019-12-16T22:45:35.609 INFO:teuthology.orchestra.run.smithi177.stdout:1201 writesame 0xe5a2c8a thru 0xe5ac02f data_size 0x1(0x93a6 bytes) 2019-12-16T22:45:35.614 INFO:teuthology.orchestra.run.smithi177.stdout:1202 read 0xc558a4 thru 0xc5c1ef (0x694c bytes) 2019-12-16T22:45:35.614 INFO:teuthology.orchestra.run.smithi177.stdout:1203 writesame 0x1a13531 thru 0x1a1e145 data_size 0x1(0xac15 bytes) 2019-12-16T22:45:35.655 INFO:teuthology.orchestra.run.smithi177.stdout:1204 punch from 0xa778b1b to 0xa786c9a, (0xe17f bytes) 2019-12-16T22:45:35.656 INFO:teuthology.orchestra.run.smithi177.stdout:1206 writesame 0xba93d6 thru 0xbafc8a data_size 0x5(0x68b5 bytes) 2019-12-16T22:45:35.670 INFO:teuthology.orchestra.run.smithi177.stdout:916 writesame 0xddd373c thru 0xddd565e data_size 0x1(0x1f23 bytes) 2019-12-16T22:45:35.674 INFO:teuthology.orchestra.run.smithi177.stdout:917 punch from 0x77122c3 to 0x771b7d5, (0x9512 bytes) 2019-12-16T22:45:35.675 INFO:teuthology.orchestra.run.smithi177.stdout:920 write 0x7fa63a2 thru 0x7fabfcd (0x5c2c bytes) 2019-12-16T22:45:35.679 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.679 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.679 INFO:teuthology.orchestra.run.smithi177.stdout:1256 write 0xb9bba29 thru 0xb9c4fb6 (0x958e bytes) 2019-12-16T22:45:35.688 INFO:teuthology.orchestra.run.smithi177.stdout:1002 punch from 0x7c9f49 to 0x7d303a, (0x90f1 bytes) 2019-12-16T22:45:35.688 INFO:teuthology.orchestra.run.smithi177.stdout:1003 read 0x4b922a thru 0x4c5822 (0xc5f9 bytes) 2019-12-16T22:45:35.690 INFO:teuthology.orchestra.run.smithi177.stdout:1257 write 0x4d576b7 thru 0x4d5f640 (0x7f8a bytes) 2019-12-16T22:45:35.691 INFO:teuthology.orchestra.run.smithi177.stdout:921 punch from 0x106c278 to 0x1079aa9, (0xd831 bytes) 2019-12-16T22:45:35.691 INFO:teuthology.orchestra.run.smithi177.stdout:922 write 0xd4f95b8 thru 0xd505008 (0xba51 bytes) 2019-12-16T22:45:35.691 INFO:teuthology.orchestra.run.smithi177.stdout:1004 read 0xe4f6d thru 0xf2f42 (0xdfd6 bytes) 2019-12-16T22:45:35.694 INFO:teuthology.orchestra.run.smithi177.stdout:1005 punch from 0x15d0c18 to 0x15de961, (0xdd49 bytes) 2019-12-16T22:45:35.695 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.695 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.696 INFO:teuthology.orchestra.run.smithi177.stdout:1258 write 0x792c672 thru 0x792fb0a (0x3499 bytes) 2019-12-16T22:45:35.720 INFO:teuthology.orchestra.run.smithi177.stdout:496 trunc from 0xe1cb9b4 to 0x146e744 2019-12-16T22:45:35.721 INFO:teuthology.orchestra.run.smithi177.stdout:924 write 0xcab38e9 thru 0xcac0b35 (0xd24d bytes) 2019-12-16T22:45:35.721 INFO:teuthology.orchestra.run.smithi177.stdout:1211 trunc from 0xe5ac030 to 0x112eeea 2019-12-16T22:45:35.721 INFO:teuthology.orchestra.run.smithi177.stdout:1259 read 0x724f760 thru 0x7254d14 (0x55b5 bytes) 2019-12-16T22:45:35.721 INFO:teuthology.orchestra.run.smithi177.stdout:1260 writesame 0x5ba1d3d thru 0x5bae575 data_size 0x1(0xc839 bytes) 2019-12-16T22:45:35.724 INFO:teuthology.orchestra.run.smithi177.stdout:1010 write 0x2e555ca thru 0x2e58938 (0x336f bytes) 2019-12-16T22:45:35.745 INFO:teuthology.orchestra.run.smithi177.stdout:925 writesame 0x7c2acae thru 0x7c2deae data_size 0x11(0x3201 bytes) 2019-12-16T22:45:35.754 INFO:teuthology.orchestra.run.smithi177.stdout:926 punch from 0xd881f67 to 0xd89179e, (0xf837 bytes) 2019-12-16T22:45:35.754 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.756 INFO:teuthology.orchestra.run.smithi177.stdout:1261 write 0x3f2df4e thru 0x3f3d996 (0xfa49 bytes) 2019-12-16T22:45:35.768 INFO:teuthology.orchestra.run.smithi177.stdout:1262 trunc from 0xb9c4fb7 to 0xa8ffa36 2019-12-16T22:45:35.776 INFO:teuthology.orchestra.run.smithi177.stdout:927 trunc from 0xddd565f to 0x2548a98 2019-12-16T22:45:35.804 INFO:teuthology.orchestra.run.smithi177.stdout:1263 read 0x3ab167a thru 0x3abcd92 (0xb719 bytes) 2019-12-16T22:45:35.804 INFO:teuthology.orchestra.run.smithi177.stdout:1265 read 0x97b2a40 thru 0x97b9c35 (0x71f6 bytes) 2019-12-16T22:45:35.806 INFO:teuthology.orchestra.run.smithi177.stdout:497 write 0x8efcdab thru 0x8efeda2 (0x1ff8 bytes) 2019-12-16T22:45:35.806 INFO:teuthology.orchestra.run.smithi177.stdout:1013 write 0xe1f06b6 thru 0xe1f92ee (0x8c39 bytes) 2019-12-16T22:45:35.808 INFO:teuthology.orchestra.run.smithi177.stdout:1267 trunc from 0xa8ffa36 to 0x8c9fc3b 2019-12-16T22:45:35.816 INFO:teuthology.orchestra.run.smithi177.stdout:498 read 0x312fe02 thru 0x3134742 (0x4941 bytes) 2019-12-16T22:45:35.816 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.816 INFO:teuthology.orchestra.run.smithi177.stdout:501 read 0x6ae7fad thru 0x6af7c02 (0xfc56 bytes) 2019-12-16T22:45:35.816 INFO:teuthology.orchestra.run.smithi177.stdout:502 write 0x4085b0b thru 0x4086b0d (0x1003 bytes) 2019-12-16T22:45:35.822 INFO:teuthology.orchestra.run.smithi177.stdout:503 punch from 0x65755dd to 0x6581490, (0xbeb3 bytes) 2019-12-16T22:45:35.836 INFO:teuthology.orchestra.run.smithi177.stdout:1014 trunc from 0xe1f92ef to 0xb4bcc5a 2019-12-16T22:45:35.837 INFO:teuthology.orchestra.run.smithi177.stdout:1268 read 0x6add688 thru 0x6aea217 (0xcb90 bytes) 2019-12-16T22:45:35.837 INFO:teuthology.orchestra.run.smithi177.stdout:1269 trunc from 0x8c9fc3b to 0x779d86b 2019-12-16T22:45:35.837 INFO:teuthology.orchestra.run.smithi177.stdout:504 trunc from 0x8efeda3 to 0xbdd7b25 2019-12-16T22:45:35.837 INFO:teuthology.orchestra.run.smithi177.stdout:1212 trunc from 0x112eeea to 0xe56ea10 2019-12-16T22:45:35.854 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.854 INFO:teuthology.orchestra.run.smithi177.stdout:508 read 0xaf964de thru 0xaf986ae (0x21d1 bytes) 2019-12-16T22:45:35.855 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.856 INFO:teuthology.orchestra.run.smithi177.stdout:1213 punch from 0x8ad1645 to 0x8adfc4c, (0xe607 bytes) 2019-12-16T22:45:35.856 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.857 INFO:teuthology.orchestra.run.smithi177.stdout:1215 punch from 0x3329c35 to 0x33348fb, (0xacc6 bytes) 2019-12-16T22:45:35.857 INFO:teuthology.orchestra.run.smithi177.stdout:1216 punch from 0x2b7c3ef to 0x2b800e0, (0x3cf1 bytes) 2019-12-16T22:45:35.857 INFO:teuthology.orchestra.run.smithi177.stdout:1218 read 0x4015669 thru 0x4015d3e (0x6d6 bytes) 2019-12-16T22:45:35.857 INFO:teuthology.orchestra.run.smithi177.stdout:1219 write 0xc5e9d2c thru 0xc5f217d (0x8452 bytes) 2019-12-16T22:45:35.864 INFO:teuthology.orchestra.run.smithi177.stdout:928 writesame 0xdbcd674 thru 0xdbdb14b data_size 0x8(0xdad8 bytes) 2019-12-16T22:45:35.867 INFO:teuthology.orchestra.run.smithi177.stdout:1220 write 0x2254263 thru 0x225c60f (0x83ad bytes) 2019-12-16T22:45:35.867 INFO:teuthology.orchestra.run.smithi177.stdout:930 punch from 0x48334ae to 0x483dc01, (0xa753 bytes) 2019-12-16T22:45:35.867 INFO:teuthology.orchestra.run.smithi177.stdout:931 write 0xa7f6224 thru 0xa7f625f (0x3c bytes) 2019-12-16T22:45:35.870 INFO:teuthology.orchestra.run.smithi177.stdout:1016 trunc from 0xb4bcc5a to 0x467bd61 2019-12-16T22:45:35.876 INFO:teuthology.orchestra.run.smithi177.stdout:1222 read 0xa759c74 thru 0xa765bcd (0xbf5a bytes) 2019-12-16T22:45:35.876 INFO:teuthology.orchestra.run.smithi177.stdout:1223 read 0xb302f4d thru 0xb30dc78 (0xad2c bytes) 2019-12-16T22:45:35.876 INFO:teuthology.orchestra.run.smithi177.stdout:1224 punch from 0x72bfdc7 to 0x72c4a4d, (0x4c86 bytes) 2019-12-16T22:45:35.877 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.877 INFO:teuthology.orchestra.run.smithi177.stdout:1226 read 0xb0cc92c thru 0xb0dae7f (0xe554 bytes) 2019-12-16T22:45:35.877 INFO:teuthology.orchestra.run.smithi177.stdout:1230 writesame 0x5adaea8 thru 0x5adeb66 data_size 0x1(0x3cbf bytes) 2019-12-16T22:45:35.879 INFO:teuthology.orchestra.run.smithi177.stdout:509 write 0xd7bcaa5 thru 0xd7c329a (0x67f6 bytes) 2019-12-16T22:45:35.881 INFO:teuthology.orchestra.run.smithi177.stdout:1271 write 0xb550c1f thru 0xb558eab (0x828d bytes) 2019-12-16T22:45:35.892 INFO:teuthology.orchestra.run.smithi177.stdout:1232 writesame 0x968b42a thru 0x968e643 data_size 0x35(0x321a bytes) 2019-12-16T22:45:35.894 INFO:teuthology.orchestra.run.smithi177.stdout:510 read 0x491ce1e thru 0x4920974 (0x3b57 bytes) 2019-12-16T22:45:35.894 INFO:teuthology.orchestra.run.smithi177.stdout:512 writesame 0x1e6554b thru 0x1e71d9a data_size 0x28(0xc850 bytes) 2019-12-16T22:45:35.896 INFO:teuthology.orchestra.run.smithi177.stdout:1272 write 0x7d68bfd thru 0x7d77950 (0xed54 bytes) 2019-12-16T22:45:35.896 INFO:teuthology.orchestra.run.smithi177.stdout:933 trunc from 0xdbdb14c to 0x105c0d0 2019-12-16T22:45:35.901 INFO:teuthology.orchestra.run.smithi177.stdout:1233 write 0x956d0d4 thru 0x9573794 (0x66c1 bytes) 2019-12-16T22:45:35.908 INFO:teuthology.orchestra.run.smithi177.stdout:1281 read 0x6dbc4b7 thru 0x6dc71ff (0xad49 bytes) 2019-12-16T22:45:35.929 INFO:teuthology.orchestra.run.smithi177.stdout:513 read 0x5b06006 thru 0x5b0cf7c (0x6f77 bytes) 2019-12-16T22:45:35.929 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.930 INFO:teuthology.orchestra.run.smithi177.stdout:515 write 0x16903ea thru 0x1696bae (0x67c5 bytes) 2019-12-16T22:45:35.930 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:35.930 INFO:teuthology.orchestra.run.smithi177.stdout:1235 read 0x917fa23 thru 0x91829e7 (0x2fc5 bytes) 2019-12-16T22:45:35.930 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #7, image image_cluster1.client.mirror.5-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent8 2019-12-16T22:45:35.931 INFO:teuthology.orchestra.run.smithi177.stdout:1282 trunc from 0xb558eac to 0x2c97c0a 2019-12-16T22:45:35.931 INFO:teuthology.orchestra.run.smithi177.stdout:936 read 0x5f4eaa thru 0x5fe530 (0x9687 bytes) 2019-12-16T22:45:35.932 INFO:teuthology.orchestra.run.smithi177.stdout:938 read 0x3eb99d thru 0x3eba2f (0x93 bytes) 2019-12-16T22:45:35.933 INFO:teuthology.orchestra.run.smithi177.stdout:940 read 0x8088c2 thru 0x80c57f (0x3cbe bytes) 2019-12-16T22:45:35.934 INFO:teuthology.orchestra.run.smithi177.stdout:941 write 0x41ad23 thru 0x4298a5 (0xeb83 bytes) 2019-12-16T22:45:35.935 INFO:teuthology.orchestra.run.smithi177.stdout:517 trunc from 0xd7c329b to 0x5eb16aa 2019-12-16T22:45:35.936 INFO:teuthology.orchestra.run.smithi177.stdout:1236 trunc from 0xe56ea10 to 0x20461d3 2019-12-16T22:45:35.946 INFO:teuthology.orchestra.run.smithi177.stdout:942 read 0x8d79f0 thru 0x8e2b03 (0xb114 bytes) 2019-12-16T22:45:35.954 INFO:teuthology.orchestra.run.smithi177.stdout:944 punch from 0x353781 to 0x3553e1, (0x1c60 bytes) 2019-12-16T22:45:35.971 INFO:teuthology.orchestra.run.smithi177.stdout:518 writesame 0x1c9e24e thru 0x1cab71f data_size 0x1(0xd4d2 bytes) 2019-12-16T22:45:35.976 INFO:teuthology.orchestra.run.smithi177.stdout:767 writesame 0x5cfb48 thru 0x5d75a5 data_size 0x2e(0x7a5e bytes) 2019-12-16T22:45:35.985 INFO:teuthology.orchestra.run.smithi177.stdout:946 writesame 0x7ca0963 thru 0x7cad803 data_size 0xd(0xcea1 bytes) 2019-12-16T22:45:35.989 INFO:teuthology.orchestra.run.smithi177.stdout:947 write 0x3eea35a thru 0x3ef5749 (0xb3f0 bytes) 2019-12-16T22:45:36.005 INFO:teuthology.orchestra.run.smithi177.stdout:948 clone 8 order 23 su 524288 sc 7 2019-12-16T22:45:36.011 INFO:teuthology.orchestra.run.smithi177.stdout:519 writesame 0x4e479c5 thru 0x4e4d878 data_size 0x1d(0x5eb4 bytes) 2019-12-16T22:45:36.016 INFO:teuthology.orchestra.run.smithi177.stdout:1283 write 0x6976e74 thru 0x698091d (0x9aaa bytes) 2019-12-16T22:45:36.019 INFO:teuthology.orchestra.run.smithi177.stdout:1237 write 0x8fe3c56 thru 0x8fe9613 (0x59be bytes) 2019-12-16T22:45:36.030 INFO:teuthology.orchestra.run.smithi177.stdout:1238 write 0x4b70761 thru 0x4b76eb3 (0x6753 bytes) 2019-12-16T22:45:36.030 INFO:teuthology.orchestra.run.smithi177.stdout:1284 read 0x4874edd thru 0x4879dc4 (0x4ee8 bytes) 2019-12-16T22:45:36.030 INFO:teuthology.orchestra.run.smithi177.stdout:1285 punch from 0x3b0f8d4 to 0x3b19758, (0x9e84 bytes) 2019-12-16T22:45:36.032 INFO:teuthology.orchestra.run.smithi177.stdout:1286 trunc from 0x698091e to 0x52f61ad 2019-12-16T22:45:36.033 INFO:teuthology.orchestra.run.smithi177.stdout:770 writesame 0x5316490 thru 0x531bc20 data_size 0x1(0x5791 bytes) 2019-12-16T22:45:36.037 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.037 INFO:teuthology.orchestra.run.smithi177.stdout:1240 read 0x2d4f7c0 thru 0x2d547eb (0x502c bytes) 2019-12-16T22:45:36.037 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.037 INFO:teuthology.orchestra.run.smithi177.stdout:1242 read 0x4dec05c thru 0x4decdad (0xd52 bytes) 2019-12-16T22:45:36.064 INFO:teuthology.orchestra.run.smithi177.stdout:520 write 0x9a873bb thru 0x9a8a5af (0x31f5 bytes) 2019-12-16T22:45:36.068 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.070 INFO:teuthology.orchestra.run.smithi177.stdout:1243 write 0x9df3512 thru 0x9df82b8 (0x4da7 bytes) 2019-12-16T22:45:36.078 INFO:teuthology.orchestra.run.smithi177.stdout:521 punch from 0x15eb3e2 to 0x15f9ddd, (0xe9fb bytes) 2019-12-16T22:45:36.078 INFO:teuthology.orchestra.run.smithi177.stdout:522 write 0x4eb2798 thru 0x4ec1a36 (0xf29f bytes) 2019-12-16T22:45:36.079 INFO:teuthology.orchestra.run.smithi177.stdout:771 trunc from 0xb7df821 to 0xd5bde 2019-12-16T22:45:36.085 INFO:teuthology.orchestra.run.smithi177.stdout:1017 read 0x13f3fb0 thru 0x13fe091 (0xa0e2 bytes) 2019-12-16T22:45:36.085 INFO:teuthology.orchestra.run.smithi177.stdout:1018 writesame 0x2d661ca thru 0x2d75892 data_size 0x1(0xf6c9 bytes) 2019-12-16T22:45:36.118 INFO:teuthology.orchestra.run.smithi177.stdout:1288 writesame 0xbc387de thru 0xbc40ffb data_size 0x26(0x881e bytes) 2019-12-16T22:45:36.120 INFO:teuthology.orchestra.run.smithi177.stdout:1289 punch from 0x2da27ad to 0x2daaf46, (0x8799 bytes) 2019-12-16T22:45:36.131 INFO:teuthology.orchestra.run.smithi177.stdout:1244 writesame 0xb15c3b8 thru 0xb1610ca data_size 0x1(0x4d13 bytes) 2019-12-16T22:45:36.131 INFO:teuthology.orchestra.run.smithi177.stdout:1245 write 0x6cf6294 thru 0x6cfc403 (0x6170 bytes) 2019-12-16T22:45:36.131 INFO:teuthology.orchestra.run.smithi177.stdout:772 read 0xf967 thru 0x177b7 (0x7e51 bytes) 2019-12-16T22:45:36.143 INFO:teuthology.orchestra.run.smithi177.stdout:1246 trunc from 0xb1610cb to 0xa160941 2019-12-16T22:45:36.144 INFO:teuthology.orchestra.run.smithi177.stdout:524 write 0xc3671a3 thru 0xc374085 (0xcee3 bytes) 2019-12-16T22:45:36.149 INFO:teuthology.orchestra.run.smithi177.stdout:1291 writesame 0xcfb63b7 thru 0xcfc087b data_size 0x1(0xa4c5 bytes) 2019-12-16T22:45:36.157 INFO:teuthology.orchestra.run.smithi177.stdout:1294 read 0xc6a626a thru 0xc6adfb0 (0x7d47 bytes) 2019-12-16T22:45:36.157 INFO:teuthology.orchestra.run.smithi177.stdout:1295 write 0xc51aab4 thru 0xc521ba3 (0x70f0 bytes) 2019-12-16T22:45:36.158 INFO:teuthology.orchestra.run.smithi177.stdout:773 trunc from 0xd5bde to 0xb744d20 2019-12-16T22:45:36.162 INFO:teuthology.orchestra.run.smithi177.stdout:1019 write 0x7487642 thru 0x74883bd (0xd7c bytes) 2019-12-16T22:45:36.165 INFO:teuthology.orchestra.run.smithi177.stdout:1296 punch from 0x4eccb59 to 0x4ed25b6, (0x5a5d bytes) 2019-12-16T22:45:36.165 INFO:teuthology.orchestra.run.smithi177.stdout:1297 writesame 0xd3bc5 thru 0xe1dbd data_size 0xb(0xe1f9 bytes) 2019-12-16T22:45:36.170 INFO:teuthology.orchestra.run.smithi177.stdout:1020 punch from 0x2e593fe to 0x2e67231, (0xde33 bytes) 2019-12-16T22:45:36.170 INFO:teuthology.orchestra.run.smithi177.stdout:1021 writesame 0x249732d thru 0x2497de3 data_size 0x1(0xab7 bytes) 2019-12-16T22:45:36.172 INFO:teuthology.orchestra.run.smithi177.stdout:1298 write 0x3311fe7 thru 0x33211e4 (0xf1fe bytes) 2019-12-16T22:45:36.173 INFO:teuthology.orchestra.run.smithi177.stdout:1247 writesame 0x35e976 thru 0x36916d data_size 0x7d(0xa7f8 bytes) 2019-12-16T22:45:36.177 INFO:teuthology.orchestra.run.smithi177.stdout:774 punch from 0x4ddee37 to 0x4de6137, (0x7300 bytes) 2019-12-16T22:45:36.177 INFO:teuthology.orchestra.run.smithi177.stdout:775 read 0xc27a67 thru 0xc37a4f (0xffe9 bytes) 2019-12-16T22:45:36.177 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.178 INFO:teuthology.orchestra.run.smithi177.stdout:779 read 0x27a75cf thru 0x27b1e98 (0xa8ca bytes) 2019-12-16T22:45:36.178 INFO:teuthology.orchestra.run.smithi177.stdout:782 write 0x7f9188e thru 0x7f985f2 (0x6d65 bytes) 2019-12-16T22:45:36.179 INFO:teuthology.orchestra.run.smithi177.stdout:1022 read 0x6794369 thru 0x6799020 (0x4cb8 bytes) 2019-12-16T22:45:36.179 INFO:teuthology.orchestra.run.smithi177.stdout:1023 read 0x64be64 thru 0x6500f5 (0x4292 bytes) 2019-12-16T22:45:36.180 INFO:teuthology.orchestra.run.smithi177.stdout:1299 write 0x430aef7 thru 0x430d94f (0x2a59 bytes) 2019-12-16T22:45:36.187 INFO:teuthology.orchestra.run.smithi177.stdout:525 write 0xe3b0685 thru 0xe3b9e11 (0x978d bytes) 2019-12-16T22:45:36.188 INFO:teuthology.orchestra.run.smithi177.stdout:1300 read 0x1a732 thru 0x1e4ad (0x3d7c bytes) 2019-12-16T22:45:36.189 INFO:teuthology.orchestra.run.smithi177.stdout:1301 writesame 0xa22abe1 thru 0xa2365db data_size 0x1(0xb9fb bytes) 2019-12-16T22:45:36.189 INFO:teuthology.orchestra.run.smithi177.stdout:1248 trunc from 0xa160941 to 0x93b0258 2019-12-16T22:45:36.194 INFO:teuthology.orchestra.run.smithi177.stdout:783 trunc from 0xb744d20 to 0xd8a0c62 2019-12-16T22:45:36.200 INFO:teuthology.orchestra.run.smithi177.stdout:526 writesame 0x1a28553 thru 0x1a2f428 data_size 0x3(0x6ed6 bytes) 2019-12-16T22:45:36.226 INFO:teuthology.orchestra.run.smithi177.stdout:528 write 0x291a0fd thru 0x291c1ea (0x20ee bytes) 2019-12-16T22:45:36.234 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.234 INFO:teuthology.orchestra.run.smithi177.stdout:1303 punch from 0x1c3137a to 0x1c36162, (0x4de8 bytes) 2019-12-16T22:45:36.235 INFO:teuthology.orchestra.run.smithi177.stdout:1305 read 0x8902901 thru 0x890725a (0x495a bytes) 2019-12-16T22:45:36.235 INFO:teuthology.orchestra.run.smithi177.stdout:1306 writesame 0x746f3ec thru 0x7472f3a data_size 0x15(0x3b4f bytes) 2019-12-16T22:45:36.239 INFO:teuthology.orchestra.run.smithi177.stdout:1025 write 0xd30ea14 thru 0xd31c187 (0xd774 bytes) 2019-12-16T22:45:36.239 INFO:teuthology.orchestra.run.smithi177.stdout:529 read 0x589c466 thru 0x58ab99a (0xf535 bytes) 2019-12-16T22:45:36.240 INFO:teuthology.orchestra.run.smithi177.stdout:532 read 0xd1385dd thru 0xd140c17 (0x863b bytes) 2019-12-16T22:45:36.240 INFO:teuthology.orchestra.run.smithi177.stdout:533 writesame 0xdffacf2 thru 0xdffea5f data_size 0x3(0x3d6e bytes) 2019-12-16T22:45:36.242 INFO:teuthology.orchestra.run.smithi177.stdout:1307 write 0x3a6a8c7 thru 0x3a6cb0a (0x2244 bytes) 2019-12-16T22:45:36.244 INFO:teuthology.orchestra.run.smithi177.stdout:1249 write 0x2e8aaf2 thru 0x2e91e74 (0x7383 bytes) 2019-12-16T22:45:36.245 INFO:teuthology.orchestra.run.smithi177.stdout:784 write 0x67b3e24 thru 0x67bbc62 (0x7e3f bytes) 2019-12-16T22:45:36.252 INFO:teuthology.orchestra.run.smithi177.stdout:534 write 0xa00c548 thru 0xa0183cd (0xbe86 bytes) 2019-12-16T22:45:36.257 INFO:teuthology.orchestra.run.smithi177.stdout:1309 write 0xc0beb7d thru 0xc0c9d6a (0xb1ee bytes) 2019-12-16T22:45:36.261 INFO:teuthology.orchestra.run.smithi177.stdout:786 read 0x5d8f21d thru 0x5d93334 (0x4118 bytes) 2019-12-16T22:45:36.261 INFO:teuthology.orchestra.run.smithi177.stdout:787 punch from 0x2ab994d to 0x2ab9dcd, (0x480 bytes) 2019-12-16T22:45:36.262 INFO:teuthology.orchestra.run.smithi177.stdout:788 read 0x24d2de5 thru 0x24dcd64 (0x9f80 bytes) 2019-12-16T22:45:36.262 INFO:teuthology.orchestra.run.smithi177.stdout:1252 read 0x6c2f0db thru 0x6c3d28d (0xe1b3 bytes) 2019-12-16T22:45:36.262 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.263 INFO:teuthology.orchestra.run.smithi177.stdout:1026 trunc from 0xd31c188 to 0xe79183d 2019-12-16T22:45:36.270 INFO:teuthology.orchestra.run.smithi177.stdout:535 writesame 0x8e1c497 thru 0x8e26e30 data_size 0x2(0xa99a bytes) 2019-12-16T22:45:36.270 INFO:teuthology.orchestra.run.smithi177.stdout:1310 writesame 0x348b6c7 thru 0x348e8cb data_size 0x1(0x3205 bytes) 2019-12-16T22:45:36.278 INFO:teuthology.orchestra.run.smithi177.stdout:790 trunc from 0xd8a0c62 to 0x4654f1a 2019-12-16T22:45:36.282 INFO:teuthology.orchestra.run.smithi177.stdout:1311 write 0xcb901d9 thru 0xcb9b859 (0xb681 bytes) 2019-12-16T22:45:36.289 INFO:teuthology.orchestra.run.smithi177.stdout:536 write 0x1b6da31 thru 0x1b7615d (0x872d bytes) 2019-12-16T22:45:36.294 INFO:teuthology.orchestra.run.smithi177.stdout:1027 writesame 0x97f38f9 thru 0x97f5a7a data_size 0x1(0x2182 bytes) 2019-12-16T22:45:36.294 INFO:teuthology.orchestra.run.smithi177.stdout:1312 punch from 0x2adbe17 to 0x2ae948f, (0xd678 bytes) 2019-12-16T22:45:36.294 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.295 INFO:teuthology.orchestra.run.smithi177.stdout:1317 read 0xc2e89e1 thru 0xc2f5917 (0xcf37 bytes) 2019-12-16T22:45:36.295 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.295 INFO:teuthology.orchestra.run.smithi177.stdout:1319 trunc from 0xcfc087c to 0xc4ae753 2019-12-16T22:45:36.298 INFO:teuthology.orchestra.run.smithi177.stdout:1254 write 0xeb30c97 thru 0xeb3e858 (0xdbc2 bytes) 2019-12-16T22:45:36.302 INFO:teuthology.orchestra.run.smithi177.stdout:538 write 0x22992b6 thru 0x22a5252 (0xbf9d bytes) 2019-12-16T22:45:36.308 INFO:teuthology.orchestra.run.smithi177.stdout:1028 read 0x24b6b04 thru 0x24bf919 (0x8e16 bytes) 2019-12-16T22:45:36.309 INFO:teuthology.orchestra.run.smithi177.stdout:1030 read 0xbc8bec1 thru 0xbc93f48 (0x8088 bytes) 2019-12-16T22:45:36.309 INFO:teuthology.orchestra.run.smithi177.stdout:1031 read 0xcb9b22 thru 0xcbc8cd (0x2dac bytes) 2019-12-16T22:45:36.309 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.310 INFO:teuthology.orchestra.run.smithi177.stdout:793 writesame 0x52a5be thru 0x5375f8 data_size 0x3(0xd03b bytes) 2019-12-16T22:45:36.310 INFO:teuthology.orchestra.run.smithi177.stdout:1032 read 0x1ec59d0 thru 0x1ecc8a0 (0x6ed1 bytes) 2019-12-16T22:45:36.311 INFO:teuthology.orchestra.run.smithi177.stdout:1033 write 0xc56f2f6 thru 0xc57d599 (0xe2a4 bytes) 2019-12-16T22:45:36.323 INFO:teuthology.orchestra.run.smithi177.stdout:794 writesame 0x1f3ca70 thru 0x1f40ec8 data_size 0x1(0x4459 bytes) 2019-12-16T22:45:36.325 INFO:teuthology.orchestra.run.smithi177.stdout:1255 read 0x6eea7b0 thru 0x6efa1c3 (0xfa14 bytes) 2019-12-16T22:45:36.325 INFO:teuthology.orchestra.run.smithi177.stdout:1256 read 0x2cd7526 thru 0x2ce0e4c (0x9927 bytes) 2019-12-16T22:45:36.325 INFO:teuthology.orchestra.run.smithi177.stdout:1257 read 0x6dd7b79 thru 0x6de2def (0xb277 bytes) 2019-12-16T22:45:36.325 INFO:teuthology.orchestra.run.smithi177.stdout:1258 read 0xc539487 thru 0xc53d04c (0x3bc6 bytes) 2019-12-16T22:45:36.326 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.326 INFO:teuthology.orchestra.run.smithi177.stdout:1260 read 0xd66b413 thru 0xd66f710 (0x42fe bytes) 2019-12-16T22:45:36.326 INFO:teuthology.orchestra.run.smithi177.stdout:1263 punch from 0xa9e76e8 to 0xa9e9aa1, (0x23b9 bytes) 2019-12-16T22:45:36.326 INFO:teuthology.orchestra.run.smithi177.stdout:1264 punch from 0xb2665c6 to 0xb266cc7, (0x701 bytes) 2019-12-16T22:45:36.326 INFO:teuthology.orchestra.run.smithi177.stdout:1268 write 0x18efce4 thru 0x18fe8f8 (0xec15 bytes) 2019-12-16T22:45:36.327 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.327 INFO:teuthology.orchestra.run.smithi177.stdout:540 writesame 0x66fbdf4 thru 0x67087da data_size 0x3(0xc9e7 bytes) 2019-12-16T22:45:36.338 INFO:teuthology.orchestra.run.smithi177.stdout:1034 punch from 0xb2aaea2 to 0xb2b2944, (0x7aa2 bytes) 2019-12-16T22:45:36.338 INFO:teuthology.orchestra.run.smithi177.stdout:1035 read 0x798e606 thru 0x7996f23 (0x891e bytes) 2019-12-16T22:45:36.338 INFO:teuthology.orchestra.run.smithi177.stdout:1036 writesame 0x63b64d5 thru 0x63bb763 data_size 0x5(0x528f bytes) 2019-12-16T22:45:36.341 INFO:teuthology.orchestra.run.smithi177.stdout:1321 punch from 0x2877359 to 0x288543f, (0xe0e6 bytes) 2019-12-16T22:45:36.341 INFO:teuthology.orchestra.run.smithi177.stdout:1322 read 0x4df56df thru 0x4dfa4a0 (0x4dc2 bytes) 2019-12-16T22:45:36.343 INFO:teuthology.orchestra.run.smithi177.stdout:1326 write 0x4769a47 thru 0x4771710 (0x7cca bytes) 2019-12-16T22:45:36.343 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.345 INFO:teuthology.orchestra.run.smithi177.stdout:1269 read 0xe9d88f1 thru 0xe9e2a13 (0xa123 bytes) 2019-12-16T22:45:36.345 INFO:teuthology.orchestra.run.smithi177.stdout:1271 read 0x88fe825 thru 0x890329b (0x4a77 bytes) 2019-12-16T22:45:36.346 INFO:teuthology.orchestra.run.smithi177.stdout:1272 read 0x69ef7e3 thru 0x69f7394 (0x7bb2 bytes) 2019-12-16T22:45:36.346 INFO:teuthology.orchestra.run.smithi177.stdout:1273 punch from 0x28708f7 to 0x2875d22, (0x542b bytes) 2019-12-16T22:45:36.346 INFO:teuthology.orchestra.run.smithi177.stdout:1275 read 0x9105db9 thru 0x910c0a0 (0x62e8 bytes) 2019-12-16T22:45:36.346 INFO:teuthology.orchestra.run.smithi177.stdout:1277 read 0xe10e1cc thru 0xe119ebb (0xbcf0 bytes) 2019-12-16T22:45:36.346 INFO:teuthology.orchestra.run.smithi177.stdout:1278 punch from 0x5a1751d to 0x5a19376, (0x1e59 bytes) 2019-12-16T22:45:36.346 INFO:teuthology.orchestra.run.smithi177.stdout:1279 punch from 0x37c63f4 to 0x37c78b5, (0x14c1 bytes) 2019-12-16T22:45:36.346 INFO:teuthology.orchestra.run.smithi177.stdout:1281 punch from 0x442c67d to 0x4433f96, (0x7919 bytes) 2019-12-16T22:45:36.347 INFO:teuthology.orchestra.run.smithi177.stdout:1282 writesame 0x4350801 thru 0x4354d28 data_size 0x4(0x4528 bytes) 2019-12-16T22:45:36.352 INFO:teuthology.orchestra.run.smithi177.stdout:1038 write 0xd175a4a thru 0xd17d39e (0x7955 bytes) 2019-12-16T22:45:36.352 INFO:teuthology.orchestra.run.smithi177.stdout:798 trunc from 0x4654f1a to 0x87f53e7 2019-12-16T22:45:36.357 INFO:teuthology.orchestra.run.smithi177.stdout:541 read 0x46ea0b6 thru 0x46ebb25 (0x1a70 bytes) 2019-12-16T22:45:36.357 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.360 INFO:teuthology.orchestra.run.smithi177.stdout:1328 write 0x30ca270 thru 0x30cccc6 (0x2a57 bytes) 2019-12-16T22:45:36.365 INFO:teuthology.orchestra.run.smithi177.stdout:1283 write 0xc5e0410 thru 0xc5eaeb6 (0xaaa7 bytes) 2019-12-16T22:45:36.374 INFO:teuthology.orchestra.run.smithi177.stdout:544 trunc from 0xe3b9e12 to 0x44e7ec8 2019-12-16T22:45:36.376 INFO:teuthology.orchestra.run.smithi177.stdout:1284 write 0x67e6c90 thru 0x67f251f (0xb890 bytes) 2019-12-16T22:45:36.378 INFO:teuthology.orchestra.run.smithi177.stdout:1329 trunc from 0xc4ae753 to 0x82f10d0 2019-12-16T22:45:36.382 INFO:teuthology.orchestra.run.smithi177.stdout:799 read 0x6049fef thru 0x605032b (0x633d bytes) 2019-12-16T22:45:36.393 INFO:teuthology.orchestra.run.smithi177.stdout:1285 punch from 0x4f15727 to 0x4f1d330, (0x7c09 bytes) 2019-12-16T22:45:36.393 INFO:teuthology.orchestra.run.smithi177.stdout:1286 write 0x24c7def thru 0x24ccb33 (0x4d45 bytes) 2019-12-16T22:45:36.393 INFO:teuthology.orchestra.run.smithi177.stdout:1039 trunc from 0xe79183d to 0x5111b61 2019-12-16T22:45:36.405 INFO:teuthology.orchestra.run.smithi177.stdout:1288 trunc from 0xeb3e859 to 0xe1660a8 2019-12-16T22:45:36.418 INFO:teuthology.orchestra.run.smithi177.stdout:802 write 0xe2714b9 thru 0xe271ba1 (0x6e9 bytes) 2019-12-16T22:45:36.422 INFO:teuthology.orchestra.run.smithi177.stdout:545 writesame 0x44947b7 thru 0x449ce05 data_size 0x49(0x864f bytes) 2019-12-16T22:45:36.424 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.424 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.434 INFO:teuthology.orchestra.run.smithi177.stdout:546 write 0x19cf50 thru 0x1a7a91 (0xab42 bytes) 2019-12-16T22:45:36.436 INFO:teuthology.orchestra.run.smithi177.stdout:1333 trunc from 0x82f10d0 to 0xddb8cd2 2019-12-16T22:45:36.443 INFO:teuthology.orchestra.run.smithi177.stdout:1289 write 0xca59897 thru 0xca5dbec (0x4356 bytes) 2019-12-16T22:45:36.448 INFO:teuthology.orchestra.run.smithi177.stdout:803 trunc from 0xe271ba2 to 0x42b32d0 2019-12-16T22:45:36.450 INFO:teuthology.orchestra.run.smithi177.stdout:1290 write 0x721f306 thru 0x722b028 (0xbd23 bytes) 2019-12-16T22:45:36.459 INFO:teuthology.orchestra.run.smithi177.stdout:1334 read 0x9af1f5b thru 0x9afef39 (0xcfdf bytes) 2019-12-16T22:45:36.459 INFO:teuthology.orchestra.run.smithi177.stdout:1335 read 0x8160abb thru 0x81679ba (0x6f00 bytes) 2019-12-16T22:45:36.459 INFO:teuthology.orchestra.run.smithi177.stdout:1336 punch from 0x71ed742 to 0x71f7f3a, (0xa7f8 bytes) 2019-12-16T22:45:36.459 INFO:teuthology.orchestra.run.smithi177.stdout:1339 read 0x17ca4fe thru 0x17cd39e (0x2ea1 bytes) 2019-12-16T22:45:36.460 INFO:teuthology.orchestra.run.smithi177.stdout:1340 write 0x634c403 thru 0x634d7dd (0x13db bytes) 2019-12-16T22:45:36.460 INFO:teuthology.orchestra.run.smithi177.stdout:1292 writesame 0x9cea7fa thru 0x9cf97b1 data_size 0xc(0xefb8 bytes) 2019-12-16T22:45:36.463 INFO:teuthology.orchestra.run.smithi177.stdout:1341 read 0x8b1d58b thru 0x8b200ba (0x2b30 bytes) 2019-12-16T22:45:36.466 INFO:teuthology.orchestra.run.smithi177.stdout:1342 trunc from 0xddb8cd2 to 0xbdcee40 2019-12-16T22:45:36.471 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.471 INFO:teuthology.orchestra.run.smithi177.stdout:1295 writesame 0x8e0eb61 thru 0x8e10110 data_size 0x8(0x15b0 bytes) 2019-12-16T22:45:36.473 INFO:teuthology.orchestra.run.smithi177.stdout:1040 writesame 0xee660a7 thru 0xee69b2a data_size 0x1c(0x3a84 bytes) 2019-12-16T22:45:36.477 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.477 INFO:teuthology.orchestra.run.smithi177.stdout:1042 writesame 0x1f9333a thru 0x1f996af data_size 0x2(0x6376 bytes) 2019-12-16T22:45:36.480 INFO:teuthology.orchestra.run.smithi177.stdout:1296 write 0x73b3e3 thru 0x73d633 (0x2251 bytes) 2019-12-16T22:45:36.485 INFO:teuthology.orchestra.run.smithi177.stdout:547 write 0x986b0b4 thru 0x9879180 (0xe0cd bytes) 2019-12-16T22:45:36.500 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.501 INFO:teuthology.orchestra.run.smithi177.stdout:1044 read 0x2c78ae thru 0x2ca9b5 (0x3108 bytes) 2019-12-16T22:45:36.501 INFO:teuthology.orchestra.run.smithi177.stdout:1346 read 0x3168651 thru 0x3174089 (0xba39 bytes) 2019-12-16T22:45:36.501 INFO:teuthology.orchestra.run.smithi177.stdout:1347 read 0x1a62471 thru 0x1a66296 (0x3e26 bytes) 2019-12-16T22:45:36.501 INFO:teuthology.orchestra.run.smithi177.stdout:1348 write 0x184f89e thru 0x1851a5c (0x21bf bytes) 2019-12-16T22:45:36.501 INFO:teuthology.orchestra.run.smithi177.stdout:1297 read 0x1b7d3a thru 0x1bcbca (0x4e91 bytes) 2019-12-16T22:45:36.501 INFO:teuthology.orchestra.run.smithi177.stdout:1298 punch from 0x47fb4f3 to 0x480403a, (0x8b47 bytes) 2019-12-16T22:45:36.502 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.502 INFO:teuthology.orchestra.run.smithi177.stdout:1300 write 0x74ccff2 thru 0x74dc459 (0xf468 bytes) 2019-12-16T22:45:36.505 INFO:teuthology.orchestra.run.smithi177.stdout:1349 read 0x5bd447c thru 0x5bdae21 (0x69a6 bytes) 2019-12-16T22:45:36.506 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe924c67 2019-12-16T22:45:36.509 INFO:teuthology.orchestra.run.smithi177.stdout:549 punch from 0x9091be2 to 0x90920e0, (0x4fe bytes) 2019-12-16T22:45:36.509 INFO:teuthology.orchestra.run.smithi177.stdout:1302 read 0xd2b9c87 thru 0xd2c3395 (0x970f bytes) 2019-12-16T22:45:36.509 INFO:teuthology.orchestra.run.smithi177.stdout:1303 clone 9 order 20 su 65536 sc 5 2019-12-16T22:45:36.514 INFO:teuthology.orchestra.run.smithi177.stdout:1350 trunc from 0xbdcee40 to 0xe924c67 2019-12-16T22:45:36.520 INFO:teuthology.orchestra.run.smithi177.stdout:1046 trunc from 0xee69b2b to 0x5a5df57 2019-12-16T22:45:36.523 INFO:teuthology.orchestra.run.smithi177.stdout:804 writesame 0xcd0d9f7 thru 0xcd14b21 data_size 0x9(0x712b bytes) 2019-12-16T22:45:36.525 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.525 INFO:teuthology.orchestra.run.smithi177.stdout:806 writesame 0x952f726 thru 0x9530ae4 data_size 0x5(0x13bf bytes) 2019-12-16T22:45:36.534 INFO:teuthology.orchestra.run.smithi177.stdout:1351 write 0x45aed33 thru 0x45b870e (0x99dc bytes) 2019-12-16T22:45:36.534 INFO:teuthology.orchestra.run.smithi177.stdout:807 read 0x58eddb1 thru 0x58ee296 (0x4e6 bytes) 2019-12-16T22:45:36.534 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.534 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.535 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.535 INFO:teuthology.orchestra.run.smithi177.stdout:812 read 0x956d5c5 thru 0x9578cab (0xb6e7 bytes) 2019-12-16T22:45:36.541 INFO:teuthology.orchestra.run.smithi177.stdout:1353 write 0x9854fae thru 0x985fdfc (0xae4f bytes) 2019-12-16T22:45:36.542 INFO:teuthology.orchestra.run.smithi177.stdout:813 trunc from 0xcd14b22 to 0x8f1baad 2019-12-16T22:45:36.543 INFO:teuthology.orchestra.run.smithi177.stdout:550 write 0xdc33782 thru 0xdc3563c (0x1ebb bytes) 2019-12-16T22:45:36.548 INFO:teuthology.orchestra.run.smithi177.stdout:1047 trunc from 0x5a5df57 to 0x4ba0c07 2019-12-16T22:45:36.549 INFO:teuthology.orchestra.run.smithi177.stdout:1354 read 0x64609bf thru 0x646360d (0x2c4f bytes) 2019-12-16T22:45:36.550 INFO:teuthology.orchestra.run.smithi177.stdout:1355 write 0xd656bb thru 0xd68e13 (0x3759 bytes) 2019-12-16T22:45:36.554 INFO:teuthology.orchestra.run.smithi177.stdout:1356 writesame 0xacdc771 thru 0xace3f22 data_size 0x3(0x77b2 bytes) 2019-12-16T22:45:36.559 INFO:teuthology.orchestra.run.smithi177.stdout:551 trunc from 0xdc3563d to 0x7c4bec2 2019-12-16T22:45:36.567 INFO:teuthology.orchestra.run.smithi177.stdout:1357 punch from 0x17712c9 to 0x177bfdc, (0xad13 bytes) 2019-12-16T22:45:36.567 INFO:teuthology.orchestra.run.smithi177.stdout:1358 read 0x3a8626c thru 0x3a928c0 (0xc655 bytes) 2019-12-16T22:45:36.567 INFO:teuthology.orchestra.run.smithi177.stdout:1359 write 0x35a6425 thru 0x35af430 (0x900c bytes) 2019-12-16T22:45:36.568 INFO:teuthology.orchestra.run.smithi177.stdout:1048 write 0x1927fd6 thru 0x1937ec6 (0xfef1 bytes) 2019-12-16T22:45:36.580 INFO:teuthology.orchestra.run.smithi177.stdout:1360 write 0x6bd0a5e thru 0x6bd7d2a (0x72cd bytes) 2019-12-16T22:45:36.586 INFO:teuthology.orchestra.run.smithi177.stdout:815 trunc from 0x8f1baad to 0x134a550 2019-12-16T22:45:36.587 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.587 INFO:teuthology.orchestra.run.smithi177.stdout:1362 write 0xdd08215 thru 0xdd107ea (0x85d6 bytes) 2019-12-16T22:45:36.592 INFO:teuthology.orchestra.run.smithi177.stdout:1050 trunc from 0x4ba0c07 to 0x95c24d9 2019-12-16T22:45:36.597 INFO:teuthology.orchestra.run.smithi177.stdout:1363 write 0xda81b16 thru 0xda8f125 (0xd610 bytes) 2019-12-16T22:45:36.600 INFO:teuthology.orchestra.run.smithi177.stdout:553 read 0x30d5048 thru 0x30df8fb (0xa8b4 bytes) 2019-12-16T22:45:36.600 INFO:teuthology.orchestra.run.smithi177.stdout:554 read 0x5281a79 thru 0x5284d4d (0x32d5 bytes) 2019-12-16T22:45:36.600 INFO:teuthology.orchestra.run.smithi177.stdout:556 write 0x66a53d0 thru 0x66a6076 (0xca7 bytes) 2019-12-16T22:45:36.608 INFO:teuthology.orchestra.run.smithi177.stdout:557 read 0x6b01c76 thru 0x6b0a23b (0x85c6 bytes) 2019-12-16T22:45:36.609 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.609 INFO:teuthology.orchestra.run.smithi177.stdout:1364 write 0xb08a2 thru 0xbc7af (0xbf0e bytes) 2019-12-16T22:45:36.613 INFO:teuthology.orchestra.run.smithi177.stdout:1051 read 0x47361d2 thru 0x4742277 (0xc0a6 bytes) 2019-12-16T22:45:36.613 INFO:teuthology.orchestra.run.smithi177.stdout:1052 punch from 0x48a14ca to 0x48a5e30, (0x4966 bytes) 2019-12-16T22:45:36.614 INFO:teuthology.orchestra.run.smithi177.stdout:1054 punch from 0x93894df to 0x9390e9a, (0x79bb bytes) 2019-12-16T22:45:36.614 INFO:teuthology.orchestra.run.smithi177.stdout:1055 punch from 0x90c905 to 0x9148a6, (0x7fa1 bytes) 2019-12-16T22:45:36.614 INFO:teuthology.orchestra.run.smithi177.stdout:1056 read 0x1299e27 thru 0x12a39bb (0x9b95 bytes) 2019-12-16T22:45:36.614 INFO:teuthology.orchestra.run.smithi177.stdout:1058 read 0x4ab2ebc thru 0x4ab7391 (0x44d6 bytes) 2019-12-16T22:45:36.615 INFO:teuthology.orchestra.run.smithi177.stdout:1063 write 0x640a59a thru 0x641059a (0x6001 bytes) 2019-12-16T22:45:36.619 INFO:teuthology.orchestra.run.smithi177.stdout:1365 write 0xd64ad47 thru 0xd652670 (0x792a bytes) 2019-12-16T22:45:36.626 INFO:teuthology.orchestra.run.smithi177.stdout:816 trunc from 0x134a550 to 0x4d30468 2019-12-16T22:45:36.629 INFO:teuthology.orchestra.run.smithi177.stdout:1366 punch from 0xa9fe59a to 0xaa01920, (0x3386 bytes) 2019-12-16T22:45:36.629 INFO:teuthology.orchestra.run.smithi177.stdout:1367 read 0x65a0585 thru 0x65a5e23 (0x589f bytes) 2019-12-16T22:45:36.629 INFO:teuthology.orchestra.run.smithi177.stdout:1369 write 0x1495320 thru 0x149937d (0x405e bytes) 2019-12-16T22:45:36.638 INFO:teuthology.orchestra.run.smithi177.stdout:1372 punch from 0xd24f2aa to 0xd25cc80, (0xd9d6 bytes) 2019-12-16T22:45:36.638 INFO:teuthology.orchestra.run.smithi177.stdout:1373 write 0x39427f4 thru 0x39511e8 (0xe9f5 bytes) 2019-12-16T22:45:36.640 INFO:teuthology.orchestra.run.smithi177.stdout:561 writesame 0xa53fa6b thru 0xa5418d0 data_size 0x3(0x1e66 bytes) 2019-12-16T22:45:36.646 INFO:teuthology.orchestra.run.smithi177.stdout:564 read 0x3fa7528 thru 0x3fb0819 (0x92f2 bytes) 2019-12-16T22:45:36.646 INFO:teuthology.orchestra.run.smithi177.stdout:566 write 0x8f54ba9 thru 0x8f55532 (0x98a bytes) 2019-12-16T22:45:36.648 INFO:teuthology.orchestra.run.smithi177.stdout:1374 writesame 0x89faf17 thru 0x8a097dc data_size 0x76(0xe8c6 bytes) 2019-12-16T22:45:36.651 INFO:teuthology.orchestra.run.smithi177.stdout:817 read 0x266ae44 thru 0x266fa6b (0x4c28 bytes) 2019-12-16T22:45:36.655 INFO:teuthology.orchestra.run.smithi177.stdout:568 read 0x75e47e6 thru 0x75e6447 (0x1c62 bytes) 2019-12-16T22:45:36.656 INFO:teuthology.orchestra.run.smithi177.stdout:1378 read 0x15ee6b0 thru 0x15f9ee1 (0xb832 bytes) 2019-12-16T22:45:36.657 INFO:teuthology.orchestra.run.smithi177.stdout:569 trunc from 0xa5418d1 to 0xa1aac35 2019-12-16T22:45:36.657 INFO:teuthology.orchestra.run.smithi177.stdout:1379 read 0x4c0bb45 thru 0x4c15b10 (0x9fcc bytes) 2019-12-16T22:45:36.657 INFO:teuthology.orchestra.run.smithi177.stdout:1381 read 0xdaf4d03 thru 0xdaf7b7e (0x2e7c bytes) 2019-12-16T22:45:36.657 INFO:teuthology.orchestra.run.smithi177.stdout:1382 write 0x65bfa0 thru 0x6672eb (0xb34c bytes) 2019-12-16T22:45:36.674 INFO:teuthology.orchestra.run.smithi177.stdout:1383 punch from 0xc7651c2 to 0xc768c2d, (0x3a6b bytes) 2019-12-16T22:45:36.675 INFO:teuthology.orchestra.run.smithi177.stdout:1385 write 0x537f619 thru 0x538455a (0x4f42 bytes) 2019-12-16T22:45:36.675 INFO:teuthology.orchestra.run.smithi177.stdout:1386 punch from 0x8994064 to 0x89a274c, (0xe6e8 bytes) 2019-12-16T22:45:36.675 INFO:teuthology.orchestra.run.smithi177.stdout:1387 punch from 0x9e92c95 to 0x9e998c6, (0x6c31 bytes) 2019-12-16T22:45:36.675 INFO:teuthology.orchestra.run.smithi177.stdout:1390 punch from 0x97c1080 to 0x97cbd38, (0xacb8 bytes) 2019-12-16T22:45:36.675 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.675 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #6, image image_cluster1.client.mirror.4-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent7 2019-12-16T22:45:36.676 INFO:teuthology.orchestra.run.smithi177.stdout:1064 writesame 0xc2e48dc thru 0xc2ea8c3 data_size 0x21(0x5fe8 bytes) 2019-12-16T22:45:36.676 INFO:teuthology.orchestra.run.smithi177.stdout:1065 read 0x91e3729 thru 0x91e3d47 (0x61f bytes) 2019-12-16T22:45:36.676 INFO:teuthology.orchestra.run.smithi177.stdout:1066 read 0x493175d thru 0x4938435 (0x6cd9 bytes) 2019-12-16T22:45:36.687 INFO:teuthology.orchestra.run.smithi177.stdout:1067 punch from 0x6f5ad50 to 0x6f64c15, (0x9ec5 bytes) 2019-12-16T22:45:36.687 INFO:teuthology.orchestra.run.smithi177.stdout:1069 writesame 0x790e511 thru 0x7917c7a data_size 0x1(0x976a bytes) 2019-12-16T22:45:36.688 INFO:teuthology.orchestra.run.smithi177.stdout:818 write 0x64f8b45 thru 0x6504926 (0xbde2 bytes) 2019-12-16T22:45:36.689 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.689 INFO:teuthology.orchestra.run.smithi177.stdout:570 write 0x35222ce thru 0x35270c9 (0x4dfc bytes) 2019-12-16T22:45:36.689 INFO:teuthology.orchestra.run.smithi177.stdout:1392 trunc from 0xe924c67 to 0x8cf62d6 2019-12-16T22:45:36.691 INFO:teuthology.orchestra.run.smithi177.stdout:821 trunc from 0x6504927 to 0x2c310d7 2019-12-16T22:45:36.699 INFO:teuthology.orchestra.run.smithi177.stdout:1070 punch from 0xcef3c0 to 0xcfc327, (0xcf67 bytes) 2019-12-16T22:45:36.707 INFO:teuthology.orchestra.run.smithi177.stdout:572 trunc from 0xa1aac35 to 0xb49b3a7 2019-12-16T22:45:36.721 INFO:teuthology.orchestra.run.smithi177.stdout:822 punch from 0x48f455 to 0x491771, (0x231c bytes) 2019-12-16T22:45:36.722 INFO:teuthology.orchestra.run.smithi177.stdout:823 read 0x2b4f57a thru 0x2b5f567 (0xffee bytes) 2019-12-16T22:45:36.723 INFO:teuthology.orchestra.run.smithi177.stdout:824 punch from 0xed2f57 to 0xed502d, (0x20d6 bytes) 2019-12-16T22:45:36.723 INFO:teuthology.orchestra.run.smithi177.stdout:825 punch from 0x1c470f5 to 0x1c55cdf, (0xebea bytes) 2019-12-16T22:45:36.724 INFO:teuthology.orchestra.run.smithi177.stdout:1393 punch from 0x815c039 to 0x81661f7, (0xa1be bytes) 2019-12-16T22:45:36.724 INFO:teuthology.orchestra.run.smithi177.stdout:1394 read 0x238181 thru 0x238a61 (0x8e1 bytes) 2019-12-16T22:45:36.728 INFO:teuthology.orchestra.run.smithi177.stdout:1071 writesame 0xd6e86be thru 0xd6f7783 data_size 0x3(0xf0c6 bytes) 2019-12-16T22:45:36.730 INFO:teuthology.orchestra.run.smithi177.stdout:1072 write 0xacb1423 thru 0xacb2334 (0xf12 bytes) 2019-12-16T22:45:36.731 INFO:teuthology.orchestra.run.smithi177.stdout:574 read 0xb156ff2 thru 0xb15b224 (0x4233 bytes) 2019-12-16T22:45:36.731 INFO:teuthology.orchestra.run.smithi177.stdout:575 write 0x681819b thru 0x681d49a (0x5300 bytes) 2019-12-16T22:45:36.739 INFO:teuthology.orchestra.run.smithi177.stdout:1073 read 0x743b873 thru 0x743db1c (0x22aa bytes) 2019-12-16T22:45:36.739 INFO:teuthology.orchestra.run.smithi177.stdout:1075 read 0x55f724d thru 0x5604c8b (0xda3f bytes) 2019-12-16T22:45:36.739 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.739 INFO:teuthology.orchestra.run.smithi177.stdout:1077 read 0x2dc999d thru 0x2dcc595 (0x2bf9 bytes) 2019-12-16T22:45:36.740 INFO:teuthology.orchestra.run.smithi177.stdout:1078 punch from 0x7e4c247 to 0x7e50b8f, (0x4948 bytes) 2019-12-16T22:45:36.740 INFO:teuthology.orchestra.run.smithi177.stdout:1079 punch from 0x31482d4 to 0x314f640, (0x736c bytes) 2019-12-16T22:45:36.740 INFO:teuthology.orchestra.run.smithi177.stdout:1081 write 0x7434acd thru 0x7436d45 (0x2279 bytes) 2019-12-16T22:45:36.741 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.741 INFO:teuthology.orchestra.run.smithi177.stdout:578 punch from 0x4a207f7 to 0x4a2bf85, (0xb78e bytes) 2019-12-16T22:45:36.741 INFO:teuthology.orchestra.run.smithi177.stdout:579 write 0x2312588 thru 0x231bd05 (0x977e bytes) 2019-12-16T22:45:36.746 INFO:teuthology.orchestra.run.smithi177.stdout:1082 write 0xa0e987 thru 0xa0f170 (0x7ea bytes) 2019-12-16T22:45:36.750 INFO:teuthology.orchestra.run.smithi177.stdout:580 writesame 0x48513d1 thru 0x485300f data_size 0x1(0x1c3f bytes) 2019-12-16T22:45:36.758 INFO:teuthology.orchestra.run.smithi177.stdout:1395 write 0xebe3fc5 thru 0xebed9f6 (0x9a32 bytes) 2019-12-16T22:45:36.766 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.767 INFO:teuthology.orchestra.run.smithi177.stdout:582 read 0x751c0f0 thru 0x7526bfb (0xab0c bytes) 2019-12-16T22:45:36.767 INFO:teuthology.orchestra.run.smithi177.stdout:585 punch from 0x7e37d48 to 0x7e3d146, (0x53fe bytes) 2019-12-16T22:45:36.767 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.767 INFO:teuthology.orchestra.run.smithi177.stdout:587 read 0x7c8cadf thru 0x7c94251 (0x7773 bytes) 2019-12-16T22:45:36.768 INFO:teuthology.orchestra.run.smithi177.stdout:588 punch from 0x8518377 to 0x851ff5c, (0x7be5 bytes) 2019-12-16T22:45:36.768 INFO:teuthology.orchestra.run.smithi177.stdout:589 write 0x8233846 thru 0x8238155 (0x4910 bytes) 2019-12-16T22:45:36.768 INFO:teuthology.orchestra.run.smithi177.stdout:826 writesame 0xb22a96a thru 0xb236381 data_size 0x3c(0xba18 bytes) 2019-12-16T22:45:36.769 INFO:teuthology.orchestra.run.smithi177.stdout:950 writesame 0xd204005 thru 0xd2047fe data_size 0x1(0x7fa bytes) 2019-12-16T22:45:36.771 INFO:teuthology.orchestra.run.smithi177.stdout:828 punch from 0xbbd41a to 0xbca5ee, (0xd1d4 bytes) 2019-12-16T22:45:36.771 INFO:teuthology.orchestra.run.smithi177.stdout:829 punch from 0x2786eaa to 0x2795986, (0xeadc bytes) 2019-12-16T22:45:36.772 INFO:teuthology.orchestra.run.smithi177.stdout:830 write 0x780f344 thru 0x780f7e2 (0x49f bytes) 2019-12-16T22:45:36.774 INFO:teuthology.orchestra.run.smithi177.stdout:1396 read 0x3a723f1 thru 0x3a7d5df (0xb1ef bytes) 2019-12-16T22:45:36.775 INFO:teuthology.orchestra.run.smithi177.stdout:1397 write 0x65402e3 thru 0x65471e2 (0x6f00 bytes) 2019-12-16T22:45:36.780 INFO:teuthology.orchestra.run.smithi177.stdout:832 writesame 0x2a232df thru 0x2a2c9f2 data_size 0xc(0x9714 bytes) 2019-12-16T22:45:36.785 INFO:teuthology.orchestra.run.smithi177.stdout:1399 write 0x2e22681 thru 0x2e281ec (0x5b6c bytes) 2019-12-16T22:45:36.806 INFO:teuthology.orchestra.run.smithi177.stdout:951 trunc from 0xd2047ff to 0x50948d5 2019-12-16T22:45:36.864 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.864 INFO:teuthology.orchestra.run.smithi177.stdout:590 trunc from 0xb49b3a7 to 0x5e9786d 2019-12-16T22:45:36.864 INFO:teuthology.orchestra.run.smithi177.stdout:1400 write 0x4bb6189 thru 0x4bbb0e0 (0x4f58 bytes) 2019-12-16T22:45:36.865 INFO:teuthology.orchestra.run.smithi177.stdout:1083 write 0xa2fc0ef thru 0xa30b2cb (0xf1dd bytes) 2019-12-16T22:45:36.866 INFO:teuthology.orchestra.run.smithi177.stdout:1401 read 0x31ecae1 thru 0x31f0bf7 (0x4117 bytes) 2019-12-16T22:45:36.866 INFO:teuthology.orchestra.run.smithi177.stdout:834 trunc from 0xb236382 to 0x146c399 2019-12-16T22:45:36.867 INFO:teuthology.orchestra.run.smithi177.stdout:835 punch from 0x132d5b4 to 0x13396cb, (0xc117 bytes) 2019-12-16T22:45:36.867 INFO:teuthology.orchestra.run.smithi177.stdout:1084 punch from 0xc60ca49 to 0xc60fcb1, (0x3268 bytes) 2019-12-16T22:45:36.867 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.867 INFO:teuthology.orchestra.run.smithi177.stdout:1088 trunc from 0xd6f7784 to 0xcf78e23 2019-12-16T22:45:36.867 INFO:teuthology.orchestra.run.smithi177.stdout:1089 write 0x9560f9 thru 0x964f34 (0xee3c bytes) 2019-12-16T22:45:36.867 INFO:teuthology.orchestra.run.smithi177.stdout:591 punch from 0x3c0dc26 to 0x3c11a66, (0x3e40 bytes) 2019-12-16T22:45:36.868 INFO:teuthology.orchestra.run.smithi177.stdout:952 write 0x161854f thru 0x1618d4a (0x7fc bytes) 2019-12-16T22:45:36.868 INFO:teuthology.orchestra.run.smithi177.stdout:593 writesame 0xa01119a thru 0xa01ead7 data_size 0x8a(0xd93e bytes) 2019-12-16T22:45:36.877 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.877 INFO:teuthology.orchestra.run.smithi177.stdout:595 write 0x61dd945 thru 0x61ebab3 (0xe16f bytes) 2019-12-16T22:45:36.881 INFO:teuthology.orchestra.run.smithi177.stdout:836 write 0x5037952 thru 0x50443a5 (0xca54 bytes) 2019-12-16T22:45:36.905 INFO:teuthology.orchestra.run.smithi177.stdout:1090 read 0xb81a750 thru 0xb81b49b (0xd4c bytes) 2019-12-16T22:45:36.905 INFO:teuthology.orchestra.run.smithi177.stdout:1091 writesame 0x5100de2 thru 0x510b467 data_size 0x6(0xa686 bytes) 2019-12-16T22:45:36.905 INFO:teuthology.orchestra.run.smithi177.stdout:596 read 0x15b2ca2 thru 0x15bd8e7 (0xac46 bytes) 2019-12-16T22:45:36.905 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.905 INFO:teuthology.orchestra.run.smithi177.stdout:599 write 0x9a9404 thru 0x9acf7b (0x3b78 bytes) 2019-12-16T22:45:36.919 INFO:teuthology.orchestra.run.smithi177.stdout:956 writesame 0x70b9cc1 thru 0x70c1ce8 data_size 0xc(0x8028 bytes) 2019-12-16T22:45:36.922 INFO:teuthology.orchestra.run.smithi177.stdout:600 trunc from 0xa01ead8 to 0xa5e93a8 2019-12-16T22:45:36.922 INFO:teuthology.orchestra.run.smithi177.stdout:1092 read 0x4ceeb9c thru 0x4cfe913 (0xfd78 bytes) 2019-12-16T22:45:36.922 INFO:teuthology.orchestra.run.smithi177.stdout:1093 read 0xa927e5d thru 0xa930e10 (0x8fb4 bytes) 2019-12-16T22:45:36.922 INFO:teuthology.orchestra.run.smithi177.stdout:1095 write 0x2222083 thru 0x222f9e3 (0xd961 bytes) 2019-12-16T22:45:36.924 INFO:teuthology.orchestra.run.smithi177.stdout:1096 punch from 0x464573b to 0x46542d8, (0xeb9d bytes) 2019-12-16T22:45:36.925 INFO:teuthology.orchestra.run.smithi177.stdout:1097 read 0x811e368 thru 0x811e93b (0x5d4 bytes) 2019-12-16T22:45:36.925 INFO:teuthology.orchestra.run.smithi177.stdout:1099 punch from 0xb2fedee to 0xb30b1e9, (0xc3fb bytes) 2019-12-16T22:45:36.925 INFO:teuthology.orchestra.run.smithi177.stdout:1100 write 0x77bae5 thru 0x781eae (0x63ca bytes) 2019-12-16T22:45:36.936 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.939 INFO:teuthology.orchestra.run.smithi177.stdout:957 write 0x78faf0c thru 0x790a849 (0xf93e bytes) 2019-12-16T22:45:36.940 INFO:teuthology.orchestra.run.smithi177.stdout:837 write 0xe768a6b thru 0xe775b80 (0xd116 bytes) 2019-12-16T22:45:36.951 INFO:teuthology.orchestra.run.smithi177.stdout:838 punch from 0x9684670 to 0x9685ca0, (0x1630 bytes) 2019-12-16T22:45:36.951 INFO:teuthology.orchestra.run.smithi177.stdout:839 trunc from 0xe775b81 to 0xe84da6f 2019-12-16T22:45:36.954 INFO:teuthology.orchestra.run.smithi177.stdout:959 read 0x655d94e thru 0x65680aa (0xa75d bytes) 2019-12-16T22:45:36.954 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xeddaaca 2019-12-16T22:45:36.962 INFO:teuthology.orchestra.run.smithi177.stdout:603 writesame 0xc1803df thru 0xc18f8d8 data_size 0x1(0xf4fa bytes) 2019-12-16T22:45:36.966 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.966 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.966 INFO:teuthology.orchestra.run.smithi177.stdout:606 punch from 0x761f2b3 to 0x762de33, (0xeb80 bytes) 2019-12-16T22:45:36.966 INFO:teuthology.orchestra.run.smithi177.stdout:607 read 0xeb5ea thru 0xf05a9 (0x4fc0 bytes) 2019-12-16T22:45:36.972 INFO:teuthology.orchestra.run.smithi177.stdout:841 read 0x7b90a34 thru 0x7b9daa6 (0xd073 bytes) 2019-12-16T22:45:36.972 INFO:teuthology.orchestra.run.smithi177.stdout:842 writesame 0x53edba1 thru 0x53f345c data_size 0x12(0x58bc bytes) 2019-12-16T22:45:36.972 INFO:teuthology.orchestra.run.smithi177.stdout:962 trunc from 0x790a84a to 0xeddaaca 2019-12-16T22:45:36.978 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:36.978 INFO:teuthology.orchestra.run.smithi177.stdout:845 write 0x574f73c thru 0x575337f (0x3c44 bytes) 2019-12-16T22:45:36.984 INFO:teuthology.orchestra.run.smithi177.stdout:846 punch from 0x382ece2 to 0x383b82e, (0xcb4c bytes) 2019-12-16T22:45:36.984 INFO:teuthology.orchestra.run.smithi177.stdout:848 read 0xb89fed0 thru 0xb8aef24 (0xf055 bytes) 2019-12-16T22:45:36.984 INFO:teuthology.orchestra.run.smithi177.stdout:849 punch from 0x3618b49 to 0x361f238, (0x66ef bytes) 2019-12-16T22:45:36.985 INFO:teuthology.orchestra.run.smithi177.stdout:851 write 0x23e0aa6 thru 0x23e1221 (0x77c bytes) 2019-12-16T22:45:36.989 INFO:teuthology.orchestra.run.smithi177.stdout:608 trunc from 0xc18f8d9 to 0x75c9ea 2019-12-16T22:45:36.990 INFO:teuthology.orchestra.run.smithi177.stdout:852 punch from 0x4968731 to 0x4975ffa, (0xd8c9 bytes) 2019-12-16T22:45:36.991 INFO:teuthology.orchestra.run.smithi177.stdout:853 read 0x126bd35 thru 0x126c4e6 (0x7b2 bytes) 2019-12-16T22:45:36.991 INFO:teuthology.orchestra.run.smithi177.stdout:854 read 0x7d1b05a thru 0x7d25783 (0xa72a bytes) 2019-12-16T22:45:36.991 INFO:teuthology.orchestra.run.smithi177.stdout:855 read 0x1804d3c thru 0x18099af (0x4c74 bytes) 2019-12-16T22:45:36.992 INFO:teuthology.orchestra.run.smithi177.stdout:856 write 0xbaf809c thru 0xbafd787 (0x56ec bytes) 2019-12-16T22:45:37.003 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.003 INFO:teuthology.orchestra.run.smithi177.stdout:1403 read 0x7f8bbea thru 0x7f969eb (0xae02 bytes) 2019-12-16T22:45:37.003 INFO:teuthology.orchestra.run.smithi177.stdout:1404 writesame 0xce95c76 thru 0xce9ce96 data_size 0x1(0x7221 bytes) 2019-12-16T22:45:37.004 INFO:teuthology.orchestra.run.smithi177.stdout:963 write 0x8771ef8 thru 0x8777cdb (0x5de4 bytes) 2019-12-16T22:45:37.008 INFO:teuthology.orchestra.run.smithi177.stdout:1101 write 0x8cb863f thru 0x8cbea9e (0x6460 bytes) 2019-12-16T22:45:37.016 INFO:teuthology.orchestra.run.smithi177.stdout:857 write 0x5892a53 thru 0x589c54c (0x9afa bytes) 2019-12-16T22:45:37.017 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.017 INFO:teuthology.orchestra.run.smithi177.stdout:966 punch from 0xedabfa8 to 0xedafcbe, (0x3d16 bytes) 2019-12-16T22:45:37.017 INFO:teuthology.orchestra.run.smithi177.stdout:967 read 0x918b03b thru 0x918d22d (0x21f3 bytes) 2019-12-16T22:45:37.017 INFO:teuthology.orchestra.run.smithi177.stdout:968 punch from 0xd03f4e to 0xd0fc39, (0xbceb bytes) 2019-12-16T22:45:37.021 INFO:teuthology.orchestra.run.smithi177.stdout:972 read 0xf6ac00 thru 0xf736df (0x8ae0 bytes) 2019-12-16T22:45:37.023 INFO:teuthology.orchestra.run.smithi177.stdout:973 read 0x10e3836 thru 0x10e7db4 (0x457f bytes) 2019-12-16T22:45:37.023 INFO:teuthology.orchestra.run.smithi177.stdout:974 read 0xbe30d0b thru 0xbe32c66 (0x1f5c bytes) 2019-12-16T22:45:37.023 INFO:teuthology.orchestra.run.smithi177.stdout:975 write 0x4f13658 thru 0x4f1621f (0x2bc8 bytes) 2019-12-16T22:45:37.033 INFO:teuthology.orchestra.run.smithi177.stdout:858 write 0x71aa346 thru 0x71b30a6 (0x8d61 bytes) 2019-12-16T22:45:37.035 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.035 INFO:teuthology.orchestra.run.smithi177.stdout:977 read 0x89411d5 thru 0x89485e0 (0x740c bytes) 2019-12-16T22:45:37.035 INFO:teuthology.orchestra.run.smithi177.stdout:978 writesame 0x169f072 thru 0x16a388c data_size 0x15(0x481b bytes) 2019-12-16T22:45:37.044 INFO:teuthology.orchestra.run.smithi177.stdout:1405 read 0xc996ceb thru 0xc9a4e56 (0xe16c bytes) 2019-12-16T22:45:37.044 INFO:teuthology.orchestra.run.smithi177.stdout:1407 writesame 0x3559f75 thru 0x355ad2a data_size 0xf(0xdb6 bytes) 2019-12-16T22:45:37.046 INFO:teuthology.orchestra.run.smithi177.stdout:1103 trunc from 0xcf78e23 to 0x4098f85 2019-12-16T22:45:37.051 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.051 INFO:teuthology.orchestra.run.smithi177.stdout:860 punch from 0xd18b7fa to 0xd18e40b, (0x2c11 bytes) 2019-12-16T22:45:37.052 INFO:teuthology.orchestra.run.smithi177.stdout:861 punch from 0xc47074b to 0xc47346a, (0x2d1f bytes) 2019-12-16T22:45:37.052 INFO:teuthology.orchestra.run.smithi177.stdout:862 punch from 0x5148db2 to 0x514fe72, (0x70c0 bytes) 2019-12-16T22:45:37.052 INFO:teuthology.orchestra.run.smithi177.stdout:863 read 0xb9c857c thru 0xb9d135c (0x8de1 bytes) 2019-12-16T22:45:37.052 INFO:teuthology.orchestra.run.smithi177.stdout:1408 punch from 0xd7d424d to 0xd7d58e3, (0x1696 bytes) 2019-12-16T22:45:37.052 INFO:teuthology.orchestra.run.smithi177.stdout:1409 writesame 0x3a015be thru 0x3a10171 data_size 0x46(0xebb4 bytes) 2019-12-16T22:45:37.053 INFO:teuthology.orchestra.run.smithi177.stdout:865 write 0x4491922 thru 0x4498319 (0x69f8 bytes) 2019-12-16T22:45:37.057 INFO:teuthology.orchestra.run.smithi177.stdout:1410 read 0x1688fa thru 0x169834 (0xf3b bytes) 2019-12-16T22:45:37.057 INFO:teuthology.orchestra.run.smithi177.stdout:1411 read 0x7b7dc56 thru 0x7b8cb05 (0xeeb0 bytes) 2019-12-16T22:45:37.058 INFO:teuthology.orchestra.run.smithi177.stdout:981 read 0xb69538f thru 0xb6a330e (0xdf80 bytes) 2019-12-16T22:45:37.058 INFO:teuthology.orchestra.run.smithi177.stdout:984 write 0x8e11b10 thru 0x8e18149 (0x663a bytes) 2019-12-16T22:45:37.059 INFO:teuthology.orchestra.run.smithi177.stdout:1412 writesame 0x2626517 thru 0x262cbd9 data_size 0x4f(0x66c3 bytes) 2019-12-16T22:45:37.060 INFO:teuthology.orchestra.run.smithi177.stdout:867 writesame 0xdfba1da thru 0xdfc4ffd data_size 0x1e(0xae24 bytes) 2019-12-16T22:45:37.068 INFO:teuthology.orchestra.run.smithi177.stdout:1413 write 0x44a2ba4 thru 0x44ad940 (0xad9d bytes) 2019-12-16T22:45:37.069 INFO:teuthology.orchestra.run.smithi177.stdout:987 writesame 0xb3c161b thru 0xb3cb2cd data_size 0x47(0x9cb3 bytes) 2019-12-16T22:45:37.076 INFO:teuthology.orchestra.run.smithi177.stdout:1414 write 0x9d997b3 thru 0x9d9afe7 (0x1835 bytes) 2019-12-16T22:45:37.076 INFO:teuthology.orchestra.run.smithi177.stdout:609 read 0x679903 thru 0x68939f (0xfa9d bytes) 2019-12-16T22:45:37.077 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.077 INFO:teuthology.orchestra.run.smithi177.stdout:612 read 0x30d41f thru 0x3172e7 (0x9ec9 bytes) 2019-12-16T22:45:37.077 INFO:teuthology.orchestra.run.smithi177.stdout:988 write 0xc93213b thru 0xc937e4a (0x5d10 bytes) 2019-12-16T22:45:37.083 INFO:teuthology.orchestra.run.smithi177.stdout:868 trunc from 0xe84da6f to 0xa26ad5c 2019-12-16T22:45:37.083 INFO:teuthology.orchestra.run.smithi177.stdout:1415 read 0xc751f36 thru 0xc756756 (0x4821 bytes) 2019-12-16T22:45:37.083 INFO:teuthology.orchestra.run.smithi177.stdout:1417 writesame 0xc6af4fa thru 0xc6b699e data_size 0x1(0x74a5 bytes) 2019-12-16T22:45:37.084 INFO:teuthology.orchestra.run.smithi177.stdout:991 read 0x1b9141 thru 0x1c3828 (0xa6e8 bytes) 2019-12-16T22:45:37.086 INFO:teuthology.orchestra.run.smithi177.stdout:992 trunc from 0xeddaaca to 0xe47f073 2019-12-16T22:45:37.088 INFO:teuthology.orchestra.run.smithi177.stdout:1104 read 0x14568c thru 0x14eb85 (0x94fa bytes) 2019-12-16T22:45:37.092 INFO:teuthology.orchestra.run.smithi177.stdout:1106 punch from 0x97b802 to 0x97e679, (0x2e77 bytes) 2019-12-16T22:45:37.092 INFO:teuthology.orchestra.run.smithi177.stdout:1107 read 0x1e92ca9 thru 0x1e9a6a5 (0x79fd bytes) 2019-12-16T22:45:37.111 INFO:teuthology.orchestra.run.smithi177.stdout:1419 punch from 0x3090d76 to 0x309b65f, (0xa8e9 bytes) 2019-12-16T22:45:37.111 INFO:teuthology.orchestra.run.smithi177.stdout:1420 punch from 0xdc72d93 to 0xdc75eef, (0x315c bytes) 2019-12-16T22:45:37.112 INFO:teuthology.orchestra.run.smithi177.stdout:1421 write 0xbd0d0a3 thru 0xbd1956a (0xc4c8 bytes) 2019-12-16T22:45:37.122 INFO:teuthology.orchestra.run.smithi177.stdout:1422 write 0x403cc1b thru 0x40460b2 (0x9498 bytes) 2019-12-16T22:45:37.129 INFO:teuthology.orchestra.run.smithi177.stdout:993 writesame 0x4d7174e thru 0x4d7ecdf data_size 0x1(0xd592 bytes) 2019-12-16T22:45:37.130 INFO:teuthology.orchestra.run.smithi177.stdout:613 write 0xbc96200 thru 0xbc9bf48 (0x5d49 bytes) 2019-12-16T22:45:37.130 INFO:teuthology.orchestra.run.smithi177.stdout:869 punch from 0x77f08c2 to 0x77f51c8, (0x4906 bytes) 2019-12-16T22:45:37.130 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.131 INFO:teuthology.orchestra.run.smithi177.stdout:874 punch from 0x5234711 to 0x523febf, (0xb7ae bytes) 2019-12-16T22:45:37.131 INFO:teuthology.orchestra.run.smithi177.stdout:875 read 0x7d58a49 thru 0x7d681d8 (0xf790 bytes) 2019-12-16T22:45:37.131 INFO:teuthology.orchestra.run.smithi177.stdout:876 punch from 0x2282380 to 0x228bb0a, (0x978a bytes) 2019-12-16T22:45:37.131 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.132 INFO:teuthology.orchestra.run.smithi177.stdout:878 punch from 0x79debe3 to 0x79e5fa4, (0x73c1 bytes) 2019-12-16T22:45:37.132 INFO:teuthology.orchestra.run.smithi177.stdout:1423 writesame 0x4eee31 thru 0x4f8f00 data_size 0x3e(0xa0d0 bytes) 2019-12-16T22:45:37.138 INFO:teuthology.orchestra.run.smithi177.stdout:1425 write 0x4b07e16 thru 0x4b146b1 (0xc89c bytes) 2019-12-16T22:45:37.148 INFO:teuthology.orchestra.run.smithi177.stdout:1108 write 0x817d05f thru 0x818302e (0x5fd0 bytes) 2019-12-16T22:45:37.168 INFO:teuthology.orchestra.run.smithi177.stdout:1110 trunc from 0x818302f to 0xca74c5b 2019-12-16T22:45:37.174 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.174 INFO:teuthology.orchestra.run.smithi177.stdout:997 read 0x310646 thru 0x31826c (0x7c27 bytes) 2019-12-16T22:45:37.177 INFO:teuthology.orchestra.run.smithi177.stdout:998 writesame 0x8cdad55 thru 0x8cddc65 data_size 0x1(0x2f11 bytes) 2019-12-16T22:45:37.179 INFO:teuthology.orchestra.run.smithi177.stdout:1428 punch from 0x49290a7 to 0x492c637, (0x3590 bytes) 2019-12-16T22:45:37.179 INFO:teuthology.orchestra.run.smithi177.stdout:1429 read 0x2c25454 thru 0x2c279dc (0x2589 bytes) 2019-12-16T22:45:37.189 INFO:teuthology.orchestra.run.smithi177.stdout:614 trunc from 0xbc9bf49 to 0x21ebc23 2019-12-16T22:45:37.190 INFO:teuthology.orchestra.run.smithi177.stdout:879 writesame 0xda8e8f9 thru 0xda9715e data_size 0xd(0x8866 bytes) 2019-12-16T22:45:37.194 INFO:teuthology.orchestra.run.smithi177.stdout:1112 write 0x8159132 thru 0x815c574 (0x3443 bytes) 2019-12-16T22:45:37.197 INFO:teuthology.orchestra.run.smithi177.stdout:1430 trunc from 0xebed9f7 to 0x786a2ec 2019-12-16T22:45:37.197 INFO:teuthology.orchestra.run.smithi177.stdout:1114 punch from 0x1e13886 to 0x1e152b2, (0x1a2c bytes) 2019-12-16T22:45:37.197 INFO:teuthology.orchestra.run.smithi177.stdout:1115 read 0x4d86b08 thru 0x4d93c6a (0xd163 bytes) 2019-12-16T22:45:37.197 INFO:teuthology.orchestra.run.smithi177.stdout:1116 punch from 0x552a6a7 to 0x552f262, (0x4bbb bytes) 2019-12-16T22:45:37.198 INFO:teuthology.orchestra.run.smithi177.stdout:1117 writesame 0x3c1b44c thru 0x3c2b24e data_size 0x1(0xfe03 bytes) 2019-12-16T22:45:37.206 INFO:teuthology.orchestra.run.smithi177.stdout:880 trunc from 0xda9715f to 0xad43a28 2019-12-16T22:45:37.213 INFO:teuthology.orchestra.run.smithi177.stdout:999 trunc from 0xe47f073 to 0x22bb788 2019-12-16T22:45:37.238 INFO:teuthology.orchestra.run.smithi177.stdout:1118 read 0x851e37d thru 0x851f1cd (0xe51 bytes) 2019-12-16T22:45:37.238 INFO:teuthology.orchestra.run.smithi177.stdout:616 read 0x79c7a4 thru 0x79f12d (0x298a bytes) 2019-12-16T22:45:37.238 INFO:teuthology.orchestra.run.smithi177.stdout:619 read 0x2001fac thru 0x200ce93 (0xaee8 bytes) 2019-12-16T22:45:37.239 INFO:teuthology.orchestra.run.smithi177.stdout:620 punch from 0x1609591 to 0x161671f, (0xd18e bytes) 2019-12-16T22:45:37.245 INFO:teuthology.orchestra.run.smithi177.stdout:1119 trunc from 0xca74c5b to 0x9b2aa43 2019-12-16T22:45:37.266 INFO:teuthology.orchestra.run.smithi177.stdout:881 trunc from 0xad43a28 to 0x8655516 2019-12-16T22:45:37.284 INFO:teuthology.orchestra.run.smithi177.stdout:621 writesame 0xcd2f4e2 thru 0xcd3de22 data_size 0x1(0xe941 bytes) 2019-12-16T22:45:37.287 INFO:teuthology.orchestra.run.smithi177.stdout:622 read 0xc8dd257 thru 0xc8e2f8e (0x5d38 bytes) 2019-12-16T22:45:37.287 INFO:teuthology.orchestra.run.smithi177.stdout:623 read 0x3489a08 thru 0x3491da7 (0x83a0 bytes) 2019-12-16T22:45:37.297 INFO:teuthology.orchestra.run.smithi177.stdout:1431 write 0x930ff0e thru 0x931582d (0x5920 bytes) 2019-12-16T22:45:37.302 INFO:teuthology.orchestra.run.smithi177.stdout:624 trunc from 0xcd3de23 to 0x546fb55 2019-12-16T22:45:37.303 INFO:teuthology.orchestra.run.smithi177.stdout:882 read 0x4bffc7d thru 0x4c023f0 (0x2774 bytes) 2019-12-16T22:45:37.304 INFO:teuthology.orchestra.run.smithi177.stdout:1432 read 0x5087ec thru 0x514384 (0xbb99 bytes) 2019-12-16T22:45:37.305 INFO:teuthology.orchestra.run.smithi177.stdout:1120 writesame 0xc6c84ad thru 0xc6cba08 data_size 0x1(0x355c bytes) 2019-12-16T22:45:37.306 INFO:teuthology.orchestra.run.smithi177.stdout:1433 read 0xf02f2b thru 0xf061b4 (0x328a bytes) 2019-12-16T22:45:37.306 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.306 INFO:teuthology.orchestra.run.smithi177.stdout:1435 read 0x48cbae2 thru 0x48cce81 (0x13a0 bytes) 2019-12-16T22:45:37.308 INFO:teuthology.orchestra.run.smithi177.stdout:1121 writesame 0x480b5a3 thru 0x480dce1 data_size 0x3(0x273f bytes) 2019-12-16T22:45:37.311 INFO:teuthology.orchestra.run.smithi177.stdout:1436 trunc from 0x931582e to 0x6e8781d 2019-12-16T22:45:37.315 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.315 INFO:teuthology.orchestra.run.smithi177.stdout:1127 read 0xc444dc9 thru 0xc446163 (0x139b bytes) 2019-12-16T22:45:37.315 INFO:teuthology.orchestra.run.smithi177.stdout:1128 writesame 0x8b76e6 thru 0x8bb39a data_size 0x1(0x3cb5 bytes) 2019-12-16T22:45:37.329 INFO:teuthology.orchestra.run.smithi177.stdout:1129 write 0x4e6efb7 thru 0x4e7cad8 (0xdb22 bytes) 2019-12-16T22:45:37.333 INFO:teuthology.orchestra.run.smithi177.stdout:625 write 0x3260c39 thru 0x3268d97 (0x815f bytes) 2019-12-16T22:45:37.348 INFO:teuthology.orchestra.run.smithi177.stdout:626 read 0x47ea38d thru 0x47f7b4a (0xd7be bytes) 2019-12-16T22:45:37.349 INFO:teuthology.orchestra.run.smithi177.stdout:627 read 0x54298a8 thru 0x5429d41 (0x49a bytes) 2019-12-16T22:45:37.349 INFO:teuthology.orchestra.run.smithi177.stdout:628 write 0x2fd0374 thru 0x2fd3a90 (0x371d bytes) 2019-12-16T22:45:37.353 INFO:teuthology.orchestra.run.smithi177.stdout:884 write 0xde768e7 thru 0xde84ca0 (0xe3ba bytes) 2019-12-16T22:45:37.364 INFO:teuthology.orchestra.run.smithi177.stdout:1000 writesame 0xcfe0fcd thru 0xcfe6163 data_size 0x1(0x5197 bytes) 2019-12-16T22:45:37.374 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.374 INFO:teuthology.orchestra.run.smithi177.stdout:1002 write 0xc462dce thru 0xc4678cb (0x4afe bytes) 2019-12-16T22:45:37.375 INFO:teuthology.orchestra.run.smithi177.stdout:1437 flatten 2019-12-16T22:45:37.390 INFO:teuthology.orchestra.run.smithi177.stdout:885 write 0xeba1ac thru 0xec8178 (0xdfcd bytes) 2019-12-16T22:45:37.391 INFO:teuthology.orchestra.run.smithi177.stdout:629 trunc from 0x546fb55 to 0x37fc3a2 2019-12-16T22:45:37.391 INFO:teuthology.orchestra.run.smithi177.stdout:1003 punch from 0x76e8385 to 0x76f1aa7, (0x9722 bytes) 2019-12-16T22:45:37.391 INFO:teuthology.orchestra.run.smithi177.stdout:1005 writesame 0x32409d1 thru 0x324d144 data_size 0x3c(0xc774 bytes) 2019-12-16T22:45:37.397 INFO:teuthology.orchestra.run.smithi177.stdout:1130 writesame 0xd6ffac9 thru 0xd706ee1 data_size 0x1(0x7419 bytes) 2019-12-16T22:45:37.402 INFO:teuthology.orchestra.run.smithi177.stdout:1007 writesame 0x7eaf7d9 thru 0x7eaf86d data_size 0x1(0x95 bytes) 2019-12-16T22:45:37.402 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.403 INFO:teuthology.orchestra.run.smithi177.stdout:1132 clone 10 order 22 su 2097152 sc 2 2019-12-16T22:45:37.406 INFO:teuthology.orchestra.run.smithi177.stdout:886 read 0xccd9255 thru 0xcce7068 (0xde14 bytes) 2019-12-16T22:45:37.407 INFO:teuthology.orchestra.run.smithi177.stdout:887 writesame 0xa9f697b thru 0xaa00eec data_size 0x27(0xa572 bytes) 2019-12-16T22:45:37.412 INFO:teuthology.orchestra.run.smithi177.stdout:1008 read 0x45153f5 thru 0x451cb89 (0x7795 bytes) 2019-12-16T22:45:37.415 INFO:teuthology.orchestra.run.smithi177.stdout:1009 trunc from 0xcfe6164 to 0xe088bb6 2019-12-16T22:45:37.417 INFO:teuthology.orchestra.run.smithi177.stdout:1439 read 0x63d297a thru 0x63d6df3 (0x447a bytes) 2019-12-16T22:45:37.430 INFO:teuthology.orchestra.run.smithi177.stdout:630 trunc from 0x37fc3a2 to 0x56d8d85 2019-12-16T22:45:37.430 INFO:teuthology.orchestra.run.smithi177.stdout:888 trunc from 0xde84ca1 to 0x7d4e9ba 2019-12-16T22:45:37.435 INFO:teuthology.orchestra.run.smithi177.stdout:1010 read 0xc111781 thru 0xc1178be (0x613e bytes) 2019-12-16T22:45:37.436 INFO:teuthology.orchestra.run.smithi177.stdout:1011 read 0xafdfc2e thru 0xafe1a78 (0x1e4b bytes) 2019-12-16T22:45:37.438 INFO:teuthology.orchestra.run.smithi177.stdout:1013 trunc from 0xe088bb6 to 0xc920519 2019-12-16T22:45:37.453 INFO:teuthology.orchestra.run.smithi177.stdout:1441 write 0xc3275e7 thru 0xc3326df (0xb0f9 bytes) 2019-12-16T22:45:37.496 INFO:teuthology.orchestra.run.smithi177.stdout:1014 read 0x11280ff thru 0x1133c75 (0xbb77 bytes) 2019-12-16T22:45:37.496 INFO:teuthology.orchestra.run.smithi177.stdout:1015 read 0x196e002 thru 0x197b857 (0xd856 bytes) 2019-12-16T22:45:37.496 INFO:teuthology.orchestra.run.smithi177.stdout:1017 clone 9 order 21 su 32768 sc 13 2019-12-16T22:45:37.497 INFO:teuthology.orchestra.run.smithi177.stdout:889 read 0x11480fd thru 0x114fae8 (0x79ec bytes) 2019-12-16T22:45:37.497 INFO:teuthology.orchestra.run.smithi177.stdout:890 read 0x583e1c7 thru 0x5842c00 (0x4a3a bytes) 2019-12-16T22:45:37.497 INFO:teuthology.orchestra.run.smithi177.stdout:893 read 0x7ce8856 thru 0x7cf3fbb (0xb766 bytes) 2019-12-16T22:45:37.498 INFO:teuthology.orchestra.run.smithi177.stdout:897 writesame 0x20d1136 thru 0x20d3be0 data_size 0xb(0x2aab bytes) 2019-12-16T22:45:37.499 INFO:teuthology.orchestra.run.smithi177.stdout:898 punch from 0x22b8ce1 to 0x22bce63, (0x4182 bytes) 2019-12-16T22:45:37.499 INFO:teuthology.orchestra.run.smithi177.stdout:899 punch from 0x2fb823d to 0x2fc4c3e, (0xca01 bytes) 2019-12-16T22:45:37.500 INFO:teuthology.orchestra.run.smithi177.stdout:1442 trunc from 0xc3326e0 to 0x83289f8 2019-12-16T22:45:37.500 INFO:teuthology.orchestra.run.smithi177.stdout:633 writesame 0xc43138b thru 0xc437da7 data_size 0x5(0x6a1d bytes) 2019-12-16T22:45:37.501 INFO:teuthology.orchestra.run.smithi177.stdout:634 read 0xa7d309c thru 0xa7e14b1 (0xe416 bytes) 2019-12-16T22:45:37.503 INFO:teuthology.orchestra.run.smithi177.stdout:635 write 0xe5a881d thru 0xe5b422b (0xba0f bytes) 2019-12-16T22:45:37.503 INFO:teuthology.orchestra.run.smithi177.stdout:900 write 0xd95f5ba thru 0xd967f63 (0x89aa bytes) 2019-12-16T22:45:37.505 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.506 INFO:teuthology.orchestra.run.smithi177.stdout:1445 write 0xbdad7c thru 0xbe9884 (0xeb09 bytes) 2019-12-16T22:45:37.517 INFO:teuthology.orchestra.run.smithi177.stdout:1446 writesame 0x1372a6 thru 0x1392a7 data_size 0x11(0x2002 bytes) 2019-12-16T22:45:37.518 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone8 from 0xe1660a8 (overlap 0x112eeea) to 0x1b7e4a 2019-12-16T22:45:37.520 INFO:teuthology.orchestra.run.smithi177.stdout:901 read 0x37543cb thru 0x3762f50 (0xeb86 bytes) 2019-12-16T22:45:37.520 INFO:teuthology.orchestra.run.smithi177.stdout:903 write 0xd18f52e thru 0xd192967 (0x343a bytes) 2019-12-16T22:45:37.521 INFO:teuthology.orchestra.run.smithi177.stdout:636 punch from 0x78ec45b to 0x78f3e6b, (0x7a10 bytes) 2019-12-16T22:45:37.521 INFO:teuthology.orchestra.run.smithi177.stdout:637 write 0xdf99f3c thru 0xdfa998f (0xfa54 bytes) 2019-12-16T22:45:37.521 INFO:teuthology.orchestra.run.smithi177.stdout:1448 write 0x1187835 thru 0x11964fd (0xecc9 bytes) 2019-12-16T22:45:37.530 INFO:teuthology.orchestra.run.smithi177.stdout:904 read 0x1f97b thru 0x2700a (0x7690 bytes) 2019-12-16T22:45:37.541 INFO:teuthology.orchestra.run.smithi177.stdout:638 writesame 0x27cc74c thru 0x27cdd45 data_size 0x1(0x15fa bytes) 2019-12-16T22:45:37.542 INFO:teuthology.orchestra.run.smithi177.stdout:1449 trunc from 0x83289f8 to 0xb1343ac 2019-12-16T22:45:37.550 INFO:teuthology.orchestra.run.smithi177.stdout:905 trunc from 0xd967f64 to 0x5303801 2019-12-16T22:45:37.554 INFO:teuthology.orchestra.run.smithi177.stdout:640 write 0x9aa4f5e thru 0x9aae0ce (0x9171 bytes) 2019-12-16T22:45:37.574 INFO:teuthology.orchestra.run.smithi177.stdout:641 write 0x35cc482 thru 0x35d2629 (0x61a8 bytes) 2019-12-16T22:45:37.585 INFO:teuthology.orchestra.run.smithi177.stdout:1450 writesame 0x724c5ec thru 0x724fe8f data_size 0x19(0x38a4 bytes) 2019-12-16T22:45:37.590 INFO:teuthology.orchestra.run.smithi177.stdout:642 read 0x907cfcc thru 0x907f65b (0x2690 bytes) 2019-12-16T22:45:37.590 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.590 INFO:teuthology.orchestra.run.smithi177.stdout:645 read 0x3b1876f thru 0x3b1b073 (0x2905 bytes) 2019-12-16T22:45:37.590 INFO:teuthology.orchestra.run.smithi177.stdout:647 write 0x5c3991f thru 0x5c49285 (0xf967 bytes) 2019-12-16T22:45:37.595 INFO:teuthology.orchestra.run.smithi177.stdout:1451 write 0x5f891c7 thru 0x5f97f90 (0xedca bytes) 2019-12-16T22:45:37.605 INFO:teuthology.orchestra.run.smithi177.stdout:1453 write 0x7bd8031 thru 0x7bd952d (0x14fd bytes) 2019-12-16T22:45:37.615 INFO:teuthology.orchestra.run.smithi177.stdout:1454 write 0x9e6a763 thru 0x9e726ef (0x7f8d bytes) 2019-12-16T22:45:37.622 INFO:teuthology.orchestra.run.smithi177.stdout:648 trunc from 0xe5b422c to 0x78c3798 2019-12-16T22:45:37.624 INFO:teuthology.orchestra.run.smithi177.stdout:1455 read 0x2c614a thru 0x2cad5a (0x4c11 bytes) 2019-12-16T22:45:37.626 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.626 INFO:teuthology.orchestra.run.smithi177.stdout:1457 read 0x26a903f thru 0x26ac826 (0x37e8 bytes) 2019-12-16T22:45:37.627 INFO:teuthology.orchestra.run.smithi177.stdout:1460 read 0x7f78c44 thru 0x7f867eb (0xdba8 bytes) 2019-12-16T22:45:37.636 INFO:teuthology.orchestra.run.smithi177.stdout:1461 trunc from 0xb1343ac to 0x6097099 2019-12-16T22:45:37.637 INFO:teuthology.orchestra.run.smithi177.stdout:907 write 0xedf0260 thru 0xedf62ec (0x608d bytes) 2019-12-16T22:45:37.653 INFO:teuthology.orchestra.run.smithi177.stdout:649 write 0x66beb23 thru 0x66c4cde (0x61bc bytes) 2019-12-16T22:45:37.670 INFO:teuthology.orchestra.run.smithi177.stdout:908 trunc from 0xedf62ed to 0x114c441 2019-12-16T22:45:37.675 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #7, image image_cluster1.client.mirror.0-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent8 2019-12-16T22:45:37.675 INFO:teuthology.orchestra.run.smithi177.stdout:1463 punch from 0x4fd5bfd to 0x4fd641d, (0x820 bytes) 2019-12-16T22:45:37.675 INFO:teuthology.orchestra.run.smithi177.stdout:1464 read 0x2c350d4 thru 0x2c3afa2 (0x5ecf bytes) 2019-12-16T22:45:37.676 INFO:teuthology.orchestra.run.smithi177.stdout:1471 punch from 0x54dba46 to 0x54e0c49, (0x5203 bytes) 2019-12-16T22:45:37.676 INFO:teuthology.orchestra.run.smithi177.stdout:1474 read 0x516e98c thru 0x51727e9 (0x3e5e bytes) 2019-12-16T22:45:37.676 INFO:teuthology.orchestra.run.smithi177.stdout:1476 writesame 0x3183143 thru 0x3183bdd data_size 0x5(0xa9b bytes) 2019-12-16T22:45:37.678 INFO:teuthology.orchestra.run.smithi177.stdout:1477 punch from 0x5228d58 to 0x5238d4f, (0xfff7 bytes) 2019-12-16T22:45:37.679 INFO:teuthology.orchestra.run.smithi177.stdout:1478 read 0x2895a6a thru 0x289b3d3 (0x596a bytes) 2019-12-16T22:45:37.701 INFO:teuthology.orchestra.run.smithi177.stdout:650 write 0xe00adc1 thru 0xe01025c (0x549c bytes) 2019-12-16T22:45:37.703 INFO:teuthology.orchestra.run.smithi177.stdout:909 trunc from 0x114c441 to 0x1886385 2019-12-16T22:45:37.713 INFO:teuthology.orchestra.run.smithi177.stdout:652 read 0xc4a09bb thru 0xc4a6d7e (0x63c4 bytes) 2019-12-16T22:45:37.714 INFO:teuthology.orchestra.run.smithi177.stdout:653 write 0x770389a thru 0x7704e7e (0x15e5 bytes) 2019-12-16T22:45:37.716 INFO:teuthology.orchestra.run.smithi177.stdout:1479 write 0xd024cc0 thru 0xd026163 (0x14a4 bytes) 2019-12-16T22:45:37.721 INFO:teuthology.orchestra.run.smithi177.stdout:654 write 0x4fc8bb1 thru 0x4fd415d (0xb5ad bytes) 2019-12-16T22:45:37.732 INFO:teuthology.orchestra.run.smithi177.stdout:656 punch from 0xc927a5b to 0xc928d15, (0x12ba bytes) 2019-12-16T22:45:37.732 INFO:teuthology.orchestra.run.smithi177.stdout:657 punch from 0xb8f5917 to 0xb8f8f87, (0x3670 bytes) 2019-12-16T22:45:37.732 INFO:teuthology.orchestra.run.smithi177.stdout:659 write 0xae9e3f4 thru 0xaea2c81 (0x488e bytes) 2019-12-16T22:45:37.742 INFO:teuthology.orchestra.run.smithi177.stdout:661 writesame 0x657e317 thru 0x658790a data_size 0x2a(0x95f4 bytes) 2019-12-16T22:45:37.745 INFO:teuthology.orchestra.run.smithi177.stdout:1483 trunc from 0xd026164 to 0x73b8300 2019-12-16T22:45:37.750 INFO:teuthology.orchestra.run.smithi177.stdout:663 punch from 0x8f09593 to 0x8f09934, (0x3a1 bytes) 2019-12-16T22:45:37.750 INFO:teuthology.orchestra.run.smithi177.stdout:664 read 0x415bfb0 thru 0x4167f41 (0xbf92 bytes) 2019-12-16T22:45:37.768 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.768 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.769 INFO:teuthology.orchestra.run.smithi177.stdout:910 writesame 0xd7bb1f8 thru 0xd7c88f7 data_size 0xac(0xd700 bytes) 2019-12-16T22:45:37.771 INFO:teuthology.orchestra.run.smithi177.stdout:665 trunc from 0xe01025d to 0x1c33a67 2019-12-16T22:45:37.773 INFO:teuthology.orchestra.run.smithi177.stdout:1486 trunc from 0x73b8300 to 0x4cdec2a 2019-12-16T22:45:37.802 INFO:teuthology.orchestra.run.smithi177.stdout:912 writesame 0xd8e4fbc thru 0xd8e61f1 data_size 0x2a(0x1236 bytes) 2019-12-16T22:45:37.805 INFO:teuthology.orchestra.run.smithi177.stdout:913 write 0xaaec37 thru 0xabb09a (0xc464 bytes) 2019-12-16T22:45:37.805 INFO:teuthology.orchestra.run.smithi177.stdout:1487 writesame 0x1ad8f75 thru 0x1ae4519 data_size 0xd(0xb5a5 bytes) 2019-12-16T22:45:37.807 INFO:teuthology.orchestra.run.smithi177.stdout:666 read 0x19dcadc thru 0x19e680c (0x9d31 bytes) 2019-12-16T22:45:37.809 INFO:teuthology.orchestra.run.smithi177.stdout:667 trunc from 0x1c33a67 to 0xd19aa9 2019-12-16T22:45:37.809 INFO:teuthology.orchestra.run.smithi177.stdout:914 writesame 0xbcad734 thru 0xbcb8c07 data_size 0x8e(0xb4d4 bytes) 2019-12-16T22:45:37.812 INFO:teuthology.orchestra.run.smithi177.stdout:1490 punch from 0xf5bcf5 to 0xf5dfb2, (0x22bd bytes) 2019-12-16T22:45:37.813 INFO:teuthology.orchestra.run.smithi177.stdout:1496 read 0x46ffec2 thru 0x4708df8 (0x8f37 bytes) 2019-12-16T22:45:37.813 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.813 INFO:teuthology.orchestra.run.smithi177.stdout:1499 read 0x20ebb29 thru 0x20f14b4 (0x598c bytes) 2019-12-16T22:45:37.814 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.816 INFO:teuthology.orchestra.run.smithi177.stdout:915 read 0x9412709 thru 0x94150cf (0x29c7 bytes) 2019-12-16T22:45:37.816 INFO:teuthology.orchestra.run.smithi177.stdout:916 write 0x37f1461 thru 0x37f550e (0x40ae bytes) 2019-12-16T22:45:37.825 INFO:teuthology.orchestra.run.smithi177.stdout:917 read 0xd5081d9 thru 0xd513d81 (0xbba9 bytes) 2019-12-16T22:45:37.825 INFO:teuthology.orchestra.run.smithi177.stdout:921 punch from 0xcb6e667 to 0xcb718c6, (0x325f bytes) 2019-12-16T22:45:37.826 INFO:teuthology.orchestra.run.smithi177.stdout:922 punch from 0x490f582 to 0x4914ff2, (0x5a70 bytes) 2019-12-16T22:45:37.826 INFO:teuthology.orchestra.run.smithi177.stdout:923 read 0xb3bd6df thru 0xb3c3e09 (0x672b bytes) 2019-12-16T22:45:37.826 INFO:teuthology.orchestra.run.smithi177.stdout:1501 trunc from 0x4cdec2a to 0xb262af3 2019-12-16T22:45:37.831 INFO:teuthology.orchestra.run.smithi177.stdout:1304 write 0xb8d5d8a thru 0xb8e4cb7 (0xef2e bytes) 2019-12-16T22:45:37.842 INFO:teuthology.orchestra.run.smithi177.stdout:1502 writesame 0x1ce3ee thru 0x1d32b3 data_size 0x3(0x4ec6 bytes) 2019-12-16T22:45:37.857 INFO:teuthology.orchestra.run.smithi177.stdout:1305 writesame 0x5227a59 thru 0x522c6e0 data_size 0x4f(0x4c88 bytes) 2019-12-16T22:45:37.860 INFO:teuthology.orchestra.run.smithi177.stdout:924 trunc from 0xd8e61f2 to 0x1d0ad07 2019-12-16T22:45:37.864 INFO:teuthology.orchestra.run.smithi177.stdout:1306 write 0x60791a3 thru 0x607e998 (0x57f6 bytes) 2019-12-16T22:45:37.872 INFO:teuthology.orchestra.run.smithi177.stdout:1308 punch from 0x28be053 to 0x28c4c2a, (0x6bd7 bytes) 2019-12-16T22:45:37.872 INFO:teuthology.orchestra.run.smithi177.stdout:1309 read 0x5dab48e thru 0x5db32c1 (0x7e34 bytes) 2019-12-16T22:45:37.873 INFO:teuthology.orchestra.run.smithi177.stdout:1310 writesame 0x696eb3e thru 0x697ce37 data_size 0x11(0xe2fa bytes) 2019-12-16T22:45:37.881 INFO:teuthology.orchestra.run.smithi177.stdout:1504 writesame 0xe22ff11 thru 0xe23d04e data_size 0x1(0xd13e bytes) 2019-12-16T22:45:37.883 INFO:teuthology.orchestra.run.smithi177.stdout:1507 punch from 0x35f1bff to 0x35f2e36, (0x1237 bytes) 2019-12-16T22:45:37.886 INFO:teuthology.orchestra.run.smithi177.stdout:1311 writesame 0xcc6d6a5 thru 0xcc72605 data_size 0x1(0x4f61 bytes) 2019-12-16T22:45:37.886 INFO:teuthology.orchestra.run.smithi177.stdout:669 writesame 0xed20fcf thru 0xed30c5a data_size 0xe(0xfc8c bytes) 2019-12-16T22:45:37.887 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.887 INFO:teuthology.orchestra.run.smithi177.stdout:672 punch from 0x2e3eea8 to 0x2e486bb, (0x9813 bytes) 2019-12-16T22:45:37.887 INFO:teuthology.orchestra.run.smithi177.stdout:673 punch from 0x89d52d9 to 0x89e3ba5, (0xe8cc bytes) 2019-12-16T22:45:37.888 INFO:teuthology.orchestra.run.smithi177.stdout:674 write 0xa8f5573 thru 0xa904025 (0xeab3 bytes) 2019-12-16T22:45:37.900 INFO:teuthology.orchestra.run.smithi177.stdout:1312 read 0x8226dfc thru 0x82324c0 (0xb6c5 bytes) 2019-12-16T22:45:37.901 INFO:teuthology.orchestra.run.smithi177.stdout:1314 write 0x1c95fec thru 0x1c99d41 (0x3d56 bytes) 2019-12-16T22:45:37.905 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.905 INFO:teuthology.orchestra.run.smithi177.stdout:926 write 0x14e616d thru 0x14e84b4 (0x2348 bytes) 2019-12-16T22:45:37.907 INFO:teuthology.orchestra.run.smithi177.stdout:1508 trunc from 0xe23d04f to 0xa73444 2019-12-16T22:45:37.912 INFO:teuthology.orchestra.run.smithi177.stdout:675 write 0x27c1d02 thru 0x27c2a4c (0xd4b bytes) 2019-12-16T22:45:37.915 INFO:teuthology.orchestra.run.smithi177.stdout:1315 write 0x1eecfc6 thru 0x1eee1fc (0x1237 bytes) 2019-12-16T22:45:37.916 INFO:teuthology.orchestra.run.smithi177.stdout:928 read 0x15d26dc thru 0x15df7c6 (0xd0eb bytes) 2019-12-16T22:45:37.923 INFO:teuthology.orchestra.run.smithi177.stdout:676 read 0x4606454 thru 0x460f85d (0x940a bytes) 2019-12-16T22:45:37.923 INFO:teuthology.orchestra.run.smithi177.stdout:677 read 0xd5956c6 thru 0xd596533 (0xe6e bytes) 2019-12-16T22:45:37.923 INFO:teuthology.orchestra.run.smithi177.stdout:679 write 0xe5958f8 thru 0xe598364 (0x2a6d bytes) 2019-12-16T22:45:37.925 INFO:teuthology.orchestra.run.smithi177.stdout:1316 write 0xcb6b065 thru 0xcb79a10 (0xe9ac bytes) 2019-12-16T22:45:37.938 INFO:teuthology.orchestra.run.smithi177.stdout:680 write 0x978e218 thru 0x979e13a (0xff23 bytes) 2019-12-16T22:45:37.939 INFO:teuthology.orchestra.run.smithi177.stdout:1318 writesame 0x6a5310a thru 0x6a59575 data_size 0x2(0x646c bytes) 2019-12-16T22:45:37.959 INFO:teuthology.orchestra.run.smithi177.stdout:681 read 0x588ee9 thru 0x59416f (0xb287 bytes) 2019-12-16T22:45:37.959 INFO:teuthology.orchestra.run.smithi177.stdout:682 write 0x538548c thru 0x538d462 (0x7fd7 bytes) 2019-12-16T22:45:37.967 INFO:teuthology.orchestra.run.smithi177.stdout:929 write 0xbc11214 thru 0xbc1cfe0 (0xbdcd bytes) 2019-12-16T22:45:37.968 INFO:teuthology.orchestra.run.smithi177.stdout:684 writesame 0xb84651e thru 0xb84da2a data_size 0xd(0x750d bytes) 2019-12-16T22:45:37.973 INFO:teuthology.orchestra.run.smithi177.stdout:933 punch from 0x7490580 to 0x749ee80, (0xe900 bytes) 2019-12-16T22:45:37.975 INFO:teuthology.orchestra.run.smithi177.stdout:934 trunc from 0xbc1cfe1 to 0xaefca71 2019-12-16T22:45:37.978 INFO:teuthology.orchestra.run.smithi177.stdout:685 write 0xfb745d thru 0xfc4ae7 (0xd68b bytes) 2019-12-16T22:45:37.980 INFO:teuthology.orchestra.run.smithi177.stdout:1322 trunc from 0xe1660a8 to 0x501ace7 2019-12-16T22:45:37.995 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.995 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:37.995 INFO:teuthology.orchestra.run.smithi177.stdout:688 writesame 0x42a0124 thru 0x42a8f28 data_size 0x1(0x8e05 bytes) 2019-12-16T22:45:38.013 INFO:teuthology.orchestra.run.smithi177.stdout:935 write 0x231af32 thru 0x2328d27 (0xddf6 bytes) 2019-12-16T22:45:38.025 INFO:teuthology.orchestra.run.smithi177.stdout:692 write 0x6289d7f thru 0x628c496 (0x2718 bytes) 2019-12-16T22:45:38.025 INFO:teuthology.orchestra.run.smithi177.stdout:1509 writesame 0xee3c37c thru 0xee3fc09 data_size 0x13(0x388e bytes) 2019-12-16T22:45:38.029 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.029 INFO:teuthology.orchestra.run.smithi177.stdout:1511 write 0xc4f1957 thru 0xc4fc3dc (0xaa86 bytes) 2019-12-16T22:45:38.031 INFO:teuthology.orchestra.run.smithi177.stdout:936 read 0x6ed6a65 thru 0x6ed8183 (0x171f bytes) 2019-12-16T22:45:38.038 INFO:teuthology.orchestra.run.smithi177.stdout:693 write 0x149f602 thru 0x14a7375 (0x7d74 bytes) 2019-12-16T22:45:38.041 INFO:teuthology.orchestra.run.smithi177.stdout:1512 write 0xdc6580e thru 0xdc7135f (0xbb52 bytes) 2019-12-16T22:45:38.047 INFO:teuthology.orchestra.run.smithi177.stdout:1323 punch from 0x1d1e0bb to 0x1d21e4b, (0x3d90 bytes) 2019-12-16T22:45:38.047 INFO:teuthology.orchestra.run.smithi177.stdout:694 read 0x3082fa9 thru 0x309210a (0xf162 bytes) 2019-12-16T22:45:38.048 INFO:teuthology.orchestra.run.smithi177.stdout:695 writesame 0x5eaa836 thru 0x5eb283f data_size 0x1b(0x800a bytes) 2019-12-16T22:45:38.049 INFO:teuthology.orchestra.run.smithi177.stdout:1513 punch from 0xc6c1109 to 0xc6c956b, (0x8462 bytes) 2019-12-16T22:45:38.049 INFO:teuthology.orchestra.run.smithi177.stdout:1516 write 0x989ee39 thru 0x98a14bb (0x2683 bytes) 2019-12-16T22:45:38.052 INFO:teuthology.orchestra.run.smithi177.stdout:937 trunc from 0xaefca71 to 0x11102f0 2019-12-16T22:45:38.056 INFO:teuthology.orchestra.run.smithi177.stdout:697 read 0x14f6942 thru 0x14fe12c (0x77eb bytes) 2019-12-16T22:45:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:699 writesame 0xc03d9b2 thru 0xc046c01 data_size 0x8(0x9250 bytes) 2019-12-16T22:45:38.057 INFO:teuthology.orchestra.run.smithi177.stdout:1517 writesame 0x8c6ab15 thru 0x8c6d737 data_size 0x1(0x2c23 bytes) 2019-12-16T22:45:38.075 INFO:teuthology.orchestra.run.smithi177.stdout:703 read 0x13bb6f thru 0x14b84c (0xfcde bytes) 2019-12-16T22:45:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:705 punch from 0x55f2e90 to 0x55f88ac, (0x5a1c bytes) 2019-12-16T22:45:38.076 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:707 write 0x801be58 thru 0x802acfd (0xeea6 bytes) 2019-12-16T22:45:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:1325 write 0x9c5f9fc thru 0x9c662b1 (0x68b6 bytes) 2019-12-16T22:45:38.080 INFO:teuthology.orchestra.run.smithi177.stdout:1519 trunc from 0xee3fc0a to 0xa468688 2019-12-16T22:45:38.101 INFO:teuthology.orchestra.run.smithi177.stdout:1328 read 0x915fa56 thru 0x916a61b (0xabc6 bytes) 2019-12-16T22:45:38.101 INFO:teuthology.orchestra.run.smithi177.stdout:1329 trunc from 0x9c662b2 to 0xc5ec013 2019-12-16T22:45:38.101 INFO:teuthology.orchestra.run.smithi177.stdout:708 read 0xa89534f thru 0xa8a481d (0xf4cf bytes) 2019-12-16T22:45:38.102 INFO:teuthology.orchestra.run.smithi177.stdout:709 read 0xc48c3b4 thru 0xc49ab7c (0xe7c9 bytes) 2019-12-16T22:45:38.102 INFO:teuthology.orchestra.run.smithi177.stdout:710 write 0xecbe59f thru 0xecccb05 (0xe567 bytes) 2019-12-16T22:45:38.116 INFO:teuthology.orchestra.run.smithi177.stdout:711 write 0x75aaa02 thru 0x75b6dcb (0xc3ca bytes) 2019-12-16T22:45:38.117 INFO:teuthology.orchestra.run.smithi177.stdout:938 write 0x16bb0a7 thru 0x16c5e23 (0xad7d bytes) 2019-12-16T22:45:38.129 INFO:teuthology.orchestra.run.smithi177.stdout:1520 write 0x79b75f9 thru 0x79bb402 (0x3e0a bytes) 2019-12-16T22:45:38.129 INFO:teuthology.orchestra.run.smithi177.stdout:1330 punch from 0x10b7b31 to 0x10bb271, (0x3740 bytes) 2019-12-16T22:45:38.130 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.134 INFO:teuthology.orchestra.run.smithi177.stdout:712 write 0x5c8e115 thru 0x5c9d2a1 (0xf18d bytes) 2019-12-16T22:45:38.138 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.139 INFO:teuthology.orchestra.run.smithi177.stdout:1522 write 0x95fb0e1 thru 0x96049d2 (0x98f2 bytes) 2019-12-16T22:45:38.143 INFO:teuthology.orchestra.run.smithi177.stdout:1332 trunc from 0xc5ec013 to 0x47d77fb 2019-12-16T22:45:38.148 INFO:teuthology.orchestra.run.smithi177.stdout:1524 write 0x2cd6ec8 thru 0x2cd86e2 (0x181b bytes) 2019-12-16T22:45:38.148 INFO:teuthology.orchestra.run.smithi177.stdout:713 write 0x11b552c thru 0x11be2df (0x8db4 bytes) 2019-12-16T22:45:38.155 INFO:teuthology.orchestra.run.smithi177.stdout:1525 trunc from 0xa468688 to 0xa5b6796 2019-12-16T22:45:38.161 INFO:teuthology.orchestra.run.smithi177.stdout:714 read 0x2ced392 thru 0x2cf2f1e (0x5b8d bytes) 2019-12-16T22:45:38.161 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.166 INFO:teuthology.orchestra.run.smithi177.stdout:716 trunc from 0xed30c5b to 0xcfce33d 2019-12-16T22:45:38.182 INFO:teuthology.orchestra.run.smithi177.stdout:1526 clone 7 order 19 su 32768 sc 11 2019-12-16T22:45:38.183 INFO:teuthology.orchestra.run.smithi177.stdout:941 write 0xc97dccb thru 0xc98c0df (0xe415 bytes) 2019-12-16T22:45:38.197 INFO:teuthology.orchestra.run.smithi177.stdout:1333 trunc from 0x47d77fb to 0x72f92f7 2019-12-16T22:45:38.212 INFO:teuthology.orchestra.run.smithi177.stdout:942 trunc from 0xc98c0e0 to 0x32479c7 2019-12-16T22:45:38.213 INFO:teuthology.orchestra.run.smithi177.stdout:1335 write 0x3d3d451 thru 0x3d47dc2 (0xa972 bytes) 2019-12-16T22:45:38.217 INFO:teuthology.orchestra.run.smithi177.stdout:717 trunc from 0xcfce33d to 0x343c536 2019-12-16T22:45:38.228 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.241 INFO:teuthology.orchestra.run.smithi177.stdout:1339 trunc from 0x72f92f7 to 0x193f244 2019-12-16T22:45:38.281 INFO:teuthology.orchestra.run.smithi177.stdout:718 trunc from 0x343c536 to 0xad9db00 2019-12-16T22:45:38.294 INFO:teuthology.orchestra.run.smithi177.stdout:944 write 0xd1c801a thru 0xd1ce390 (0x6377 bytes) 2019-12-16T22:45:38.294 INFO:teuthology.orchestra.run.smithi177.stdout:721 write 0x30fce0d thru 0x30ffd07 (0x2efb bytes) 2019-12-16T22:45:38.302 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.303 INFO:teuthology.orchestra.run.smithi177.stdout:946 write 0x8964c47 thru 0x896a447 (0x5801 bytes) 2019-12-16T22:45:38.309 INFO:teuthology.orchestra.run.smithi177.stdout:948 writesame 0x601cad4 thru 0x6020f98 data_size 0x7(0x44c5 bytes) 2019-12-16T22:45:38.310 INFO:teuthology.orchestra.run.smithi177.stdout:1340 writesame 0xcfcfd23 thru 0xcfdd1f5 data_size 0x7f(0xd4d3 bytes) 2019-12-16T22:45:38.313 INFO:teuthology.orchestra.run.smithi177.stdout:722 trunc from 0xad9db00 to 0x3931aba 2019-12-16T22:45:38.314 INFO:teuthology.orchestra.run.smithi177.stdout:1341 punch from 0xbb50f9a to 0xbb552bb, (0x4321 bytes) 2019-12-16T22:45:38.314 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.314 INFO:teuthology.orchestra.run.smithi177.stdout:1344 writesame 0x135a7c5 thru 0x1365b4e data_size 0x2(0xb38a bytes) 2019-12-16T22:45:38.317 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.317 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.317 INFO:teuthology.orchestra.run.smithi177.stdout:952 write 0xb26b9e2 thru 0xb278bd7 (0xd1f6 bytes) 2019-12-16T22:45:38.335 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.338 INFO:teuthology.orchestra.run.smithi177.stdout:954 trunc from 0xd1ce391 to 0x6918259 2019-12-16T22:45:38.343 INFO:teuthology.orchestra.run.smithi177.stdout:1345 punch from 0xcb947ba to 0xcb9c1bb, (0x7a01 bytes) 2019-12-16T22:45:38.344 INFO:teuthology.orchestra.run.smithi177.stdout:1346 punch from 0x98894e7 to 0x9893cd2, (0xa7eb bytes) 2019-12-16T22:45:38.344 INFO:teuthology.orchestra.run.smithi177.stdout:1347 read 0x6f19b50 thru 0x6f209b6 (0x6e67 bytes) 2019-12-16T22:45:38.344 INFO:teuthology.orchestra.run.smithi177.stdout:1348 write 0xa86a922 thru 0xa8744b7 (0x9b96 bytes) 2019-12-16T22:45:38.355 INFO:teuthology.orchestra.run.smithi177.stdout:1349 read 0x133f588 thru 0x134064c (0x10c5 bytes) 2019-12-16T22:45:38.356 INFO:teuthology.orchestra.run.smithi177.stdout:1350 write 0x9700cc4 thru 0x97059db (0x4d18 bytes) 2019-12-16T22:45:38.374 INFO:teuthology.orchestra.run.smithi177.stdout:724 writesame 0xc65ca41 thru 0xc662171 data_size 0x11(0x5731 bytes) 2019-12-16T22:45:38.384 INFO:teuthology.orchestra.run.smithi177.stdout:726 writesame 0x423ead9 thru 0x4249cf9 data_size 0x1(0xb221 bytes) 2019-12-16T22:45:38.384 INFO:teuthology.orchestra.run.smithi177.stdout:955 trunc from 0x6918259 to 0x89219fd 2019-12-16T22:45:38.397 INFO:teuthology.orchestra.run.smithi177.stdout:1351 trunc from 0xcfdd1f6 to 0x348c08f 2019-12-16T22:45:38.415 INFO:teuthology.orchestra.run.smithi177.stdout:727 read 0x4397cac thru 0x43a296b (0xacc0 bytes) 2019-12-16T22:45:38.415 INFO:teuthology.orchestra.run.smithi177.stdout:728 punch from 0x729bc68 to 0x72a1fa0, (0x6338 bytes) 2019-12-16T22:45:38.416 INFO:teuthology.orchestra.run.smithi177.stdout:729 read 0x79d7da9 thru 0x79dd815 (0x5a6d bytes) 2019-12-16T22:45:38.418 INFO:teuthology.orchestra.run.smithi177.stdout:956 read 0x47d966f thru 0x47e456c (0xaefe bytes) 2019-12-16T22:45:38.431 INFO:teuthology.orchestra.run.smithi177.stdout:959 trunc from 0x89219fd to 0x81b8fb2 2019-12-16T22:45:38.436 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.436 INFO:teuthology.orchestra.run.smithi177.stdout:962 writesame 0x19f3de0 thru 0x1a02be3 data_size 0x2(0xee04 bytes) 2019-12-16T22:45:38.438 INFO:teuthology.orchestra.run.smithi177.stdout:1355 trunc from 0x348c08f to 0x27929e 2019-12-16T22:45:38.443 INFO:teuthology.orchestra.run.smithi177.stdout:731 write 0xdffa026 thru 0xe009061 (0xf03c bytes) 2019-12-16T22:45:38.472 INFO:teuthology.orchestra.run.smithi177.stdout:964 writesame 0x2553a9 thru 0x26401a data_size 0x5(0xec72 bytes) 2019-12-16T22:45:38.494 INFO:teuthology.orchestra.run.smithi177.stdout:965 trunc from 0x81b8fb2 to 0x595e246 2019-12-16T22:45:38.515 INFO:teuthology.orchestra.run.smithi177.stdout:733 trunc from 0xe009062 to 0x52cddab 2019-12-16T22:45:38.516 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.516 INFO:teuthology.orchestra.run.smithi177.stdout:1357 read 0x18200f thru 0x182611 (0x603 bytes) 2019-12-16T22:45:38.527 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.3-clone9 intact 2019-12-16T22:45:38.530 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.4-clone8 2019-12-16T22:45:38.545 INFO:teuthology.orchestra.run.smithi177.stdout:968 write 0x82b0940 thru 0x82b4050 (0x3711 bytes) 2019-12-16T22:45:38.546 INFO:teuthology.orchestra.run.smithi177.stdout:734 trunc from 0x52cddab to 0x1a17df 2019-12-16T22:45:38.555 INFO:teuthology.orchestra.run.smithi177.stdout:970 writesame 0xcfed0f thru 0xd09729 data_size 0x1(0xaa1b bytes) 2019-12-16T22:45:38.556 INFO:teuthology.orchestra.run.smithi177.stdout:1358 writesame 0xd3cd13e thru 0xd3d421c data_size 0x1(0x70df bytes) 2019-12-16T22:45:38.590 INFO:teuthology.orchestra.run.smithi177.stdout:971 read 0x86a26d thru 0x878f93 (0xed27 bytes) 2019-12-16T22:45:38.591 INFO:teuthology.orchestra.run.smithi177.stdout:1360 writesame 0xee07a29 thru 0xee1122e data_size 0x3d(0x9806 bytes) 2019-12-16T22:45:38.593 INFO:teuthology.orchestra.run.smithi177.stdout:1361 punch from 0x703c1e9 to 0x70463af, (0xa1c6 bytes) 2019-12-16T22:45:38.593 INFO:teuthology.orchestra.run.smithi177.stdout:1364 read 0xec12c1c thru 0xec1ca1a (0x9dff bytes) 2019-12-16T22:45:38.593 INFO:teuthology.orchestra.run.smithi177.stdout:1365 clone 10 order 22 su 65536 sc 2 2019-12-16T22:45:38.594 INFO:teuthology.orchestra.run.smithi177.stdout:972 trunc from 0x82b4051 to 0x6aeb26d 2019-12-16T22:45:38.619 INFO:teuthology.orchestra.run.smithi177.stdout:974 writesame 0x41aad2c thru 0x41b7dd1 data_size 0x11(0xd0a6 bytes) 2019-12-16T22:45:38.622 INFO:teuthology.orchestra.run.smithi177.stdout:735 writesame 0x2f0706 thru 0x2ff03e data_size 0x1(0xe939 bytes) 2019-12-16T22:45:38.629 INFO:teuthology.orchestra.run.smithi177.stdout:736 read 0x27bd0d thru 0x28258d (0x6881 bytes) 2019-12-16T22:45:38.648 INFO:teuthology.orchestra.run.smithi177.stdout:737 writesame 0x17b5c83 thru 0x17be756 data_size 0xa(0x8ad4 bytes) 2019-12-16T22:45:38.656 INFO:teuthology.orchestra.run.smithi177.stdout:975 writesame 0xd66b2ab thru 0xd674e7e data_size 0x2(0x9bd4 bytes) 2019-12-16T22:45:38.670 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #5, image image_cluster1.client.mirror.1-clone5 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent6 2019-12-16T22:45:38.681 INFO:teuthology.orchestra.run.smithi177.stdout:976 write 0xdbade58 thru 0xdbb5dfd (0x7fa6 bytes) 2019-12-16T22:45:38.687 INFO:teuthology.orchestra.run.smithi177.stdout:739 write 0x71fcfd3 thru 0x7207883 (0xa8b1 bytes) 2019-12-16T22:45:38.688 INFO:teuthology.orchestra.run.smithi177.stdout:977 write 0x2f04cc9 thru 0x2f0991c (0x4c54 bytes) 2019-12-16T22:45:38.695 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.695 INFO:teuthology.orchestra.run.smithi177.stdout:979 read 0x3bae8c3 thru 0x3bbcc1e (0xe35c bytes) 2019-12-16T22:45:38.695 INFO:teuthology.orchestra.run.smithi177.stdout:980 writesame 0xa0708ed thru 0xa07b5a0 data_size 0xe(0xacb4 bytes) 2019-12-16T22:45:38.698 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.698 INFO:teuthology.orchestra.run.smithi177.stdout:1528 read 0x59f0ec9 thru 0x59fd615 (0xc74d bytes) 2019-12-16T22:45:38.698 INFO:teuthology.orchestra.run.smithi177.stdout:740 punch from 0xf00216 to 0xf02681, (0x246b bytes) 2019-12-16T22:45:38.698 INFO:teuthology.orchestra.run.smithi177.stdout:742 read 0x21c490a thru 0x21ce449 (0x9b40 bytes) 2019-12-16T22:45:38.698 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.699 INFO:teuthology.orchestra.run.smithi177.stdout:744 punch from 0x4258b84 to 0x425b7d7, (0x2c53 bytes) 2019-12-16T22:45:38.699 INFO:teuthology.orchestra.run.smithi177.stdout:745 read 0xd28d3f thru 0xd325e3 (0x98a5 bytes) 2019-12-16T22:45:38.699 INFO:teuthology.orchestra.run.smithi177.stdout:746 read 0x4499184 thru 0x44a3329 (0xa1a6 bytes) 2019-12-16T22:45:38.702 INFO:teuthology.orchestra.run.smithi177.stdout:982 writesame 0x70dab07 thru 0x70e19a5 data_size 0x1(0x6e9f bytes) 2019-12-16T22:45:38.726 INFO:teuthology.orchestra.run.smithi177.stdout:1530 writesame 0x1c6e603 thru 0x1c77b4c data_size 0x2(0x954a bytes) 2019-12-16T22:45:38.729 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.729 INFO:teuthology.orchestra.run.smithi177.stdout:985 flatten 2019-12-16T22:45:38.736 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #8, image image_cluster1.client.mirror.3-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent9 2019-12-16T22:45:38.740 INFO:teuthology.orchestra.run.smithi177.stdout:747 write 0xadad4a9 thru 0xadb85ed (0xb145 bytes) 2019-12-16T22:45:38.748 INFO:teuthology.orchestra.run.smithi177.stdout:986 writesame 0x628a00d thru 0x6297cb2 data_size 0x3d(0xdca6 bytes) 2019-12-16T22:45:38.751 INFO:teuthology.orchestra.run.smithi177.stdout:1531 trunc from 0xa5b6796 to 0xca05e5e 2019-12-16T22:45:38.753 INFO:teuthology.orchestra.run.smithi177.stdout:989 write 0x3582046 thru 0x358aee2 (0x8e9d bytes) 2019-12-16T22:45:38.761 INFO:teuthology.orchestra.run.smithi177.stdout:992 writesame 0x33c2a thru 0x4062a data_size 0x1(0xca01 bytes) 2019-12-16T22:45:38.771 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.771 INFO:teuthology.orchestra.run.smithi177.stdout:1536 read 0x94c2690 thru 0x94cf596 (0xcf07 bytes) 2019-12-16T22:45:38.771 INFO:teuthology.orchestra.run.smithi177.stdout:1537 read 0x5cb610b thru 0x5cc282a (0xc720 bytes) 2019-12-16T22:45:38.772 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.792 INFO:teuthology.orchestra.run.smithi177.stdout:749 write 0xc26b8c7 thru 0xc270e14 (0x554e bytes) 2019-12-16T22:45:38.808 INFO:teuthology.orchestra.run.smithi177.stdout:993 trunc from 0xdbb5dfe to 0xb5e27bd 2019-12-16T22:45:38.809 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.809 INFO:teuthology.orchestra.run.smithi177.stdout:751 punch from 0x8c01881 to 0x8c026db, (0xe5a bytes) 2019-12-16T22:45:38.809 INFO:teuthology.orchestra.run.smithi177.stdout:753 read 0x782d572 thru 0x783c323 (0xedb2 bytes) 2019-12-16T22:45:38.810 INFO:teuthology.orchestra.run.smithi177.stdout:1539 write 0xce1fd12 thru 0xce2ce78 (0xd167 bytes) 2019-12-16T22:45:38.815 INFO:teuthology.orchestra.run.smithi177.stdout:1541 punch from 0xcac0625 to 0xcacb374, (0xad4f bytes) 2019-12-16T22:45:38.815 INFO:teuthology.orchestra.run.smithi177.stdout:1542 read 0x58f437b thru 0x5900591 (0xc217 bytes) 2019-12-16T22:45:38.816 INFO:teuthology.orchestra.run.smithi177.stdout:1543 write 0x582b4c5 thru 0x582cc29 (0x1765 bytes) 2019-12-16T22:45:38.821 INFO:teuthology.orchestra.run.smithi177.stdout:1544 write 0x9a405a4 thru 0x9a485ec (0x8049 bytes) 2019-12-16T22:45:38.825 INFO:teuthology.orchestra.run.smithi177.stdout:754 trunc from 0xc270e15 to 0x11fd39d 2019-12-16T22:45:38.832 INFO:teuthology.orchestra.run.smithi177.stdout:1545 punch from 0x5ebf5f8 to 0x5ec6087, (0x6a8f bytes) 2019-12-16T22:45:38.833 INFO:teuthology.orchestra.run.smithi177.stdout:1546 read 0xb37d3fe thru 0xb38a2f5 (0xcef8 bytes) 2019-12-16T22:45:38.833 INFO:teuthology.orchestra.run.smithi177.stdout:1547 writesame 0x6dceedb thru 0x6dcf903 data_size 0x11(0xa29 bytes) 2019-12-16T22:45:38.842 INFO:teuthology.orchestra.run.smithi177.stdout:1548 read 0x6e423a8 thru 0x6e48c86 (0x68df bytes) 2019-12-16T22:45:38.842 INFO:teuthology.orchestra.run.smithi177.stdout:997 trunc from 0xb5e27bd to 0x475ecda 2019-12-16T22:45:38.856 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.862 INFO:teuthology.orchestra.run.smithi177.stdout:1550 trunc from 0xce2ce79 to 0x2d4d3 2019-12-16T22:45:38.863 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.863 INFO:teuthology.orchestra.run.smithi177.stdout:999 writesame 0x15a536 thru 0x169e65 data_size 0x4(0xf930 bytes) 2019-12-16T22:45:38.879 INFO:teuthology.orchestra.run.smithi177.stdout:1000 write 0x424240a thru 0x42426e4 (0x2db bytes) 2019-12-16T22:45:38.891 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.900 INFO:teuthology.orchestra.run.smithi177.stdout:757 write 0x5b202b1 thru 0x5b2cc17 (0xc967 bytes) 2019-12-16T22:45:38.923 INFO:teuthology.orchestra.run.smithi177.stdout:758 punch from 0x527fd5f to 0x52802f6, (0x597 bytes) 2019-12-16T22:45:38.923 INFO:teuthology.orchestra.run.smithi177.stdout:760 read 0x44e0ef7 thru 0x44ece4b (0xbf55 bytes) 2019-12-16T22:45:38.923 INFO:teuthology.orchestra.run.smithi177.stdout:762 punch from 0x24b32a6 to 0x24b7bbf, (0x4919 bytes) 2019-12-16T22:45:38.924 INFO:teuthology.orchestra.run.smithi177.stdout:763 read 0x5a5e858 thru 0x5a6963f (0xade8 bytes) 2019-12-16T22:45:38.931 INFO:teuthology.orchestra.run.smithi177.stdout:1002 write 0xb006e7b thru 0xb008606 (0x178c bytes) 2019-12-16T22:45:38.935 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #7, image image_cluster1.client.mirror.4-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent8 2019-12-16T22:45:38.938 INFO:teuthology.orchestra.run.smithi177.stdout:1003 writesame 0x15f0e37 thru 0x15f7cd4 data_size 0x1(0x6e9e bytes) 2019-12-16T22:45:38.956 INFO:teuthology.orchestra.run.smithi177.stdout:1004 read 0xae68f69 thru 0xae772af (0xe347 bytes) 2019-12-16T22:45:38.956 INFO:teuthology.orchestra.run.smithi177.stdout:1005 write 0x12f064b thru 0x12f1903 (0x12b9 bytes) 2019-12-16T22:45:38.962 INFO:teuthology.orchestra.run.smithi177.stdout:1551 writesame 0x74eaba8 thru 0x74eef23 data_size 0xe(0x437c bytes) 2019-12-16T22:45:38.963 INFO:teuthology.orchestra.run.smithi177.stdout:1007 write 0x6b183de thru 0x6b22074 (0x9c97 bytes) 2019-12-16T22:45:38.963 INFO:teuthology.orchestra.run.smithi177.stdout:1552 read 0x16a5b18 thru 0x16b2ad9 (0xcfc2 bytes) 2019-12-16T22:45:38.964 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:38.966 INFO:teuthology.orchestra.run.smithi177.stdout:1555 trunc from 0x74eef24 to 0x63c3cda 2019-12-16T22:45:38.966 INFO:teuthology.orchestra.run.smithi177.stdout:764 write 0x98f2058 thru 0x98f97cb (0x7774 bytes) 2019-12-16T22:45:38.971 INFO:teuthology.orchestra.run.smithi177.stdout:1008 read 0x8fe1d06 thru 0x8fea0a1 (0x839c bytes) 2019-12-16T22:45:38.977 INFO:teuthology.orchestra.run.smithi177.stdout:765 read 0x26ee4f4 thru 0x26f761a (0x9127 bytes) 2019-12-16T22:45:38.978 INFO:teuthology.orchestra.run.smithi177.stdout:766 punch from 0x5e98a96 to 0x5ea51f2, (0xc75c bytes) 2019-12-16T22:45:38.978 INFO:teuthology.orchestra.run.smithi177.stdout:770 read 0x3118617 thru 0x311f838 (0x7222 bytes) 2019-12-16T22:45:38.978 INFO:teuthology.orchestra.run.smithi177.stdout:771 write 0x8940720 thru 0x89495c4 (0x8ea5 bytes) 2019-12-16T22:45:38.992 INFO:teuthology.orchestra.run.smithi177.stdout:1556 trunc from 0x63c3cda to 0x7465116 2019-12-16T22:45:38.993 INFO:teuthology.orchestra.run.smithi177.stdout:772 punch from 0x21f303a to 0x21feb2e, (0xbaf4 bytes) 2019-12-16T22:45:38.993 INFO:teuthology.orchestra.run.smithi177.stdout:773 write 0x3f23344 thru 0x3f314e7 (0xe1a4 bytes) 2019-12-16T22:45:39.001 INFO:teuthology.orchestra.run.smithi177.stdout:1009 write 0xd239e28 thru 0xd249327 (0xf500 bytes) 2019-12-16T22:45:39.020 INFO:teuthology.orchestra.run.smithi177.stdout:1011 trunc from 0xd249328 to 0x96c11f3 2019-12-16T22:45:39.028 INFO:teuthology.orchestra.run.smithi177.stdout:774 write 0x9f54499 thru 0x9f62b57 (0xe6bf bytes) 2019-12-16T22:45:39.035 INFO:teuthology.orchestra.run.smithi177.stdout:1557 write 0xa441264 thru 0xa44340a (0x21a7 bytes) 2019-12-16T22:45:39.045 INFO:teuthology.orchestra.run.smithi177.stdout:775 read 0x8de0a71 thru 0x8deb1db (0xa76b bytes) 2019-12-16T22:45:39.046 INFO:teuthology.orchestra.run.smithi177.stdout:777 read 0x5f6fe6c thru 0x5f790dd (0x9272 bytes) 2019-12-16T22:45:39.046 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.047 INFO:teuthology.orchestra.run.smithi177.stdout:780 punch from 0x2200868 to 0x22037f7, (0x2f8f bytes) 2019-12-16T22:45:39.047 INFO:teuthology.orchestra.run.smithi177.stdout:781 read 0x765fde thru 0x76e604 (0x8627 bytes) 2019-12-16T22:45:39.048 INFO:teuthology.orchestra.run.smithi177.stdout:782 punch from 0x3e3e309 to 0x3e49925, (0xb61c bytes) 2019-12-16T22:45:39.048 INFO:teuthology.orchestra.run.smithi177.stdout:783 writesame 0x7ab0202 thru 0x7ab8e38 data_size 0x5(0x8c37 bytes) 2019-12-16T22:45:39.049 INFO:teuthology.orchestra.run.smithi177.stdout:1558 write 0x2d10c08 thru 0x2d1efc9 (0xe3c2 bytes) 2019-12-16T22:45:39.051 INFO:teuthology.orchestra.run.smithi177.stdout:1012 write 0x8ed1096 thru 0x8eda5eb (0x9556 bytes) 2019-12-16T22:45:39.058 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.058 INFO:teuthology.orchestra.run.smithi177.stdout:1563 write 0x82eb87f thru 0x82f7201 (0xb983 bytes) 2019-12-16T22:45:39.060 INFO:teuthology.orchestra.run.smithi177.stdout:785 write 0x5346adf thru 0x535122e (0xa750 bytes) 2019-12-16T22:45:39.071 INFO:teuthology.orchestra.run.smithi177.stdout:1564 writesame 0x643d531 thru 0x6441cbb data_size 0x2d(0x478b bytes) 2019-12-16T22:45:39.081 INFO:teuthology.orchestra.run.smithi177.stdout:1565 writesame 0x8469202 thru 0x846be22 data_size 0xd(0x2c21 bytes) 2019-12-16T22:45:39.089 INFO:teuthology.orchestra.run.smithi177.stdout:1013 writesame 0x995314a thru 0x9959093 data_size 0x1(0x5f4a bytes) 2019-12-16T22:45:39.090 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.091 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.092 INFO:teuthology.orchestra.run.smithi177.stdout:1015 punch from 0x39223f4 to 0x392acf1, (0x88fd bytes) 2019-12-16T22:45:39.092 INFO:teuthology.orchestra.run.smithi177.stdout:1016 write 0xcb30e9 thru 0xcb5b06 (0x2a1e bytes) 2019-12-16T22:45:39.095 INFO:teuthology.orchestra.run.smithi177.stdout:1017 read 0x3aa5541 thru 0x3ab3009 (0xdac9 bytes) 2019-12-16T22:45:39.095 INFO:teuthology.orchestra.run.smithi177.stdout:1018 writesame 0x159dad3 thru 0x15a2400 data_size 0x13(0x492e bytes) 2019-12-16T22:45:39.098 INFO:teuthology.orchestra.run.smithi177.stdout:1568 trunc from 0xa44340b to 0x520a14d 2019-12-16T22:45:39.100 INFO:teuthology.orchestra.run.smithi177.stdout:1019 read 0x368bf7b thru 0x3694039 (0x80bf bytes) 2019-12-16T22:45:39.101 INFO:teuthology.orchestra.run.smithi177.stdout:1020 read 0x6a2b8cd thru 0x6a36d90 (0xb4c4 bytes) 2019-12-16T22:45:39.102 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.102 INFO:teuthology.orchestra.run.smithi177.stdout:1024 read 0x52c09e4 thru 0x52ce133 (0xd750 bytes) 2019-12-16T22:45:39.109 INFO:teuthology.orchestra.run.smithi177.stdout:786 write 0xea8a34a thru 0xea8a915 (0x5cc bytes) 2019-12-16T22:45:39.116 INFO:teuthology.orchestra.run.smithi177.stdout:787 write 0xbfa6da7 thru 0xbfa9d4d (0x2fa7 bytes) 2019-12-16T22:45:39.121 INFO:teuthology.orchestra.run.smithi177.stdout:1025 write 0xa42222a thru 0xa425eb7 (0x3c8e bytes) 2019-12-16T22:45:39.125 INFO:teuthology.orchestra.run.smithi177.stdout:789 trunc from 0xea8a916 to 0xe4a52d0 2019-12-16T22:45:39.127 INFO:teuthology.orchestra.run.smithi177.stdout:1027 read 0x637af20 thru 0x637d846 (0x2927 bytes) 2019-12-16T22:45:39.128 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.147 INFO:teuthology.orchestra.run.smithi177.stdout:791 read 0xcef27cd thru 0xcf0111c (0xe950 bytes) 2019-12-16T22:45:39.147 INFO:teuthology.orchestra.run.smithi177.stdout:792 read 0x53f1300 thru 0x53fd63f (0xc340 bytes) 2019-12-16T22:45:39.148 INFO:teuthology.orchestra.run.smithi177.stdout:793 write 0x81a6a34 thru 0x81b446f (0xda3c bytes) 2019-12-16T22:45:39.153 INFO:teuthology.orchestra.run.smithi177.stdout:1028 write 0xd9c5fa1 thru 0xd9d2a98 (0xcaf8 bytes) 2019-12-16T22:45:39.161 INFO:teuthology.orchestra.run.smithi177.stdout:1134 writesame 0xd5bb571 thru 0xd5c4e10 data_size 0x60(0x98a0 bytes) 2019-12-16T22:45:39.162 INFO:teuthology.orchestra.run.smithi177.stdout:1570 write 0xccffac6 thru 0xcd0957f (0x9aba bytes) 2019-12-16T22:45:39.162 INFO:teuthology.orchestra.run.smithi177.stdout:796 punch from 0xe58771 to 0xe646cf, (0xbf5e bytes) 2019-12-16T22:45:39.163 INFO:teuthology.orchestra.run.smithi177.stdout:797 read 0x392fe7 thru 0x399bbc (0x6bd6 bytes) 2019-12-16T22:45:39.163 INFO:teuthology.orchestra.run.smithi177.stdout:1029 write 0x72cc675 thru 0x72d4a0c (0x8398 bytes) 2019-12-16T22:45:39.163 INFO:teuthology.orchestra.run.smithi177.stdout:799 trunc from 0xe4a52d0 to 0xe18895a 2019-12-16T22:45:39.168 INFO:teuthology.orchestra.run.smithi177.stdout:1031 write 0x9971a29 thru 0x998096d (0xef45 bytes) 2019-12-16T22:45:39.170 INFO:teuthology.orchestra.run.smithi177.stdout:1018 clone 10 order 25 su 262144 sc 6 2019-12-16T22:45:39.178 INFO:teuthology.orchestra.run.smithi177.stdout:1032 writesame 0xcdc65d3 thru 0xcdc798d data_size 0x1(0x13bb bytes) 2019-12-16T22:45:39.185 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.185 INFO:teuthology.orchestra.run.smithi177.stdout:1574 write 0x3bd435f thru 0x3bd96ac (0x534e bytes) 2019-12-16T22:45:39.187 INFO:teuthology.orchestra.run.smithi177.stdout:1034 write 0x8e4d0ec thru 0x8e5323b (0x6150 bytes) 2019-12-16T22:45:39.200 INFO:teuthology.orchestra.run.smithi177.stdout:800 flatten 2019-12-16T22:45:39.206 INFO:teuthology.orchestra.run.smithi177.stdout:1135 trunc from 0xd706ee2 to 0x623c911 2019-12-16T22:45:39.211 INFO:teuthology.orchestra.run.smithi177.stdout:1036 trunc from 0xd9d2a99 to 0x4fa88f2 2019-12-16T22:45:39.231 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.231 INFO:teuthology.orchestra.run.smithi177.stdout:1576 writesame 0x7b9570f thru 0x7ba2ccb data_size 0x45(0xd5bd bytes) 2019-12-16T22:45:39.335 INFO:teuthology.orchestra.run.smithi177.stdout:1577 write 0x9611f27 thru 0x9613d0e (0x1de8 bytes) 2019-12-16T22:45:39.341 INFO:teuthology.orchestra.run.smithi177.stdout:801 read 0xc47856f thru 0xc480a10 (0x84a2 bytes) 2019-12-16T22:45:39.342 INFO:teuthology.orchestra.run.smithi177.stdout:802 write 0x860635b thru 0x8607a8e (0x1734 bytes) 2019-12-16T22:45:39.350 INFO:teuthology.orchestra.run.smithi177.stdout:803 writesame 0x3f748a thru 0x3faddd data_size 0x6(0x3954 bytes) 2019-12-16T22:45:39.351 INFO:teuthology.orchestra.run.smithi177.stdout:1578 trunc from 0xcd09580 to 0x9d49162 2019-12-16T22:45:39.352 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.352 INFO:teuthology.orchestra.run.smithi177.stdout:1039 writesame 0x4f5c626 thru 0x4f5ec19 data_size 0xe(0x25f4 bytes) 2019-12-16T22:45:39.361 INFO:teuthology.orchestra.run.smithi177.stdout:804 writesame 0x23f2d6a thru 0x23fcfd1 data_size 0x1(0xa268 bytes) 2019-12-16T22:45:39.392 INFO:teuthology.orchestra.run.smithi177.stdout:805 writesame 0x82a9f01 thru 0x82b1ac8 data_size 0x44(0x7bc8 bytes) 2019-12-16T22:45:39.408 INFO:teuthology.orchestra.run.smithi177.stdout:806 read 0x6958c03 thru 0x6960005 (0x7403 bytes) 2019-12-16T22:45:39.409 INFO:teuthology.orchestra.run.smithi177.stdout:807 punch from 0x2591d53 to 0x2592968, (0xc15 bytes) 2019-12-16T22:45:39.409 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.409 INFO:teuthology.orchestra.run.smithi177.stdout:809 writesame 0x1ac0e41 thru 0x1ac7916 data_size 0x19(0x6ad6 bytes) 2019-12-16T22:45:39.409 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.409 INFO:teuthology.orchestra.run.smithi177.stdout:1581 writesame 0x6980645 thru 0x698966d data_size 0x3d(0x9029 bytes) 2019-12-16T22:45:39.410 INFO:teuthology.orchestra.run.smithi177.stdout:1041 writesame 0x73e82dd thru 0x73f489e data_size 0x11(0xc5c2 bytes) 2019-12-16T22:45:39.417 INFO:teuthology.orchestra.run.smithi177.stdout:1137 write 0xbd6371d thru 0xbd718d7 (0xe1bb bytes) 2019-12-16T22:45:39.421 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.424 INFO:teuthology.orchestra.run.smithi177.stdout:1583 write 0x3d121fe thru 0x3d164cc (0x42cf bytes) 2019-12-16T22:45:39.425 INFO:teuthology.orchestra.run.smithi177.stdout:1043 trunc from 0x73f489f to 0x92dc01c 2019-12-16T22:45:39.438 INFO:teuthology.orchestra.run.smithi177.stdout:1138 punch from 0xa48ca69 to 0xa491d53, (0x52ea bytes) 2019-12-16T22:45:39.438 INFO:teuthology.orchestra.run.smithi177.stdout:1139 punch from 0x4b03c7 to 0x4b9e0a, (0x9a43 bytes) 2019-12-16T22:45:39.438 INFO:teuthology.orchestra.run.smithi177.stdout:1141 write 0x93288ed thru 0x9330ad5 (0x81e9 bytes) 2019-12-16T22:45:39.438 INFO:teuthology.orchestra.run.smithi177.stdout:1585 punch from 0x99835bb to 0x9983d13, (0x758 bytes) 2019-12-16T22:45:39.438 INFO:teuthology.orchestra.run.smithi177.stdout:1587 read 0x29a1b15 thru 0x29a57ed (0x3cd9 bytes) 2019-12-16T22:45:39.439 INFO:teuthology.orchestra.run.smithi177.stdout:1588 write 0x72818e9 thru 0x72871e2 (0x58fa bytes) 2019-12-16T22:45:39.447 INFO:teuthology.orchestra.run.smithi177.stdout:1142 punch from 0xbd71825 to 0xbd718d8, (0xb3 bytes) 2019-12-16T22:45:39.447 INFO:teuthology.orchestra.run.smithi177.stdout:1144 read 0x5fd0d09 thru 0x5fdb278 (0xa570 bytes) 2019-12-16T22:45:39.448 INFO:teuthology.orchestra.run.smithi177.stdout:1145 writesame 0x719f6c6 thru 0x71a11ea data_size 0x1(0x1b25 bytes) 2019-12-16T22:45:39.448 INFO:teuthology.orchestra.run.smithi177.stdout:810 write 0xe3f8190 thru 0xe4039a6 (0xb817 bytes) 2019-12-16T22:45:39.456 INFO:teuthology.orchestra.run.smithi177.stdout:1044 read 0x8250150 thru 0x825ff2f (0xfde0 bytes) 2019-12-16T22:45:39.456 INFO:teuthology.orchestra.run.smithi177.stdout:1045 punch from 0x6423285 to 0x6431780, (0xe4fb bytes) 2019-12-16T22:45:39.456 INFO:teuthology.orchestra.run.smithi177.stdout:1046 write 0x378600d thru 0x3789fd5 (0x3fc9 bytes) 2019-12-16T22:45:39.457 INFO:teuthology.orchestra.run.smithi177.stdout:1147 write 0xf6b7dd thru 0xf6cfc2 (0x17e6 bytes) 2019-12-16T22:45:39.466 INFO:teuthology.orchestra.run.smithi177.stdout:811 write 0x41dd3f4 thru 0x41e6cb6 (0x98c3 bytes) 2019-12-16T22:45:39.482 INFO:teuthology.orchestra.run.smithi177.stdout:812 writesame 0x4c61434 thru 0x4c70a8c data_size 0x1(0xf659 bytes) 2019-12-16T22:45:39.491 INFO:teuthology.orchestra.run.smithi177.stdout:1589 write 0xa8d419e thru 0xa8e05d3 (0xc436 bytes) 2019-12-16T22:45:39.494 INFO:teuthology.orchestra.run.smithi177.stdout:1148 write 0x8c052ff thru 0x8c061ae (0xeb0 bytes) 2019-12-16T22:45:39.512 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.512 INFO:teuthology.orchestra.run.smithi177.stdout:1150 punch from 0x4f1613f to 0x4f22493, (0xc354 bytes) 2019-12-16T22:45:39.512 INFO:teuthology.orchestra.run.smithi177.stdout:1151 writesame 0x7c87fa thru 0x7d337a data_size 0x5(0xab81 bytes) 2019-12-16T22:45:39.518 INFO:teuthology.orchestra.run.smithi177.stdout:1048 write 0xcc8632a thru 0xcc88b06 (0x27dd bytes) 2019-12-16T22:45:39.545 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.545 INFO:teuthology.orchestra.run.smithi177.stdout:1050 write 0x23546b4 thru 0x235ce30 (0x877d bytes) 2019-12-16T22:45:39.545 INFO:teuthology.orchestra.run.smithi177.stdout:813 punch from 0xd2a3864 to 0xd2b1b37, (0xe2d3 bytes) 2019-12-16T22:45:39.545 INFO:teuthology.orchestra.run.smithi177.stdout:814 read 0xd3b649c thru 0xd3c4651 (0xe1b6 bytes) 2019-12-16T22:45:39.546 INFO:teuthology.orchestra.run.smithi177.stdout:1590 writesame 0x532cd90 thru 0x533055f data_size 0x1(0x37d0 bytes) 2019-12-16T22:45:39.563 INFO:teuthology.orchestra.run.smithi177.stdout:815 trunc from 0xe4039a7 to 0x57b4885 2019-12-16T22:45:39.572 INFO:teuthology.orchestra.run.smithi177.stdout:1152 write 0x3e1ae8 thru 0x3ef79d (0xdcb6 bytes) 2019-12-16T22:45:39.573 INFO:teuthology.orchestra.run.smithi177.stdout:1591 read 0x9c3227b thru 0x9c32a95 (0x81b bytes) 2019-12-16T22:45:39.573 INFO:teuthology.orchestra.run.smithi177.stdout:1592 read 0x8623156 thru 0x8623af1 (0x99c bytes) 2019-12-16T22:45:39.573 INFO:teuthology.orchestra.run.smithi177.stdout:1593 writesame 0x359312a thru 0x359e78f data_size 0x25(0xb666 bytes) 2019-12-16T22:45:39.587 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone9 from 0xee1122f (overlap 0x27929e) to 0x7ea1f 2019-12-16T22:45:39.589 INFO:teuthology.orchestra.run.smithi177.stdout:1153 write 0x5f054b0 thru 0x5f07735 (0x2286 bytes) 2019-12-16T22:45:39.592 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.4-clone9 2019-12-16T22:45:39.598 INFO:teuthology.orchestra.run.smithi177.stdout:1594 read 0x57b9d8e thru 0x57c036e (0x65e1 bytes) 2019-12-16T22:45:39.599 INFO:teuthology.orchestra.run.smithi177.stdout:1595 read 0x618d86c thru 0x619ac56 (0xd3eb bytes) 2019-12-16T22:45:39.599 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.615 INFO:teuthology.orchestra.run.smithi177.stdout:1052 write 0xdd4d7c9 thru 0xdd5167c (0x3eb4 bytes) 2019-12-16T22:45:39.631 INFO:teuthology.orchestra.run.smithi177.stdout:1154 trunc from 0xbd718d8 to 0x92f9562 2019-12-16T22:45:39.640 INFO:teuthology.orchestra.run.smithi177.stdout:1053 read 0xd70920b thru 0xd70ff28 (0x6d1e bytes) 2019-12-16T22:45:39.640 INFO:teuthology.orchestra.run.smithi177.stdout:1054 read 0xb003fc thru 0xb034e5 (0x30ea bytes) 2019-12-16T22:45:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:1055 punch from 0x28f6522 to 0x28f9fa9, (0x3a87 bytes) 2019-12-16T22:45:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.641 INFO:teuthology.orchestra.run.smithi177.stdout:1058 write 0x85fb206 thru 0x860b024 (0xfe1f bytes) 2019-12-16T22:45:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:1060 read 0xa34cdfd thru 0xa357656 (0xa85a bytes) 2019-12-16T22:45:39.656 INFO:teuthology.orchestra.run.smithi177.stdout:1061 writesame 0x4a1dd70 thru 0x4a2c916 data_size 0x3(0xeba7 bytes) 2019-12-16T22:45:39.665 INFO:teuthology.orchestra.run.smithi177.stdout:1597 write 0xccecafc thru 0xccf11c1 (0x46c6 bytes) 2019-12-16T22:45:39.686 INFO:teuthology.orchestra.run.smithi177.stdout:1063 write 0x42c257 thru 0x435dd9 (0x9b83 bytes) 2019-12-16T22:45:39.692 INFO:teuthology.orchestra.run.smithi177.stdout:816 write 0x9a95552 thru 0x9aa463b (0xf0ea bytes) 2019-12-16T22:45:39.702 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.714 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.715 INFO:teuthology.orchestra.run.smithi177.stdout:1065 write 0x5e9800f thru 0x5e9e591 (0x6583 bytes) 2019-12-16T22:45:39.724 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.736 INFO:teuthology.orchestra.run.smithi177.stdout:817 read 0x9728386 thru 0x97351c6 (0xce41 bytes) 2019-12-16T22:45:39.736 INFO:teuthology.orchestra.run.smithi177.stdout:818 punch from 0x56d3a0f to 0x56da7fb, (0x6dec bytes) 2019-12-16T22:45:39.736 INFO:teuthology.orchestra.run.smithi177.stdout:819 write 0x1b27024 thru 0x1b2a184 (0x3161 bytes) 2019-12-16T22:45:39.738 INFO:teuthology.orchestra.run.smithi177.stdout:1066 write 0x7e6ebef thru 0x7e7580e (0x6c20 bytes) 2019-12-16T22:45:39.789 INFO:teuthology.orchestra.run.smithi177.stdout:820 read 0x994495 thru 0x99767d (0x31e9 bytes) 2019-12-16T22:45:39.790 INFO:teuthology.orchestra.run.smithi177.stdout:821 trunc from 0x9aa463c to 0x4a0740c 2019-12-16T22:45:39.790 INFO:teuthology.orchestra.run.smithi177.stdout:1067 read 0x3c9b342 thru 0x3caa72d (0xf3ec bytes) 2019-12-16T22:45:39.790 INFO:teuthology.orchestra.run.smithi177.stdout:1068 read 0x6b9d89a thru 0x6ba585e (0x7fc5 bytes) 2019-12-16T22:45:39.790 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.790 INFO:teuthology.orchestra.run.smithi177.stdout:1071 punch from 0x4d22ead to 0x4d2c53e, (0x9691 bytes) 2019-12-16T22:45:39.791 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.791 INFO:teuthology.orchestra.run.smithi177.stdout:1075 write 0x6982a11 thru 0x6985804 (0x2df4 bytes) 2019-12-16T22:45:39.791 INFO:teuthology.orchestra.run.smithi177.stdout:1076 writesame 0xa500376 thru 0xa50e887 data_size 0x6d(0xe512 bytes) 2019-12-16T22:45:39.791 INFO:teuthology.orchestra.run.smithi177.stdout:1156 write 0xb5f4efe thru 0xb5fc11a (0x721d bytes) 2019-12-16T22:45:39.791 INFO:teuthology.orchestra.run.smithi177.stdout:1599 writesame 0xe8ded5c thru 0xe8e6ea8 data_size 0x1(0x814d bytes) 2019-12-16T22:45:39.792 INFO:teuthology.orchestra.run.smithi177.stdout:1600 write 0x40a79d0 thru 0x40b6194 (0xe7c5 bytes) 2019-12-16T22:45:39.798 INFO:teuthology.orchestra.run.smithi177.stdout:1078 write 0x9c9667 thru 0x9d5fbd (0xc957 bytes) 2019-12-16T22:45:39.807 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #8, image image_cluster1.client.mirror.0-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent9 2019-12-16T22:45:39.808 INFO:teuthology.orchestra.run.smithi177.stdout:1157 trunc from 0xb5fc11b to 0xc75e580 2019-12-16T22:45:39.816 INFO:teuthology.orchestra.run.smithi177.stdout:1601 punch from 0x9a05f74 to 0x9a0adc3, (0x4e4f bytes) 2019-12-16T22:45:39.816 INFO:teuthology.orchestra.run.smithi177.stdout:1602 write 0x249e966 thru 0x24a611c (0x77b7 bytes) 2019-12-16T22:45:39.825 INFO:teuthology.orchestra.run.smithi177.stdout:1079 trunc from 0xdd5167d to 0xa356f1c 2019-12-16T22:45:39.831 INFO:teuthology.orchestra.run.smithi177.stdout:1603 writesame 0x17db084 thru 0x17dee4b data_size 0xc(0x3dc8 bytes) 2019-12-16T22:45:39.838 INFO:teuthology.orchestra.run.smithi177.stdout:822 punch from 0x2063fb8 to 0x206fb90, (0xbbd8 bytes) 2019-12-16T22:45:39.838 INFO:teuthology.orchestra.run.smithi177.stdout:824 write 0x9611fd thru 0x969aac (0x88b0 bytes) 2019-12-16T22:45:39.849 INFO:teuthology.orchestra.run.smithi177.stdout:1158 writesame 0x6dc3ed2 thru 0x6dc5560 data_size 0x23(0x168f bytes) 2019-12-16T22:45:39.851 INFO:teuthology.orchestra.run.smithi177.stdout:1605 write 0xf2da1b thru 0xf365a5 (0x8b8b bytes) 2019-12-16T22:45:39.855 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.856 INFO:teuthology.orchestra.run.smithi177.stdout:1367 punch from 0xbecfa65 to 0xbede641, (0xebdc bytes) 2019-12-16T22:45:39.860 INFO:teuthology.orchestra.run.smithi177.stdout:825 read 0x160a912 thru 0x160b63b (0xd2a bytes) 2019-12-16T22:45:39.863 INFO:teuthology.orchestra.run.smithi177.stdout:1159 read 0x7091345 thru 0x7099a43 (0x86ff bytes) 2019-12-16T22:45:39.866 INFO:teuthology.orchestra.run.smithi177.stdout:1080 trunc from 0xa356f1c to 0x5ee2962 2019-12-16T22:45:39.879 INFO:teuthology.orchestra.run.smithi177.stdout:1369 writesame 0x18ada45 thru 0x18b8b61 data_size 0x1(0xb11d bytes) 2019-12-16T22:45:39.902 INFO:teuthology.orchestra.run.smithi177.stdout:1606 writesame 0xec66f39 thru 0xec6f87e data_size 0x3(0x8946 bytes) 2019-12-16T22:45:39.904 INFO:teuthology.orchestra.run.smithi177.stdout:1607 punch from 0x1151e29 to 0x115cf1a, (0xb0f1 bytes) 2019-12-16T22:45:39.912 INFO:teuthology.orchestra.run.smithi177.stdout:1608 trunc from 0xec6f87f to 0xb2f7e0b 2019-12-16T22:45:39.919 INFO:teuthology.orchestra.run.smithi177.stdout:827 writesame 0xc032789 thru 0xc036e3e data_size 0x15(0x46b6 bytes) 2019-12-16T22:45:39.922 INFO:teuthology.orchestra.run.smithi177.stdout:828 read 0x36c6651 thru 0x36d3ad3 (0xd483 bytes) 2019-12-16T22:45:39.922 INFO:teuthology.orchestra.run.smithi177.stdout:829 punch from 0x22f3fe6 to 0x22f6293, (0x22ad bytes) 2019-12-16T22:45:39.923 INFO:teuthology.orchestra.run.smithi177.stdout:832 read 0x98f3ec3 thru 0x9900829 (0xc967 bytes) 2019-12-16T22:45:39.923 INFO:teuthology.orchestra.run.smithi177.stdout:835 writesame 0x814dea5 thru 0x815a263 data_size 0x1(0xc3bf bytes) 2019-12-16T22:45:39.924 INFO:teuthology.orchestra.run.smithi177.stdout:1160 write 0xcedcf21 thru 0xcee70ef (0xa1cf bytes) 2019-12-16T22:45:39.924 INFO:teuthology.orchestra.run.smithi177.stdout:1370 punch from 0x449c47e to 0x44a6511, (0xa093 bytes) 2019-12-16T22:45:39.924 INFO:teuthology.orchestra.run.smithi177.stdout:1371 write 0xe153494 thru 0xe15d9b3 (0xa520 bytes) 2019-12-16T22:45:39.927 INFO:teuthology.orchestra.run.smithi177.stdout:1082 trunc from 0x5ee2962 to 0xd6efca9 2019-12-16T22:45:39.953 INFO:teuthology.orchestra.run.smithi177.stdout:1161 trunc from 0xcee70f0 to 0x41eed51 2019-12-16T22:45:39.953 INFO:teuthology.orchestra.run.smithi177.stdout:1083 punch from 0x64b60c9 to 0x64b68f7, (0x82e bytes) 2019-12-16T22:45:39.954 INFO:teuthology.orchestra.run.smithi177.stdout:1084 write 0x60f4109 thru 0x60fec11 (0xab09 bytes) 2019-12-16T22:45:39.962 INFO:teuthology.orchestra.run.smithi177.stdout:1372 write 0x72d1519 thru 0x72d9c10 (0x86f8 bytes) 2019-12-16T22:45:39.968 INFO:teuthology.orchestra.run.smithi177.stdout:836 read 0x160b6f0 thru 0x1613cec (0x85fd bytes) 2019-12-16T22:45:39.968 INFO:teuthology.orchestra.run.smithi177.stdout:837 read 0x2d0a0b0 thru 0x2d17b34 (0xda85 bytes) 2019-12-16T22:45:39.969 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.969 INFO:teuthology.orchestra.run.smithi177.stdout:841 punch from 0x5a3b6a6 to 0x5a3e7db, (0x3135 bytes) 2019-12-16T22:45:39.969 INFO:teuthology.orchestra.run.smithi177.stdout:842 read 0x88a82f5 thru 0x88acc40 (0x494c bytes) 2019-12-16T22:45:39.969 INFO:teuthology.orchestra.run.smithi177.stdout:845 read 0x270107 thru 0x276f8a (0x6e84 bytes) 2019-12-16T22:45:39.970 INFO:teuthology.orchestra.run.smithi177.stdout:1085 read 0x3efcd49 thru 0x3f00034 (0x32ec bytes) 2019-12-16T22:45:39.972 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.972 INFO:teuthology.orchestra.run.smithi177.stdout:1087 writesame 0xa864314 thru 0xa86dd66 data_size 0xd(0x9a53 bytes) 2019-12-16T22:45:39.976 INFO:teuthology.orchestra.run.smithi177.stdout:1609 trunc from 0xb2f7e0b to 0xb766d57 2019-12-16T22:45:39.976 INFO:teuthology.orchestra.run.smithi177.stdout:1376 read 0x456e415 thru 0x457a85c (0xc448 bytes) 2019-12-16T22:45:39.977 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.977 INFO:teuthology.orchestra.run.smithi177.stdout:1379 read 0x3ff0a2e thru 0x3ffae44 (0xa417 bytes) 2019-12-16T22:45:39.978 INFO:teuthology.orchestra.run.smithi177.stdout:1380 read 0x1f69a2d thru 0x1f6c1f0 (0x27c4 bytes) 2019-12-16T22:45:39.978 INFO:teuthology.orchestra.run.smithi177.stdout:1384 punch from 0x859a8ea to 0x859ec34, (0x434a bytes) 2019-12-16T22:45:39.978 INFO:teuthology.orchestra.run.smithi177.stdout:1385 read 0x61bd651 thru 0x61c6065 (0x8a15 bytes) 2019-12-16T22:45:39.978 INFO:teuthology.orchestra.run.smithi177.stdout:1386 punch from 0x33ad50c to 0x33b0283, (0x2d77 bytes) 2019-12-16T22:45:39.978 INFO:teuthology.orchestra.run.smithi177.stdout:1387 write 0x1973630 thru 0x197bba5 (0x8576 bytes) 2019-12-16T22:45:39.981 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:39.982 INFO:teuthology.orchestra.run.smithi177.stdout:1089 read 0x13376e8 thru 0x133fc69 (0x8582 bytes) 2019-12-16T22:45:39.982 INFO:teuthology.orchestra.run.smithi177.stdout:1090 write 0x8ca7c1d thru 0x8cacfcb (0x53af bytes) 2019-12-16T22:45:39.988 INFO:teuthology.orchestra.run.smithi177.stdout:1388 read 0xd01fe03 thru 0xd02c19d (0xc39b bytes) 2019-12-16T22:45:39.988 INFO:teuthology.orchestra.run.smithi177.stdout:1390 write 0x21ea91a thru 0x21f1cfe (0x73e5 bytes) 2019-12-16T22:45:39.995 INFO:teuthology.orchestra.run.smithi177.stdout:1091 write 0x2be1769 thru 0x2be9102 (0x799a bytes) 2019-12-16T22:45:40.004 INFO:teuthology.orchestra.run.smithi177.stdout:846 writesame 0xe362631 thru 0xe370a9e data_size 0x7(0xe46e bytes) 2019-12-16T22:45:40.008 INFO:teuthology.orchestra.run.smithi177.stdout:1392 read 0x8e3b800 thru 0x8e3dc37 (0x2438 bytes) 2019-12-16T22:45:40.009 INFO:teuthology.orchestra.run.smithi177.stdout:1393 punch from 0xba8cfa3 to 0xba9461c, (0x7679 bytes) 2019-12-16T22:45:40.009 INFO:teuthology.orchestra.run.smithi177.stdout:1394 write 0x512ac25 thru 0x5131118 (0x64f4 bytes) 2019-12-16T22:45:40.009 INFO:teuthology.orchestra.run.smithi177.stdout:1092 read 0x5a23d3f thru 0x5a29c0a (0x5ecc bytes) 2019-12-16T22:45:40.009 INFO:teuthology.orchestra.run.smithi177.stdout:1093 write 0x2d36401 thru 0x2d38711 (0x2311 bytes) 2019-12-16T22:45:40.017 INFO:teuthology.orchestra.run.smithi177.stdout:847 trunc from 0xe370a9f to 0xa6bf67d 2019-12-16T22:45:40.029 INFO:teuthology.orchestra.run.smithi177.stdout:1395 read 0x7efdbd1 thru 0x7f01674 (0x3aa4 bytes) 2019-12-16T22:45:40.031 INFO:teuthology.orchestra.run.smithi177.stdout:1396 trunc from 0xee1122f to 0xdfcda7c 2019-12-16T22:45:40.035 INFO:teuthology.orchestra.run.smithi177.stdout:1612 write 0xea2a437 thru 0xea2f577 (0x5141 bytes) 2019-12-16T22:45:40.039 INFO:teuthology.orchestra.run.smithi177.stdout:1095 trunc from 0xd6efca9 to 0x366392f 2019-12-16T22:45:40.041 INFO:teuthology.orchestra.run.smithi177.stdout:1163 write 0xddcbe03 thru 0xddd59f3 (0x9bf1 bytes) 2019-12-16T22:45:40.050 INFO:teuthology.orchestra.run.smithi177.stdout:1613 read 0xb998e22 thru 0xb9a78e4 (0xeac3 bytes) 2019-12-16T22:45:40.051 INFO:teuthology.orchestra.run.smithi177.stdout:1615 punch from 0x51977e3 to 0x51a4b41, (0xd35e bytes) 2019-12-16T22:45:40.051 INFO:teuthology.orchestra.run.smithi177.stdout:1617 write 0x882039d thru 0x8821bb8 (0x181c bytes) 2019-12-16T22:45:40.051 INFO:teuthology.orchestra.run.smithi177.stdout:848 read 0xb42fcc thru 0xb4cb49 (0x9b7e bytes) 2019-12-16T22:45:40.051 INFO:teuthology.orchestra.run.smithi177.stdout:850 write 0x6c8866 thru 0x6cb64d (0x2de8 bytes) 2019-12-16T22:45:40.074 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.074 INFO:teuthology.orchestra.run.smithi177.stdout:1619 write 0xdf673ff thru 0xdf74ccf (0xd8d1 bytes) 2019-12-16T22:45:40.074 INFO:teuthology.orchestra.run.smithi177.stdout:852 write 0x148bb4d thru 0x14967b4 (0xac68 bytes) 2019-12-16T22:45:40.074 INFO:teuthology.orchestra.run.smithi177.stdout:1164 trunc from 0xddd59f4 to 0x268548a 2019-12-16T22:45:40.079 INFO:teuthology.orchestra.run.smithi177.stdout:1397 writesame 0x4718834 thru 0x4727383 data_size 0x1(0xeb50 bytes) 2019-12-16T22:45:40.085 INFO:teuthology.orchestra.run.smithi177.stdout:854 punch from 0x9b0fd0d to 0x9b16285, (0x6578 bytes) 2019-12-16T22:45:40.085 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.085 INFO:teuthology.orchestra.run.smithi177.stdout:856 write 0x3c63d3 thru 0x3cfb48 (0x9776 bytes) 2019-12-16T22:45:40.092 INFO:teuthology.orchestra.run.smithi177.stdout:1620 read 0x1fa972e thru 0x1faec10 (0x54e3 bytes) 2019-12-16T22:45:40.100 INFO:teuthology.orchestra.run.smithi177.stdout:1097 punch from 0x1cc0927 to 0x1cc554f, (0x4c28 bytes) 2019-12-16T22:45:40.101 INFO:teuthology.orchestra.run.smithi177.stdout:1098 read 0x4a3fac thru 0x4ae9c8 (0xaa1d bytes) 2019-12-16T22:45:40.105 INFO:teuthology.orchestra.run.smithi177.stdout:1099 trunc from 0x366392f to 0x5d675d2 2019-12-16T22:45:40.121 INFO:teuthology.orchestra.run.smithi177.stdout:1398 writesame 0x602b791 thru 0x603576a data_size 0x7(0x9fda bytes) 2019-12-16T22:45:40.122 INFO:teuthology.orchestra.run.smithi177.stdout:859 read 0x292d21c thru 0x293296e (0x5753 bytes) 2019-12-16T22:45:40.122 INFO:teuthology.orchestra.run.smithi177.stdout:860 read 0x5263aa8 thru 0x5271d23 (0xe27c bytes) 2019-12-16T22:45:40.122 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.138 INFO:teuthology.orchestra.run.smithi177.stdout:1399 read 0x7dea52e thru 0x7deb607 (0x10da bytes) 2019-12-16T22:45:40.138 INFO:teuthology.orchestra.run.smithi177.stdout:1621 writesame 0xebd9a79 thru 0xebe7174 data_size 0x2(0xd6fc bytes) 2019-12-16T22:45:40.139 INFO:teuthology.orchestra.run.smithi177.stdout:1100 punch from 0x89ec68 to 0x8a65bb, (0x7953 bytes) 2019-12-16T22:45:40.139 INFO:teuthology.orchestra.run.smithi177.stdout:1101 read 0x41bb99c thru 0x41bc37a (0x9df bytes) 2019-12-16T22:45:40.139 INFO:teuthology.orchestra.run.smithi177.stdout:1103 punch from 0x1f4a050 to 0x1f59bda, (0xfb8a bytes) 2019-12-16T22:45:40.139 INFO:teuthology.orchestra.run.smithi177.stdout:1104 read 0x308685a thru 0x308f868 (0x900f bytes) 2019-12-16T22:45:40.146 INFO:teuthology.orchestra.run.smithi177.stdout:1623 trunc from 0xebe7175 to 0xce07c2c 2019-12-16T22:45:40.148 INFO:teuthology.orchestra.run.smithi177.stdout:1166 write 0x3bb316d thru 0x3bb5fee (0x2e82 bytes) 2019-12-16T22:45:40.152 INFO:teuthology.orchestra.run.smithi177.stdout:862 writesame 0xdc65a1e thru 0xdc6fe1b data_size 0x3(0xa3fe bytes) 2019-12-16T22:45:40.154 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #8, image image_cluster1.client.mirror.4-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent9 2019-12-16T22:45:40.154 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.155 INFO:teuthology.orchestra.run.smithi177.stdout:864 punch from 0x505eede to 0x506eaaf, (0xfbd1 bytes) 2019-12-16T22:45:40.155 INFO:teuthology.orchestra.run.smithi177.stdout:867 read 0x7829348 thru 0x783304b (0x9d04 bytes) 2019-12-16T22:45:40.155 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.155 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.156 INFO:teuthology.orchestra.run.smithi177.stdout:870 punch from 0x8b8390e to 0x8b8427c, (0x96e bytes) 2019-12-16T22:45:40.156 INFO:teuthology.orchestra.run.smithi177.stdout:871 read 0x5212e7c thru 0x521ea78 (0xbbfd bytes) 2019-12-16T22:45:40.157 INFO:teuthology.orchestra.run.smithi177.stdout:872 write 0x13dd318 thru 0x13e5e1a (0x8b03 bytes) 2019-12-16T22:45:40.157 INFO:teuthology.orchestra.run.smithi177.stdout:1400 trunc from 0xdfcda7c to 0x4336258 2019-12-16T22:45:40.163 INFO:teuthology.orchestra.run.smithi177.stdout:1168 trunc from 0x3bb5fef to 0x257f30e 2019-12-16T22:45:40.170 INFO:teuthology.orchestra.run.smithi177.stdout:1106 write 0x973b7c1 thru 0x974a092 (0xe8d2 bytes) 2019-12-16T22:45:40.175 INFO:teuthology.orchestra.run.smithi177.stdout:873 trunc from 0xdc6fe1c to 0x8e1a706 2019-12-16T22:45:40.183 INFO:teuthology.orchestra.run.smithi177.stdout:1107 trunc from 0x974a093 to 0x8ad8f4e 2019-12-16T22:45:40.184 INFO:teuthology.orchestra.run.smithi177.stdout:1624 punch from 0x711a490 to 0x711a7b7, (0x327 bytes) 2019-12-16T22:45:40.184 INFO:teuthology.orchestra.run.smithi177.stdout:1625 write 0x6c33af4 thru 0x6c3f056 (0xb563 bytes) 2019-12-16T22:45:40.195 INFO:teuthology.orchestra.run.smithi177.stdout:1405 read 0x151c51 thru 0x15ad5e (0x910e bytes) 2019-12-16T22:45:40.199 INFO:teuthology.orchestra.run.smithi177.stdout:1406 trunc from 0x4336258 to 0x29e513d 2019-12-16T22:45:40.200 INFO:teuthology.orchestra.run.smithi177.stdout:1629 writesame 0x1df8269 thru 0x1df9e5c data_size 0x2(0x1bf4 bytes) 2019-12-16T22:45:40.205 INFO:teuthology.orchestra.run.smithi177.stdout:1169 flatten 2019-12-16T22:45:40.205 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.206 INFO:teuthology.orchestra.run.smithi177.stdout:876 read 0x8a74c9f thru 0x8a7e690 (0x99f2 bytes) 2019-12-16T22:45:40.207 INFO:teuthology.orchestra.run.smithi177.stdout:877 write 0x36337bb thru 0x363c3c3 (0x8c09 bytes) 2019-12-16T22:45:40.212 INFO:teuthology.orchestra.run.smithi177.stdout:1108 write 0x35c2dc8 thru 0x35d1413 (0xe64c bytes) 2019-12-16T22:45:40.224 INFO:teuthology.orchestra.run.smithi177.stdout:879 write 0x2e4d1b8 thru 0x2e56c0a (0x9a53 bytes) 2019-12-16T22:45:40.228 INFO:teuthology.orchestra.run.smithi177.stdout:1630 trunc from 0xce07c2c to 0x4e0f315 2019-12-16T22:45:40.238 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.238 INFO:teuthology.orchestra.run.smithi177.stdout:883 writesame 0x82034e6 thru 0x8205f1d data_size 0x1c(0x2a38 bytes) 2019-12-16T22:45:40.240 INFO:teuthology.orchestra.run.smithi177.stdout:1407 clone 11 order 23 su 32768 sc 9 2019-12-16T22:45:40.263 INFO:teuthology.orchestra.run.smithi177.stdout:884 read 0x3b5af26 thru 0x3b5fcf1 (0x4dcc bytes) 2019-12-16T22:45:40.263 INFO:teuthology.orchestra.run.smithi177.stdout:885 read 0x1963053 thru 0x19659c9 (0x2977 bytes) 2019-12-16T22:45:40.264 INFO:teuthology.orchestra.run.smithi177.stdout:886 punch from 0x5fa47ed to 0x5fa79cf, (0x31e2 bytes) 2019-12-16T22:45:40.264 INFO:teuthology.orchestra.run.smithi177.stdout:887 writesame 0x5cd402f thru 0x5cdb325 data_size 0x1(0x72f7 bytes) 2019-12-16T22:45:40.280 INFO:teuthology.orchestra.run.smithi177.stdout:1109 writesame 0xaae8b43 thru 0xaaec582 data_size 0x1(0x3a40 bytes) 2019-12-16T22:45:40.293 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.293 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.293 INFO:teuthology.orchestra.run.smithi177.stdout:1114 trunc from 0xaaec583 to 0x8f131d0 2019-12-16T22:45:40.306 INFO:teuthology.orchestra.run.smithi177.stdout:889 write 0x4708aa3 thru 0x470da37 (0x4f95 bytes) 2019-12-16T22:45:40.312 INFO:teuthology.orchestra.run.smithi177.stdout:1631 read 0x3a1b776 thru 0x3a1f98c (0x4217 bytes) 2019-12-16T22:45:40.316 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.316 INFO:teuthology.orchestra.run.smithi177.stdout:891 read 0x2fe7bde thru 0x2ff03e2 (0x8805 bytes) 2019-12-16T22:45:40.316 INFO:teuthology.orchestra.run.smithi177.stdout:892 write 0x3a0c96b thru 0x3a198ac (0xcf42 bytes) 2019-12-16T22:45:40.322 INFO:teuthology.orchestra.run.smithi177.stdout:1115 write 0x4d384ec thru 0x4d4426c (0xbd81 bytes) 2019-12-16T22:45:40.327 INFO:teuthology.orchestra.run.smithi177.stdout:1116 punch from 0x7712f21 to 0x771f19f, (0xc27e bytes) 2019-12-16T22:45:40.328 INFO:teuthology.orchestra.run.smithi177.stdout:1117 trunc from 0x8f131d0 to 0x9a6c7cb 2019-12-16T22:45:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:893 trunc from 0x8e1a706 to 0xa083b46 2019-12-16T22:45:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:1171 writesame 0x4c5d276 thru 0x4c6bc88 data_size 0x1(0xea13 bytes) 2019-12-16T22:45:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:1632 writesame 0xd238c7f thru 0xd24463f data_size 0x21(0xb9c1 bytes) 2019-12-16T22:45:40.352 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:1634 read 0x1f57367 thru 0x1f6182f (0xa4c9 bytes) 2019-12-16T22:45:40.353 INFO:teuthology.orchestra.run.smithi177.stdout:1635 punch from 0x3c33c7f to 0x3c42b71, (0xeef2 bytes) 2019-12-16T22:45:40.357 INFO:teuthology.orchestra.run.smithi177.stdout:1119 read 0x64bb3cc thru 0x64be894 (0x34c9 bytes) 2019-12-16T22:45:40.357 INFO:teuthology.orchestra.run.smithi177.stdout:1120 write 0xce19e3 thru 0xcf0e9e (0xf4bc bytes) 2019-12-16T22:45:40.365 INFO:teuthology.orchestra.run.smithi177.stdout:1121 punch from 0x4b321ed to 0x4b40cb2, (0xeac5 bytes) 2019-12-16T22:45:40.366 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.366 INFO:teuthology.orchestra.run.smithi177.stdout:1123 read 0x3a52f88 thru 0x3a55b2e (0x2ba7 bytes) 2019-12-16T22:45:40.371 INFO:teuthology.orchestra.run.smithi177.stdout:1172 trunc from 0x4c6bc89 to 0xe869c2f 2019-12-16T22:45:40.372 INFO:teuthology.orchestra.run.smithi177.stdout:894 trunc from 0xa083b46 to 0xe889254 2019-12-16T22:45:40.376 INFO:teuthology.orchestra.run.smithi177.stdout:1637 trunc from 0xd244640 to 0x4d8ef27 2019-12-16T22:45:40.395 INFO:teuthology.orchestra.run.smithi177.stdout:895 writesame 0x75af93d thru 0x75bde9f data_size 0x1(0xe563 bytes) 2019-12-16T22:45:40.402 INFO:teuthology.orchestra.run.smithi177.stdout:1124 writesame 0xeb7f710 thru 0xeb8128e data_size 0x1(0x1b7f bytes) 2019-12-16T22:45:40.403 INFO:teuthology.orchestra.run.smithi177.stdout:1173 write 0x936a355 thru 0x93776e4 (0xd390 bytes) 2019-12-16T22:45:40.407 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.407 INFO:teuthology.orchestra.run.smithi177.stdout:1126 read 0x5a7ad3b thru 0x5a7e53b (0x3801 bytes) 2019-12-16T22:45:40.407 INFO:teuthology.orchestra.run.smithi177.stdout:1127 read 0xcea7979 thru 0xceadf30 (0x65b8 bytes) 2019-12-16T22:45:40.408 INFO:teuthology.orchestra.run.smithi177.stdout:1128 read 0x1c7f3ac thru 0x1c88db2 (0x9a07 bytes) 2019-12-16T22:45:40.408 INFO:teuthology.orchestra.run.smithi177.stdout:1129 writesame 0xac1a0b6 thru 0xac1ff50 data_size 0x51(0x5e9b bytes) 2019-12-16T22:45:40.414 INFO:teuthology.orchestra.run.smithi177.stdout:1174 write 0x4fa98a3 thru 0x4fb23e4 (0x8b42 bytes) 2019-12-16T22:45:40.421 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.421 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.421 INFO:teuthology.orchestra.run.smithi177.stdout:1135 read 0xc7d4f31 thru 0xc7e4ca5 (0xfd75 bytes) 2019-12-16T22:45:40.422 INFO:teuthology.orchestra.run.smithi177.stdout:1136 write 0xe413e36 thru 0xe41bc97 (0x7e62 bytes) 2019-12-16T22:45:40.428 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.428 INFO:teuthology.orchestra.run.smithi177.stdout:1641 read 0x1a9700c thru 0x1aa0763 (0x9758 bytes) 2019-12-16T22:45:40.429 INFO:teuthology.orchestra.run.smithi177.stdout:1137 punch from 0x2b53dcf to 0x2b58e90, (0x50c1 bytes) 2019-12-16T22:45:40.429 INFO:teuthology.orchestra.run.smithi177.stdout:1138 write 0xe9ad63d thru 0xe9b6628 (0x8fec bytes) 2019-12-16T22:45:40.430 INFO:teuthology.orchestra.run.smithi177.stdout:1642 trunc from 0x4d8ef27 to 0x3fa9083 2019-12-16T22:45:40.437 INFO:teuthology.orchestra.run.smithi177.stdout:1139 punch from 0x821a7c4 to 0x8222522, (0x7d5e bytes) 2019-12-16T22:45:40.437 INFO:teuthology.orchestra.run.smithi177.stdout:1142 punch from 0x53c8533 to 0x53d4a1d, (0xc4ea bytes) 2019-12-16T22:45:40.437 INFO:teuthology.orchestra.run.smithi177.stdout:1143 write 0x4a43c68 thru 0x4a45c2f (0x1fc8 bytes) 2019-12-16T22:45:40.448 INFO:teuthology.orchestra.run.smithi177.stdout:1144 read 0x3ce51a5 thru 0x3ceb8c1 (0x671d bytes) 2019-12-16T22:45:40.448 INFO:teuthology.orchestra.run.smithi177.stdout:1146 read 0x66d1518 thru 0x66d8ddf (0x78c8 bytes) 2019-12-16T22:45:40.449 INFO:teuthology.orchestra.run.smithi177.stdout:1149 write 0xce309f8 thru 0xce317f7 (0xe00 bytes) 2019-12-16T22:45:40.450 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.450 INFO:teuthology.orchestra.run.smithi177.stdout:897 punch from 0x4fd6d49 to 0x4fd8c89, (0x1f40 bytes) 2019-12-16T22:45:40.451 INFO:teuthology.orchestra.run.smithi177.stdout:898 read 0x6d66661 thru 0x6d6fee6 (0x9886 bytes) 2019-12-16T22:45:40.451 INFO:teuthology.orchestra.run.smithi177.stdout:900 punch from 0xcf937c3 to 0xcfa1c94, (0xe4d1 bytes) 2019-12-16T22:45:40.451 INFO:teuthology.orchestra.run.smithi177.stdout:903 read 0xcda89ba thru 0xcdae74c (0x5d93 bytes) 2019-12-16T22:45:40.451 INFO:teuthology.orchestra.run.smithi177.stdout:904 read 0xadddfea thru 0xade3921 (0x5938 bytes) 2019-12-16T22:45:40.451 INFO:teuthology.orchestra.run.smithi177.stdout:905 punch from 0x71ef02f to 0x71f133f, (0x2310 bytes) 2019-12-16T22:45:40.451 INFO:teuthology.orchestra.run.smithi177.stdout:907 read 0x8319d20 thru 0x831dc8b (0x3f6c bytes) 2019-12-16T22:45:40.451 INFO:teuthology.orchestra.run.smithi177.stdout:908 punch from 0xa8c53e0 to 0xa8cac3f, (0x585f bytes) 2019-12-16T22:45:40.452 INFO:teuthology.orchestra.run.smithi177.stdout:910 write 0x227de71 thru 0x2284e76 (0x7006 bytes) 2019-12-16T22:45:40.457 INFO:teuthology.orchestra.run.smithi177.stdout:1150 read 0x8208adf thru 0x820e1f3 (0x5715 bytes) 2019-12-16T22:45:40.461 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.462 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.462 INFO:teuthology.orchestra.run.smithi177.stdout:914 read 0xb15470d thru 0xb1607a3 (0xc097 bytes) 2019-12-16T22:45:40.462 INFO:teuthology.orchestra.run.smithi177.stdout:915 writesame 0x7dbfb5a thru 0x7dc0399 data_size 0x10(0x840 bytes) 2019-12-16T22:45:40.463 INFO:teuthology.orchestra.run.smithi177.stdout:1152 trunc from 0xeb8128f to 0xcec79e6 2019-12-16T22:45:40.483 INFO:teuthology.orchestra.run.smithi177.stdout:916 trunc from 0xe889254 to 0x950c14a 2019-12-16T22:45:40.483 INFO:teuthology.orchestra.run.smithi177.stdout:1153 write 0x308190a thru 0x308bff0 (0xa6e7 bytes) 2019-12-16T22:45:40.489 INFO:teuthology.orchestra.run.smithi177.stdout:1154 write 0x2ca83b8 thru 0x2cb56c1 (0xd30a bytes) 2019-12-16T22:45:40.496 INFO:teuthology.orchestra.run.smithi177.stdout:1155 punch from 0x75ac86b to 0x75b57ad, (0x8f42 bytes) 2019-12-16T22:45:40.496 INFO:teuthology.orchestra.run.smithi177.stdout:1157 write 0x1fac631 thru 0x1fb9f52 (0xd922 bytes) 2019-12-16T22:45:40.506 INFO:teuthology.orchestra.run.smithi177.stdout:1159 read 0x3151eef thru 0x315f99b (0xdaad bytes) 2019-12-16T22:45:40.507 INFO:teuthology.orchestra.run.smithi177.stdout:1160 write 0x47025b5 thru 0x47065ef (0x403b bytes) 2019-12-16T22:45:40.511 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.511 INFO:teuthology.orchestra.run.smithi177.stdout:918 punch from 0x3dcdfb6 to 0x3dd0edf, (0x2f29 bytes) 2019-12-16T22:45:40.511 INFO:teuthology.orchestra.run.smithi177.stdout:919 write 0x19498f5 thru 0x194cb1d (0x3229 bytes) 2019-12-16T22:45:40.512 INFO:teuthology.orchestra.run.smithi177.stdout:1643 write 0xe51e382 thru 0xe52054f (0x21ce bytes) 2019-12-16T22:45:40.513 INFO:teuthology.orchestra.run.smithi177.stdout:1162 read 0x363e91b thru 0x3643727 (0x4e0d bytes) 2019-12-16T22:45:40.513 INFO:teuthology.orchestra.run.smithi177.stdout:1163 write 0x53ccd39 thru 0x53d59fa (0x8cc2 bytes) 2019-12-16T22:45:40.519 INFO:teuthology.orchestra.run.smithi177.stdout:1164 writesame 0xe14cf4 thru 0xe19543 data_size 0x59(0x4850 bytes) 2019-12-16T22:45:40.520 INFO:teuthology.orchestra.run.smithi177.stdout:920 read 0x7ac9fc4 thru 0x7acf50e (0x554b bytes) 2019-12-16T22:45:40.520 INFO:teuthology.orchestra.run.smithi177.stdout:921 write 0x4c25138 thru 0x4c3181e (0xc6e7 bytes) 2019-12-16T22:45:40.523 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.523 INFO:teuthology.orchestra.run.smithi177.stdout:1645 write 0x60500e thru 0x609c81 (0x4c74 bytes) 2019-12-16T22:45:40.524 INFO:teuthology.orchestra.run.smithi177.stdout:1166 writesame 0x8f3a51c thru 0x8f3b818 data_size 0x1(0x12fd bytes) 2019-12-16T22:45:40.531 INFO:teuthology.orchestra.run.smithi177.stdout:1167 write 0xba6bfbf thru 0xba79859 (0xd89b bytes) 2019-12-16T22:45:40.540 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.540 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.540 INFO:teuthology.orchestra.run.smithi177.stdout:1651 punch from 0xe1c24ce to 0xe1c4f79, (0x2aab bytes) 2019-12-16T22:45:40.542 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.542 INFO:teuthology.orchestra.run.smithi177.stdout:923 read 0x92eb146 thru 0x92efd3a (0x4bf5 bytes) 2019-12-16T22:45:40.542 INFO:teuthology.orchestra.run.smithi177.stdout:926 writesame 0x4aeca1 thru 0x4b9ad6 data_size 0x3(0xae36 bytes) 2019-12-16T22:45:40.544 INFO:teuthology.orchestra.run.smithi177.stdout:1168 write 0x4502dcb thru 0x4508ccf (0x5f05 bytes) 2019-12-16T22:45:40.550 INFO:teuthology.orchestra.run.smithi177.stdout:1169 writesame 0xa146606 thru 0xa148aea data_size 0x1(0x24e5 bytes) 2019-12-16T22:45:40.557 INFO:teuthology.orchestra.run.smithi177.stdout:1652 trunc from 0xe520550 to 0x519a6de 2019-12-16T22:45:40.559 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone10 from 0x29e513d (overlap 0x29e513d) to 0x0 2019-12-16T22:45:40.561 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.561 INFO:teuthology.orchestra.run.smithi177.stdout:1175 write 0x7808ec1 thru 0x780ce98 (0x3fd8 bytes) 2019-12-16T22:45:40.568 INFO:teuthology.orchestra.run.smithi177.stdout:1019 writesame 0x234e026 thru 0x2351af1 data_size 0x4(0x3acc bytes) 2019-12-16T22:45:40.581 INFO:teuthology.orchestra.run.smithi177.stdout:1177 writesame 0xa702a82 thru 0xa70a055 data_size 0x2(0x75d4 bytes) 2019-12-16T22:45:40.601 INFO:teuthology.orchestra.run.smithi177.stdout:1179 write 0x1666ed6 thru 0x166856e (0x1699 bytes) 2019-12-16T22:45:40.611 INFO:teuthology.orchestra.run.smithi177.stdout:927 write 0xaf10ce7 thru 0xaf11e5d (0x1177 bytes) 2019-12-16T22:45:40.611 INFO:teuthology.orchestra.run.smithi177.stdout:1180 write 0x574aa6b thru 0x5758c91 (0xe227 bytes) 2019-12-16T22:45:40.621 INFO:teuthology.orchestra.run.smithi177.stdout:1181 write 0xc97daf1 thru 0xc982900 (0x4e10 bytes) 2019-12-16T22:45:40.621 INFO:teuthology.orchestra.run.smithi177.stdout:928 writesame 0x979e39e thru 0x97ac494 data_size 0x9(0xe0f7 bytes) 2019-12-16T22:45:40.626 INFO:teuthology.orchestra.run.smithi177.stdout:1182 punch from 0xb9029ca to 0xb90ba88, (0x90be bytes) 2019-12-16T22:45:40.626 INFO:teuthology.orchestra.run.smithi177.stdout:1183 write 0xba9a420 thru 0xba9d063 (0x2c44 bytes) 2019-12-16T22:45:40.632 INFO:teuthology.orchestra.run.smithi177.stdout:1653 trunc from 0x519a6de to 0xbfdb9f6 2019-12-16T22:45:40.640 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.640 INFO:teuthology.orchestra.run.smithi177.stdout:1187 clone 10 order 24 su 1048576 sc 3 2019-12-16T22:45:40.645 INFO:teuthology.orchestra.run.smithi177.stdout:929 read 0x2af53c3 thru 0x2af57fd (0x43b bytes) 2019-12-16T22:45:40.645 INFO:teuthology.orchestra.run.smithi177.stdout:930 punch from 0x10eb1ff to 0x10f19b8, (0x67b9 bytes) 2019-12-16T22:45:40.645 INFO:teuthology.orchestra.run.smithi177.stdout:932 read 0x54933d1 thru 0x549d773 (0xa3a3 bytes) 2019-12-16T22:45:40.646 INFO:teuthology.orchestra.run.smithi177.stdout:933 read 0x9edaa78 thru 0x9ee2070 (0x75f9 bytes) 2019-12-16T22:45:40.657 INFO:teuthology.orchestra.run.smithi177.stdout:1655 read 0xbd4d0c0 thru 0xbd58de1 (0xbd22 bytes) 2019-12-16T22:45:40.657 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.657 INFO:teuthology.orchestra.run.smithi177.stdout:1658 punch from 0x73585bc to 0x735de46, (0x588a bytes) 2019-12-16T22:45:40.657 INFO:teuthology.orchestra.run.smithi177.stdout:1660 write 0xa2d452 thru 0xa32596 (0x5145 bytes) 2019-12-16T22:45:40.665 INFO:teuthology.orchestra.run.smithi177.stdout:1661 read 0x9f08513 thru 0x9f17794 (0xf282 bytes) 2019-12-16T22:45:40.666 INFO:teuthology.orchestra.run.smithi177.stdout:1662 write 0x1795d4e thru 0x179936c (0x361f bytes) 2019-12-16T22:45:40.666 INFO:teuthology.orchestra.run.smithi177.stdout:1021 writesame 0xe9b9323 thru 0xe9b9816 data_size 0x2(0x4f4 bytes) 2019-12-16T22:45:40.673 INFO:teuthology.orchestra.run.smithi177.stdout:934 write 0xd4ece2b thru 0xd4f3372 (0x6548 bytes) 2019-12-16T22:45:40.675 INFO:teuthology.orchestra.run.smithi177.stdout:1024 read 0x2dd2196 thru 0x2dd673a (0x45a5 bytes) 2019-12-16T22:45:40.693 INFO:teuthology.orchestra.run.smithi177.stdout:1664 trunc from 0xbfdb9f6 to 0xb1c373e 2019-12-16T22:45:40.693 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.693 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.693 INFO:teuthology.orchestra.run.smithi177.stdout:938 trunc from 0xd4f3373 to 0xd726019 2019-12-16T22:45:40.698 INFO:teuthology.orchestra.run.smithi177.stdout:1025 trunc from 0xe9b9817 to 0x47630f2 2019-12-16T22:45:40.723 INFO:teuthology.orchestra.run.smithi177.stdout:939 write 0xd8bb227 thru 0xd8c102d (0x5e07 bytes) 2019-12-16T22:45:40.732 INFO:teuthology.orchestra.run.smithi177.stdout:1665 writesame 0xed91add thru 0xed955e5 data_size 0x11(0x3b09 bytes) 2019-12-16T22:45:40.736 INFO:teuthology.orchestra.run.smithi177.stdout:1666 read 0xd2e93e9 thru 0xd2f60c9 (0xcce1 bytes) 2019-12-16T22:45:40.737 INFO:teuthology.orchestra.run.smithi177.stdout:940 read 0xa95d64f thru 0xa95fe9f (0x2851 bytes) 2019-12-16T22:45:40.738 INFO:teuthology.orchestra.run.smithi177.stdout:941 write 0xc705801 thru 0xc7130e0 (0xd8e0 bytes) 2019-12-16T22:45:40.750 INFO:teuthology.orchestra.run.smithi177.stdout:1668 trunc from 0xed955e6 to 0x7cbbf12 2019-12-16T22:45:40.760 INFO:teuthology.orchestra.run.smithi177.stdout:943 punch from 0xd4cdeac to 0xd4d00eb, (0x223f bytes) 2019-12-16T22:45:40.760 INFO:teuthology.orchestra.run.smithi177.stdout:944 read 0xc76f2af thru 0xc776171 (0x6ec3 bytes) 2019-12-16T22:45:40.761 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.761 INFO:teuthology.orchestra.run.smithi177.stdout:948 write 0x1291a17 thru 0x129788a (0x5e74 bytes) 2019-12-16T22:45:40.765 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #9, image image_cluster1.client.mirror.0-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent10 2019-12-16T22:45:40.775 INFO:teuthology.orchestra.run.smithi177.stdout:950 punch from 0xc51eb6c to 0xc521bda, (0x306e bytes) 2019-12-16T22:45:40.775 INFO:teuthology.orchestra.run.smithi177.stdout:951 read 0xa076c24 thru 0xa0802d0 (0x96ad bytes) 2019-12-16T22:45:40.804 INFO:teuthology.orchestra.run.smithi177.stdout:1669 write 0x29069b1 thru 0x290a9f8 (0x4048 bytes) 2019-12-16T22:45:40.819 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.819 INFO:teuthology.orchestra.run.smithi177.stdout:1409 punch from 0x2965b6f to 0x297352c, (0xd9bd bytes) 2019-12-16T22:45:40.827 INFO:teuthology.orchestra.run.smithi177.stdout:952 write 0xda7e214 thru 0xda8c4e0 (0xe2cd bytes) 2019-12-16T22:45:40.829 INFO:teuthology.orchestra.run.smithi177.stdout:1670 read 0x7222673 thru 0x722c0b6 (0x9a44 bytes) 2019-12-16T22:45:40.829 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.835 INFO:teuthology.orchestra.run.smithi177.stdout:1672 trunc from 0x7cbbf12 to 0xa97f595 2019-12-16T22:45:40.839 INFO:teuthology.orchestra.run.smithi177.stdout:953 read 0x80f1819 thru 0x80fec4d (0xd435 bytes) 2019-12-16T22:45:40.839 INFO:teuthology.orchestra.run.smithi177.stdout:954 write 0x539394d thru 0x5399881 (0x5f35 bytes) 2019-12-16T22:45:40.849 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.849 INFO:teuthology.orchestra.run.smithi177.stdout:956 write 0x88ea5e0 thru 0x88f3cbb (0x96dc bytes) 2019-12-16T22:45:40.859 INFO:teuthology.orchestra.run.smithi177.stdout:1673 trunc from 0xa97f595 to 0xb97304f 2019-12-16T22:45:40.863 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.863 INFO:teuthology.orchestra.run.smithi177.stdout:962 writesame 0x854870b thru 0x85509ad data_size 0x1(0x82a3 bytes) 2019-12-16T22:45:40.875 INFO:teuthology.orchestra.run.smithi177.stdout:1412 write 0xa8c58a4 thru 0xa8c763e (0x1d9b bytes) 2019-12-16T22:45:40.875 INFO:teuthology.orchestra.run.smithi177.stdout:1674 read 0x6ae8c81 thru 0x6af5d6d (0xd0ed bytes) 2019-12-16T22:45:40.875 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.876 INFO:teuthology.orchestra.run.smithi177.stdout:1027 writesame 0xdcc5ba3 thru 0xdcd27ea data_size 0xc(0xcc48 bytes) 2019-12-16T22:45:40.886 INFO:teuthology.orchestra.run.smithi177.stdout:1029 read 0x240a191 thru 0x2415020 (0xae90 bytes) 2019-12-16T22:45:40.887 INFO:teuthology.orchestra.run.smithi177.stdout:1030 read 0x83eaa5f thru 0x83f4f77 (0xa519 bytes) 2019-12-16T22:45:40.888 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.888 INFO:teuthology.orchestra.run.smithi177.stdout:1033 punch from 0x915dc34 to 0x916c361, (0xe72d bytes) 2019-12-16T22:45:40.890 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.890 INFO:teuthology.orchestra.run.smithi177.stdout:1414 write 0x51b4cfb thru 0x51c235d (0xd663 bytes) 2019-12-16T22:45:40.891 INFO:teuthology.orchestra.run.smithi177.stdout:963 write 0x1538d58 thru 0x153ddd4 (0x507d bytes) 2019-12-16T22:45:40.911 INFO:teuthology.orchestra.run.smithi177.stdout:1676 writesame 0xe65a341 thru 0xe668849 data_size 0x1(0xe509 bytes) 2019-12-16T22:45:40.915 INFO:teuthology.orchestra.run.smithi177.stdout:1415 write 0x102878a thru 0x10347ae (0xc025 bytes) 2019-12-16T22:45:40.916 INFO:teuthology.orchestra.run.smithi177.stdout:1677 write 0xe02e549 thru 0xe02f7b0 (0x1268 bytes) 2019-12-16T22:45:40.918 INFO:teuthology.orchestra.run.smithi177.stdout:1034 write 0xdf232f5 thru 0xdf30ec0 (0xdbcc bytes) 2019-12-16T22:45:40.926 INFO:teuthology.orchestra.run.smithi177.stdout:964 trunc from 0xda8c4e1 to 0x415ab6d 2019-12-16T22:45:40.934 INFO:teuthology.orchestra.run.smithi177.stdout:1678 writesame 0xb1efc02 thru 0xb1efc71 data_size 0x2(0x70 bytes) 2019-12-16T22:45:40.934 INFO:teuthology.orchestra.run.smithi177.stdout:1036 write 0xb0810fc thru 0xb0879e1 (0x68e6 bytes) 2019-12-16T22:45:40.946 INFO:teuthology.orchestra.run.smithi177.stdout:1037 write 0xaf6df95 thru 0xaf7875e (0xa7ca bytes) 2019-12-16T22:45:40.954 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.954 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.954 INFO:teuthology.orchestra.run.smithi177.stdout:1681 write 0x271ef0c thru 0x272209e (0x3193 bytes) 2019-12-16T22:45:40.962 INFO:teuthology.orchestra.run.smithi177.stdout:1038 writesame 0x6916b92 thru 0x69258ea data_size 0x1(0xed59 bytes) 2019-12-16T22:45:40.963 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.971 INFO:teuthology.orchestra.run.smithi177.stdout:1682 punch from 0x4db6482 to 0x4db6e9b, (0xa19 bytes) 2019-12-16T22:45:40.971 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:40.971 INFO:teuthology.orchestra.run.smithi177.stdout:1684 writesame 0xad44981 thru 0xad44e0f data_size 0x1(0x48f bytes) 2019-12-16T22:45:41.011 INFO:teuthology.orchestra.run.smithi177.stdout:1417 write 0xc252b84 thru 0xc253982 (0xdff bytes) 2019-12-16T22:45:41.012 INFO:teuthology.orchestra.run.smithi177.stdout:1039 clone 11 order 24 su 8388608 sc 14 2019-12-16T22:45:41.018 INFO:teuthology.orchestra.run.smithi177.stdout:1687 read 0x4650dda thru 0x465b184 (0xa3ab bytes) 2019-12-16T22:45:41.018 INFO:teuthology.orchestra.run.smithi177.stdout:1688 write 0x97f2698 thru 0x97fbf9f (0x9908 bytes) 2019-12-16T22:45:41.021 INFO:teuthology.orchestra.run.smithi177.stdout:1419 writesame 0x1aeb1a thru 0x1b609e data_size 0xb(0x7585 bytes) 2019-12-16T22:45:41.025 INFO:teuthology.orchestra.run.smithi177.stdout:965 write 0x5985a1e thru 0x598a660 (0x4c43 bytes) 2019-12-16T22:45:41.041 INFO:teuthology.orchestra.run.smithi177.stdout:1689 write 0x8aedd01 thru 0x8af98e1 (0xbbe1 bytes) 2019-12-16T22:45:41.056 INFO:teuthology.orchestra.run.smithi177.stdout:1690 writesame 0x888016a thru 0x8884a44 data_size 0x1(0x48db bytes) 2019-12-16T22:45:41.057 INFO:teuthology.orchestra.run.smithi177.stdout:1420 writesame 0x4c99c7f thru 0x4c9a1c7 data_size 0xb(0x549 bytes) 2019-12-16T22:45:41.064 INFO:teuthology.orchestra.run.smithi177.stdout:1421 read 0x2437b7c thru 0x243c7cc (0x4c51 bytes) 2019-12-16T22:45:41.065 INFO:teuthology.orchestra.run.smithi177.stdout:1423 write 0x79895d0 thru 0x799835b (0xed8c bytes) 2019-12-16T22:45:41.075 INFO:teuthology.orchestra.run.smithi177.stdout:966 write 0x5b3f1d4 thru 0x5b3f76a (0x597 bytes) 2019-12-16T22:45:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:967 read 0x5745e07 thru 0x5749c61 (0x3e5b bytes) 2019-12-16T22:45:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:968 read 0x3ec88b thru 0x3edda8 (0x151e bytes) 2019-12-16T22:45:41.082 INFO:teuthology.orchestra.run.smithi177.stdout:969 clone 9 order 18 su 4096 sc 11 2019-12-16T22:45:41.090 INFO:teuthology.orchestra.run.smithi177.stdout:1425 trunc from 0xc253983 to 0x81375c6 2019-12-16T22:45:41.096 INFO:teuthology.orchestra.run.smithi177.stdout:1691 trunc from 0xe66884a to 0x3808c08 2019-12-16T22:45:41.128 INFO:teuthology.orchestra.run.smithi177.stdout:1692 read 0x1b6dcda thru 0x1b71b36 (0x3e5d bytes) 2019-12-16T22:45:41.129 INFO:teuthology.orchestra.run.smithi177.stdout:1693 punch from 0x330b307 to 0x330edda, (0x3ad3 bytes) 2019-12-16T22:45:41.129 INFO:teuthology.orchestra.run.smithi177.stdout:1695 punch from 0x5d2a6e to 0x5e26ea, (0xfc7c bytes) 2019-12-16T22:45:41.135 INFO:teuthology.orchestra.run.smithi177.stdout:1696 trunc from 0x3808c08 to 0x6abc385 2019-12-16T22:45:41.143 INFO:teuthology.orchestra.run.smithi177.stdout:1427 writesame 0xb4458d3 thru 0xb452435 data_size 0x1(0xcb63 bytes) 2019-12-16T22:45:41.145 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.145 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.145 INFO:teuthology.orchestra.run.smithi177.stdout:1432 write 0x1d28313 thru 0x1d2bedb (0x3bc9 bytes) 2019-12-16T22:45:41.150 INFO:teuthology.orchestra.run.smithi177.stdout:1697 read 0x2f766c5 thru 0x2f83c36 (0xd572 bytes) 2019-12-16T22:45:41.151 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.151 INFO:teuthology.orchestra.run.smithi177.stdout:1700 read 0x3db518c thru 0x3db9e66 (0x4cdb bytes) 2019-12-16T22:45:41.152 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.152 INFO:teuthology.orchestra.run.smithi177.stdout:1702 write 0x20312ca thru 0x2034527 (0x325e bytes) 2019-12-16T22:45:41.159 INFO:teuthology.orchestra.run.smithi177.stdout:1703 read 0x18dca6e thru 0x18dcd90 (0x323 bytes) 2019-12-16T22:45:41.174 INFO:teuthology.orchestra.run.smithi177.stdout:1433 punch from 0xa5fde51 to 0xa608fb5, (0xb164 bytes) 2019-12-16T22:45:41.174 INFO:teuthology.orchestra.run.smithi177.stdout:1434 write 0xa18ce04 thru 0xa190f06 (0x4103 bytes) 2019-12-16T22:45:41.201 INFO:teuthology.orchestra.run.smithi177.stdout:1435 read 0x37480d2 thru 0x3750fca (0x8ef9 bytes) 2019-12-16T22:45:41.202 INFO:teuthology.orchestra.run.smithi177.stdout:1436 punch from 0x8d0eefc to 0x8d1b5ab, (0xc6af bytes) 2019-12-16T22:45:41.202 INFO:teuthology.orchestra.run.smithi177.stdout:1437 write 0x221e5cf thru 0x2225c3b (0x766d bytes) 2019-12-16T22:45:41.202 INFO:teuthology.orchestra.run.smithi177.stdout:1704 write 0x945dd80 thru 0x946c272 (0xe4f3 bytes) 2019-12-16T22:45:41.207 INFO:teuthology.orchestra.run.smithi177.stdout:1705 read 0x114207e thru 0x114e55a (0xc4dd bytes) 2019-12-16T22:45:41.215 INFO:teuthology.orchestra.run.smithi177.stdout:1707 trunc from 0x946c273 to 0x6340c46 2019-12-16T22:45:41.248 INFO:teuthology.orchestra.run.smithi177.stdout:1708 read 0x4fc26a4 thru 0x4fcfd3e (0xd69b bytes) 2019-12-16T22:45:41.248 INFO:teuthology.orchestra.run.smithi177.stdout:1710 writesame 0x5f449d7 thru 0x5f45591 data_size 0x21(0xbbb bytes) 2019-12-16T22:45:41.249 INFO:teuthology.orchestra.run.smithi177.stdout:1438 write 0xdd0e655 thru 0xdd17071 (0x8a1d bytes) 2019-12-16T22:45:41.258 INFO:teuthology.orchestra.run.smithi177.stdout:1711 read 0x6328c2e thru 0x6336a25 (0xddf8 bytes) 2019-12-16T22:45:41.260 INFO:teuthology.orchestra.run.smithi177.stdout:1439 read 0xcded8a4 thru 0xcdf5a54 (0x81b1 bytes) 2019-12-16T22:45:41.260 INFO:teuthology.orchestra.run.smithi177.stdout:1440 write 0xa290535 thru 0xa29d943 (0xd40f bytes) 2019-12-16T22:45:41.285 INFO:teuthology.orchestra.run.smithi177.stdout:1442 read 0x27cf950 thru 0x27d9b22 (0xa1d3 bytes) 2019-12-16T22:45:41.286 INFO:teuthology.orchestra.run.smithi177.stdout:1713 writesame 0xa135aff thru 0xa138233 data_size 0x1(0x2735 bytes) 2019-12-16T22:45:41.289 INFO:teuthology.orchestra.run.smithi177.stdout:1443 trunc from 0xdd17072 to 0x54bf990 2019-12-16T22:45:41.289 INFO:teuthology.orchestra.run.smithi177.stdout:1714 write 0x86daeb8 thru 0x86e6b6b (0xbcb4 bytes) 2019-12-16T22:45:41.299 INFO:teuthology.orchestra.run.smithi177.stdout:1715 punch from 0x46e0360 to 0x46e3f4a, (0x3bea bytes) 2019-12-16T22:45:41.299 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.299 INFO:teuthology.orchestra.run.smithi177.stdout:1718 read 0x8006ed1 thru 0x8010c78 (0x9da8 bytes) 2019-12-16T22:45:41.299 INFO:teuthology.orchestra.run.smithi177.stdout:1719 write 0x161e41 thru 0x16cbfe (0xadbe bytes) 2019-12-16T22:45:41.306 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.306 INFO:teuthology.orchestra.run.smithi177.stdout:1723 read 0x49373eb thru 0x4944999 (0xd5af bytes) 2019-12-16T22:45:41.306 INFO:teuthology.orchestra.run.smithi177.stdout:1725 punch from 0x2a14022 to 0x2a19415, (0x53f3 bytes) 2019-12-16T22:45:41.306 INFO:teuthology.orchestra.run.smithi177.stdout:1726 read 0x867123a thru 0x867f04b (0xde12 bytes) 2019-12-16T22:45:41.307 INFO:teuthology.orchestra.run.smithi177.stdout:1727 read 0x877650a thru 0x8778b6d (0x2664 bytes) 2019-12-16T22:45:41.325 INFO:teuthology.orchestra.run.smithi177.stdout:1444 trunc from 0x54bf990 to 0x4748c0b 2019-12-16T22:45:41.331 INFO:teuthology.orchestra.run.smithi177.stdout:1728 write 0xdac1c92 thru 0xdacec97 (0xd006 bytes) 2019-12-16T22:45:41.361 INFO:teuthology.orchestra.run.smithi177.stdout:1729 trunc from 0xdacec98 to 0xa400aa2 2019-12-16T22:45:41.385 INFO:teuthology.orchestra.run.smithi177.stdout:1445 punch from 0x5d8158 to 0x5dde1e, (0x5cc6 bytes) 2019-12-16T22:45:41.393 INFO:teuthology.orchestra.run.smithi177.stdout:1446 trunc from 0x4748c0b to 0x152b86c 2019-12-16T22:45:41.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.411 INFO:teuthology.orchestra.run.smithi177.stdout:1733 write 0x4aebf0a thru 0x4af3abc (0x7bb3 bytes) 2019-12-16T22:45:41.418 INFO:teuthology.orchestra.run.smithi177.stdout:1175 writesame 0x7cca565 thru 0x7ccb589 data_size 0x1(0x1025 bytes) 2019-12-16T22:45:41.427 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.428 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.428 INFO:teuthology.orchestra.run.smithi177.stdout:1737 read 0x7301610 thru 0x730ae84 (0x9875 bytes) 2019-12-16T22:45:41.428 INFO:teuthology.orchestra.run.smithi177.stdout:1739 read 0x6051ea2 thru 0x605fc03 (0xdd62 bytes) 2019-12-16T22:45:41.429 INFO:teuthology.orchestra.run.smithi177.stdout:1740 writesame 0x99c20b0 thru 0x99c2509 data_size 0x1(0x45a bytes) 2019-12-16T22:45:41.432 INFO:teuthology.orchestra.run.smithi177.stdout:1179 read 0x23c372a thru 0x23c6d05 (0x35dc bytes) 2019-12-16T22:45:41.433 INFO:teuthology.orchestra.run.smithi177.stdout:1180 write 0x3dfbda1 thru 0x3e02cc0 (0x6f20 bytes) 2019-12-16T22:45:41.442 INFO:teuthology.orchestra.run.smithi177.stdout:1741 trunc from 0xa400aa2 to 0xc7029b5 2019-12-16T22:45:41.471 INFO:teuthology.orchestra.run.smithi177.stdout:1743 punch from 0x18388df to 0x183b7a1, (0x2ec2 bytes) 2019-12-16T22:45:41.471 INFO:teuthology.orchestra.run.smithi177.stdout:1744 punch from 0xbea6885 to 0xbeae027, (0x77a2 bytes) 2019-12-16T22:45:41.472 INFO:teuthology.orchestra.run.smithi177.stdout:1745 read 0x4686ed0 thru 0x468ae3e (0x3f6f bytes) 2019-12-16T22:45:41.472 INFO:teuthology.orchestra.run.smithi177.stdout:1746 punch from 0x52af636 to 0x52af8e8, (0x2b2 bytes) 2019-12-16T22:45:41.474 INFO:teuthology.orchestra.run.smithi177.stdout:1181 trunc from 0xe869c2f to 0x18ee6c9 2019-12-16T22:45:41.480 INFO:teuthology.orchestra.run.smithi177.stdout:1447 write 0xe883abc thru 0xe883bd9 (0x11e bytes) 2019-12-16T22:45:41.491 INFO:teuthology.orchestra.run.smithi177.stdout:1448 punch from 0x5dfcc0e to 0x5e04c24, (0x8016 bytes) 2019-12-16T22:45:41.492 INFO:teuthology.orchestra.run.smithi177.stdout:1747 write 0xcf3c5da thru 0xcf412b0 (0x4cd7 bytes) 2019-12-16T22:45:41.499 INFO:teuthology.orchestra.run.smithi177.stdout:1449 trunc from 0xe883bda to 0xad62517 2019-12-16T22:45:41.524 INFO:teuthology.orchestra.run.smithi177.stdout:1183 writesame 0x5b7592 thru 0x5c28f9 data_size 0x4(0xb368 bytes) 2019-12-16T22:45:41.526 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone10 from 0xdf30ec1 (overlap 0x47630f2) to 0x0 2019-12-16T22:45:41.528 INFO:teuthology.orchestra.run.smithi177.stdout:1748 writesame 0xdae8b0b thru 0xdaeb217 data_size 0x1(0x270d bytes) 2019-12-16T22:45:41.530 INFO:teuthology.orchestra.run.smithi177.stdout:1749 write 0x261b079 thru 0x2621787 (0x670f bytes) 2019-12-16T22:45:41.531 INFO:teuthology.orchestra.run.smithi177.stdout:1450 clone 12 order 21 su 131072 sc 7 2019-12-16T22:45:41.544 INFO:teuthology.orchestra.run.smithi177.stdout:1184 read 0x107b240 thru 0x107ed72 (0x3b33 bytes) 2019-12-16T22:45:41.551 INFO:teuthology.orchestra.run.smithi177.stdout:1750 write 0x179cb9b thru 0x17ab3b9 (0xe81f bytes) 2019-12-16T22:45:41.564 INFO:teuthology.orchestra.run.smithi177.stdout:1751 writesame 0x42fc7b6 thru 0x42ff554 data_size 0x11(0x2d9f bytes) 2019-12-16T22:45:41.572 INFO:teuthology.orchestra.run.smithi177.stdout:1186 write 0x27e259e thru 0x27e8e4b (0x68ae bytes) 2019-12-16T22:45:41.574 INFO:teuthology.orchestra.run.smithi177.stdout:1752 trunc from 0xdaeb218 to 0xaacfac6 2019-12-16T22:45:41.580 INFO:teuthology.orchestra.run.smithi177.stdout:1187 read 0x21c59c9 thru 0x21d5394 (0xf9cc bytes) 2019-12-16T22:45:41.599 INFO:teuthology.orchestra.run.smithi177.stdout:1753 read 0x9b0cec0 thru 0x9b1b923 (0xea64 bytes) 2019-12-16T22:45:41.599 INFO:teuthology.orchestra.run.smithi177.stdout:1754 writesame 0x515ab19 thru 0x5168f6f data_size 0x2d(0xe457 bytes) 2019-12-16T22:45:41.610 INFO:teuthology.orchestra.run.smithi177.stdout:1755 punch from 0x5ce99fe to 0x5cf0367, (0x6969 bytes) 2019-12-16T22:45:41.610 INFO:teuthology.orchestra.run.smithi177.stdout:1756 read 0x97a4892 thru 0x97aaf38 (0x66a7 bytes) 2019-12-16T22:45:41.611 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.619 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #7, image image_cluster1.client.mirror.2-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent8 2019-12-16T22:45:41.621 INFO:teuthology.orchestra.run.smithi177.stdout:1189 write 0xe277fa5 thru 0xe279f21 (0x1f7d bytes) 2019-12-16T22:45:41.622 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #9, image image_cluster1.client.mirror.4-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent10 2019-12-16T22:45:41.627 INFO:teuthology.orchestra.run.smithi177.stdout:1190 write 0x702edb6 thru 0x703249f (0x36ea bytes) 2019-12-16T22:45:41.629 INFO:teuthology.orchestra.run.smithi177.stdout:1758 write 0xb72f2b6 thru 0xb73239b (0x30e6 bytes) 2019-12-16T22:45:41.634 INFO:teuthology.orchestra.run.smithi177.stdout:1191 punch from 0xccb749a to 0xccc0a02, (0x9568 bytes) 2019-12-16T22:45:41.634 INFO:teuthology.orchestra.run.smithi177.stdout:1192 write 0x4a28713 thru 0x4a31395 (0x8c83 bytes) 2019-12-16T22:45:41.646 INFO:teuthology.orchestra.run.smithi177.stdout:1194 write 0x41b0fa7 thru 0x41baf15 (0x9f6f bytes) 2019-12-16T22:45:41.658 INFO:teuthology.orchestra.run.smithi177.stdout:1195 read 0x53008f3 thru 0x530c865 (0xbf73 bytes) 2019-12-16T22:45:41.658 INFO:teuthology.orchestra.run.smithi177.stdout:1196 punch from 0x7cfda93 to 0x7d0beb6, (0xe423 bytes) 2019-12-16T22:45:41.658 INFO:teuthology.orchestra.run.smithi177.stdout:1197 write 0x5211a74 thru 0x5214678 (0x2c05 bytes) 2019-12-16T22:45:41.665 INFO:teuthology.orchestra.run.smithi177.stdout:1198 writesame 0x2aa2a36 thru 0x2aa6748 data_size 0x5(0x3d13 bytes) 2019-12-16T22:45:41.670 INFO:teuthology.orchestra.run.smithi177.stdout:1759 write 0xeab0579 thru 0xeab2959 (0x23e1 bytes) 2019-12-16T22:45:41.671 INFO:teuthology.orchestra.run.smithi177.stdout:1200 write 0x304e28e thru 0x3055b52 (0x78c5 bytes) 2019-12-16T22:45:41.677 INFO:teuthology.orchestra.run.smithi177.stdout:1760 read 0xb91440d thru 0xb91e7aa (0xa39e bytes) 2019-12-16T22:45:41.677 INFO:teuthology.orchestra.run.smithi177.stdout:1201 write 0x1a6b5a3 thru 0x1a72a9a (0x74f8 bytes) 2019-12-16T22:45:41.688 INFO:teuthology.orchestra.run.smithi177.stdout:1761 trunc from 0xeab295a to 0xa5b4e62 2019-12-16T22:45:41.704 INFO:teuthology.orchestra.run.smithi177.stdout:1202 trunc from 0xe279f22 to 0x24b7e87 2019-12-16T22:45:41.712 INFO:teuthology.orchestra.run.smithi177.stdout:1763 punch from 0xd211a2 to 0xd25f45, (0x4da3 bytes) 2019-12-16T22:45:41.727 INFO:teuthology.orchestra.run.smithi177.stdout:1764 trunc from 0xa5b4e62 to 0x1181aa2 2019-12-16T22:45:41.731 INFO:teuthology.orchestra.run.smithi177.stdout:1203 punch from 0x536c73 to 0x53a3a7, (0x3734 bytes) 2019-12-16T22:45:41.731 INFO:teuthology.orchestra.run.smithi177.stdout:1204 read 0x8f60ac thru 0x8ff6a2 (0x95f7 bytes) 2019-12-16T22:45:41.754 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #8, image image_cluster1.client.mirror.5-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent9 2019-12-16T22:45:41.765 INFO:teuthology.orchestra.run.smithi177.stdout:1767 read 0x8bcf8c thru 0x8c05ba (0x362f bytes) 2019-12-16T22:45:41.766 INFO:teuthology.orchestra.run.smithi177.stdout:1770 punch from 0xd137c5 to 0xd18281, (0x4abc bytes) 2019-12-16T22:45:41.766 INFO:teuthology.orchestra.run.smithi177.stdout:1207 write 0xa1d6231 thru 0xa1d8e8a (0x2c5a bytes) 2019-12-16T22:45:41.773 INFO:teuthology.orchestra.run.smithi177.stdout:1209 read 0x302bbc4 thru 0x30326e9 (0x6b26 bytes) 2019-12-16T22:45:41.773 INFO:teuthology.orchestra.run.smithi177.stdout:1211 read 0x20fb7e8 thru 0x2108fd2 (0xd7eb bytes) 2019-12-16T22:45:41.773 INFO:teuthology.orchestra.run.smithi177.stdout:1215 write 0x6476e38 thru 0x6477676 (0x83f bytes) 2019-12-16T22:45:41.789 INFO:teuthology.orchestra.run.smithi177.stdout:1771 writesame 0x1fb2452 thru 0x1fb80f0 data_size 0x1(0x5c9f bytes) 2019-12-16T22:45:41.791 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.792 INFO:teuthology.orchestra.run.smithi177.stdout:1773 punch from 0x102161 to 0x10b398, (0x9237 bytes) 2019-12-16T22:45:41.792 INFO:teuthology.orchestra.run.smithi177.stdout:1774 read 0x1f8d7bb thru 0x1f9b5f2 (0xde38 bytes) 2019-12-16T22:45:41.792 INFO:teuthology.orchestra.run.smithi177.stdout:1775 read 0x326947 thru 0x3352d8 (0xe992 bytes) 2019-12-16T22:45:41.793 INFO:teuthology.orchestra.run.smithi177.stdout:1776 read 0x32f409 thru 0x334442 (0x503a bytes) 2019-12-16T22:45:41.796 INFO:teuthology.orchestra.run.smithi177.stdout:1216 trunc from 0xa1d8e8b to 0x2b0e52e 2019-12-16T22:45:41.811 INFO:teuthology.orchestra.run.smithi177.stdout:1779 writesame 0x2377833 thru 0x238371c data_size 0x7(0xbeea bytes) 2019-12-16T22:45:41.813 INFO:teuthology.orchestra.run.smithi177.stdout:1780 write 0x20e7b77 thru 0x20f4050 (0xc4da bytes) 2019-12-16T22:45:41.821 INFO:teuthology.orchestra.run.smithi177.stdout:1217 read 0x1e0e5cf thru 0x1e0e7fe (0x230 bytes) 2019-12-16T22:45:41.826 INFO:teuthology.orchestra.run.smithi177.stdout:1781 punch from 0x2e89ff to 0x2ee881, (0x5e82 bytes) 2019-12-16T22:45:41.826 INFO:teuthology.orchestra.run.smithi177.stdout:1782 read 0x131a680 thru 0x132641a (0xbd9b bytes) 2019-12-16T22:45:41.826 INFO:teuthology.orchestra.run.smithi177.stdout:1783 read 0xdba4aa thru 0xdc584f (0xb3a6 bytes) 2019-12-16T22:45:41.826 INFO:teuthology.orchestra.run.smithi177.stdout:1784 read 0x1ba1be1 thru 0x1ba4333 (0x2753 bytes) 2019-12-16T22:45:41.830 INFO:teuthology.orchestra.run.smithi177.stdout:1786 trunc from 0x238371d to 0x44781b1 2019-12-16T22:45:41.864 INFO:teuthology.orchestra.run.smithi177.stdout:1218 write 0x9c6d516 thru 0x9c6e963 (0x144e bytes) 2019-12-16T22:45:41.864 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.864 INFO:teuthology.orchestra.run.smithi177.stdout:1220 trunc from 0x9c6e964 to 0x6de9097 2019-12-16T22:45:41.865 INFO:teuthology.orchestra.run.smithi177.stdout:1788 trunc from 0x44781b1 to 0xa96ed 2019-12-16T22:45:41.889 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.915 INFO:teuthology.orchestra.run.smithi177.stdout:1789 writesame 0xbd56d3d thru 0xbd5ee97 data_size 0x5(0x815b bytes) 2019-12-16T22:45:41.917 INFO:teuthology.orchestra.run.smithi177.stdout:1790 write 0x7aa6858 thru 0x7ab3c39 (0xd3e2 bytes) 2019-12-16T22:45:41.922 INFO:teuthology.orchestra.run.smithi177.stdout:1223 writesame 0xb7d865c thru 0xb7e82c8 data_size 0x1(0xfc6d bytes) 2019-12-16T22:45:41.924 INFO:teuthology.orchestra.run.smithi177.stdout:1224 read 0x9137c51 thru 0x913faf9 (0x7ea9 bytes) 2019-12-16T22:45:41.935 INFO:teuthology.orchestra.run.smithi177.stdout:1791 trunc from 0xbd5ee98 to 0x97e66af 2019-12-16T22:45:41.938 INFO:teuthology.orchestra.run.smithi177.stdout:1225 trunc from 0xb7e82c9 to 0x4e52129 2019-12-16T22:45:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.953 INFO:teuthology.orchestra.run.smithi177.stdout:1793 write 0x76f2663 thru 0x76fa28e (0x7c2c bytes) 2019-12-16T22:45:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:1226 punch from 0x13d16d0 to 0x13d1e7d, (0x7ad bytes) 2019-12-16T22:45:41.960 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:41.961 INFO:teuthology.orchestra.run.smithi177.stdout:1794 writesame 0x4f66005 thru 0x4f6e790 data_size 0x19(0x878c bytes) 2019-12-16T22:45:41.967 INFO:teuthology.orchestra.run.smithi177.stdout:1796 clone 8 order 24 su 65536 sc 3 2019-12-16T22:45:41.973 INFO:teuthology.orchestra.run.smithi177.stdout:1189 write 0xa9f5769 thru 0xaa055e1 (0xfe79 bytes) 2019-12-16T22:45:41.984 INFO:teuthology.orchestra.run.smithi177.stdout:1230 write 0xa0adcda thru 0xa0b8cb8 (0xafdf bytes) 2019-12-16T22:45:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:1231 read 0x677431f thru 0x6775e3d (0x1b1f bytes) 2019-12-16T22:45:42.002 INFO:teuthology.orchestra.run.smithi177.stdout:1232 writesame 0x4790239 thru 0x4791aca data_size 0x11(0x1892 bytes) 2019-12-16T22:45:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:1234 read 0x3316201 thru 0x331b0ee (0x4eee bytes) 2019-12-16T22:45:42.017 INFO:teuthology.orchestra.run.smithi177.stdout:1235 punch from 0x1737fc7 to 0x1743727, (0xb760 bytes) 2019-12-16T22:45:42.034 INFO:teuthology.orchestra.run.smithi177.stdout:1190 read 0xc76f638 thru 0xc772592 (0x2f5b bytes) 2019-12-16T22:45:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:1191 punch from 0x57992dd to 0x579e22b, (0x4f4e bytes) 2019-12-16T22:45:42.035 INFO:teuthology.orchestra.run.smithi177.stdout:970 read 0x487404f thru 0x487ec23 (0xabd5 bytes) 2019-12-16T22:45:42.039 INFO:teuthology.orchestra.run.smithi177.stdout:1237 trunc from 0xa0b8cb9 to 0x1fe7f2c 2019-12-16T22:45:42.054 INFO:teuthology.orchestra.run.smithi177.stdout:1192 trunc from 0xcec79e6 to 0x42fcf0c 2019-12-16T22:45:42.057 INFO:teuthology.orchestra.run.smithi177.stdout:972 write 0x1f00f1c thru 0x1f027cf (0x18b4 bytes) 2019-12-16T22:45:42.064 INFO:teuthology.orchestra.run.smithi177.stdout:1041 punch from 0x15c8642 to 0x15ca880, (0x223e bytes) 2019-12-16T22:45:42.074 INFO:teuthology.orchestra.run.smithi177.stdout:973 punch from 0x42fec7d to 0x4301923, (0x2ca6 bytes) 2019-12-16T22:45:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:974 read 0x1868cf6 thru 0x18767f3 (0xdafe bytes) 2019-12-16T22:45:42.075 INFO:teuthology.orchestra.run.smithi177.stdout:975 read 0x477d12 thru 0x47aa0e (0x2cfd bytes) 2019-12-16T22:45:42.084 INFO:teuthology.orchestra.run.smithi177.stdout:1042 writesame 0xcecd979 thru 0xced0974 data_size 0x53(0x2ffc bytes) 2019-12-16T22:45:42.085 INFO:teuthology.orchestra.run.smithi177.stdout:1239 trunc from 0x1fe7f2c to 0x521ef8d 2019-12-16T22:45:42.094 INFO:teuthology.orchestra.run.smithi177.stdout:1043 writesame 0x9742ab8 thru 0x974b3a5 data_size 0x11(0x88ee bytes) 2019-12-16T22:45:42.100 INFO:teuthology.orchestra.run.smithi177.stdout:1193 punch from 0x12f6adc to 0x12f8325, (0x1849 bytes) 2019-12-16T22:45:42.108 INFO:teuthology.orchestra.run.smithi177.stdout:976 writesame 0x83dabe1 thru 0x83e1530 data_size 0x28(0x6950 bytes) 2019-12-16T22:45:42.111 INFO:teuthology.orchestra.run.smithi177.stdout:1044 read 0xd9d9cb thru 0xda1d95 (0x43cb bytes) 2019-12-16T22:45:42.112 INFO:teuthology.orchestra.run.smithi177.stdout:1045 punch from 0x48b7cec to 0x48be6e4, (0x69f8 bytes) 2019-12-16T22:45:42.112 INFO:teuthology.orchestra.run.smithi177.stdout:1046 read 0x3221193 thru 0x322a661 (0x94cf bytes) 2019-12-16T22:45:42.112 INFO:teuthology.orchestra.run.smithi177.stdout:1047 read 0xb2e4b9a thru 0xb2e977d (0x4be4 bytes) 2019-12-16T22:45:42.113 INFO:teuthology.orchestra.run.smithi177.stdout:1048 punch from 0xdf1d40b to 0xdf2cdf4, (0xf9e9 bytes) 2019-12-16T22:45:42.113 INFO:teuthology.orchestra.run.smithi177.stdout:1049 punch from 0x4f25031 to 0x4f27e9e, (0x2e6d bytes) 2019-12-16T22:45:42.113 INFO:teuthology.orchestra.run.smithi177.stdout:1051 read 0x7762f6a thru 0x776f013 (0xc0aa bytes) 2019-12-16T22:45:42.114 INFO:teuthology.orchestra.run.smithi177.stdout:977 read 0x1930234 thru 0x193dcb9 (0xda86 bytes) 2019-12-16T22:45:42.114 INFO:teuthology.orchestra.run.smithi177.stdout:978 read 0x18956df thru 0x189db9d (0x84bf bytes) 2019-12-16T22:45:42.115 INFO:teuthology.orchestra.run.smithi177.stdout:979 read 0x581efac thru 0x58201d6 (0x122b bytes) 2019-12-16T22:45:42.115 INFO:teuthology.orchestra.run.smithi177.stdout:982 punch from 0x4713de3 to 0x471a196, (0x63b3 bytes) 2019-12-16T22:45:42.124 INFO:teuthology.orchestra.run.smithi177.stdout:1240 write 0x5c8df22 thru 0x5c99079 (0xb158 bytes) 2019-12-16T22:45:42.126 INFO:teuthology.orchestra.run.smithi177.stdout:1052 trunc from 0xdf30ec1 to 0x7be7129 2019-12-16T22:45:42.137 INFO:teuthology.orchestra.run.smithi177.stdout:1241 punch from 0x1caf2d4 to 0x1cb3137, (0x3e63 bytes) 2019-12-16T22:45:42.145 INFO:teuthology.orchestra.run.smithi177.stdout:1194 write 0xe4a1d35 thru 0xe4b1123 (0xf3ef bytes) 2019-12-16T22:45:42.160 INFO:teuthology.orchestra.run.smithi177.stdout:983 writesame 0xdf70086 thru 0xdf7f61f data_size 0x3f(0xf59a bytes) 2019-12-16T22:45:42.161 INFO:teuthology.orchestra.run.smithi177.stdout:1196 read 0xdf54a8b thru 0xdf5839f (0x3915 bytes) 2019-12-16T22:45:42.161 INFO:teuthology.orchestra.run.smithi177.stdout:1197 punch from 0x70d5eae to 0x70df10f, (0x9261 bytes) 2019-12-16T22:45:42.161 INFO:teuthology.orchestra.run.smithi177.stdout:1199 write 0xc93ab62 thru 0xc93d53e (0x29dd bytes) 2019-12-16T22:45:42.170 INFO:teuthology.orchestra.run.smithi177.stdout:1242 writesame 0x8ef7163 thru 0x8f01919 data_size 0x1f(0xa7b7 bytes) 2019-12-16T22:45:42.172 INFO:teuthology.orchestra.run.smithi177.stdout:1200 read 0x535181e thru 0x5355634 (0x3e17 bytes) 2019-12-16T22:45:42.173 INFO:teuthology.orchestra.run.smithi177.stdout:984 write 0xaa15062 thru 0xaa1eda3 (0x9d42 bytes) 2019-12-16T22:45:42.173 INFO:teuthology.orchestra.run.smithi177.stdout:1201 punch from 0x820dfdd to 0x82196fc, (0xb71f bytes) 2019-12-16T22:45:42.173 INFO:teuthology.orchestra.run.smithi177.stdout:1202 writesame 0x65494f4 thru 0x65589b3 data_size 0xb(0xf4c0 bytes) 2019-12-16T22:45:42.183 INFO:teuthology.orchestra.run.smithi177.stdout:1243 write 0xbf25eb thru 0xbfe9b5 (0xc3cb bytes) 2019-12-16T22:45:42.197 INFO:teuthology.orchestra.run.smithi177.stdout:1245 punch from 0x86fd7bb to 0x8703930, (0x6175 bytes) 2019-12-16T22:45:42.198 INFO:teuthology.orchestra.run.smithi177.stdout:1246 punch from 0x728d71f to 0x729977d, (0xc05e bytes) 2019-12-16T22:45:42.202 INFO:teuthology.orchestra.run.smithi177.stdout:1203 read 0x39e6254 thru 0x39ed6d6 (0x7483 bytes) 2019-12-16T22:45:42.216 INFO:teuthology.orchestra.run.smithi177.stdout:1204 trunc from 0xe4b1124 to 0x6c141f4 2019-12-16T22:45:42.228 INFO:teuthology.orchestra.run.smithi177.stdout:1247 write 0xed7ff2d thru 0xed8a29c (0xa370 bytes) 2019-12-16T22:45:42.238 INFO:teuthology.orchestra.run.smithi177.stdout:1248 read 0x8e77dda thru 0x8e825cb (0xa7f2 bytes) 2019-12-16T22:45:42.239 INFO:teuthology.orchestra.run.smithi177.stdout:1250 read 0x1b99793 thru 0x1ba38d8 (0xa146 bytes) 2019-12-16T22:45:42.239 INFO:teuthology.orchestra.run.smithi177.stdout:1251 writesame 0xc6f03be thru 0xc6fa9ad data_size 0x78(0xa5f0 bytes) 2019-12-16T22:45:42.241 INFO:teuthology.orchestra.run.smithi177.stdout:1053 trunc from 0x7be7129 to 0xea19ec7 2019-12-16T22:45:42.245 INFO:teuthology.orchestra.run.smithi177.stdout:1205 read 0x1668ea4 thru 0x16786ac (0xf809 bytes) 2019-12-16T22:45:42.245 INFO:teuthology.orchestra.run.smithi177.stdout:1208 punch from 0x15a4b5f to 0x15a9c80, (0x5121 bytes) 2019-12-16T22:45:42.245 INFO:teuthology.orchestra.run.smithi177.stdout:1209 punch from 0x21d953d to 0x21da0ca, (0xb8d bytes) 2019-12-16T22:45:42.245 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.246 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.246 INFO:teuthology.orchestra.run.smithi177.stdout:1212 punch from 0x17786e2 to 0x17840e5, (0xba03 bytes) 2019-12-16T22:45:42.246 INFO:teuthology.orchestra.run.smithi177.stdout:1214 write 0x1322e34 thru 0x1330ec8 (0xe095 bytes) 2019-12-16T22:45:42.246 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.247 INFO:teuthology.orchestra.run.smithi177.stdout:1253 write 0x8db89d2 thru 0x8dbba68 (0x3097 bytes) 2019-12-16T22:45:42.248 INFO:teuthology.orchestra.run.smithi177.stdout:986 write 0xe864ba2 thru 0xe868cd3 (0x4132 bytes) 2019-12-16T22:45:42.259 INFO:teuthology.orchestra.run.smithi177.stdout:1257 write 0x27c0eb8 thru 0x27c2d5e (0x1ea7 bytes) 2019-12-16T22:45:42.268 INFO:teuthology.orchestra.run.smithi177.stdout:1054 read 0x25614b2 thru 0x256b798 (0xa2e7 bytes) 2019-12-16T22:45:42.269 INFO:teuthology.orchestra.run.smithi177.stdout:1259 read 0x7304c31 thru 0x7308e02 (0x41d2 bytes) 2019-12-16T22:45:42.269 INFO:teuthology.orchestra.run.smithi177.stdout:1260 writesame 0xcd2ec10 thru 0xcd37257 data_size 0x4(0x8648 bytes) 2019-12-16T22:45:42.270 INFO:teuthology.orchestra.run.smithi177.stdout:1055 write 0x2519690 thru 0x2524eb3 (0xb824 bytes) 2019-12-16T22:45:42.271 INFO:teuthology.orchestra.run.smithi177.stdout:1215 read 0x6823db4 thru 0x682cdbd (0x900a bytes) 2019-12-16T22:45:42.282 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.282 INFO:teuthology.orchestra.run.smithi177.stdout:988 read 0xa377e4b thru 0xa382c18 (0xadce bytes) 2019-12-16T22:45:42.282 INFO:teuthology.orchestra.run.smithi177.stdout:989 writesame 0x17287fb thru 0x1730cfe data_size 0x2(0x8504 bytes) 2019-12-16T22:45:42.288 INFO:teuthology.orchestra.run.smithi177.stdout:1261 punch from 0x42be6ad to 0x42c5fb5, (0x7908 bytes) 2019-12-16T22:45:42.289 INFO:teuthology.orchestra.run.smithi177.stdout:1263 write 0x20efbc2 thru 0x20f6241 (0x6680 bytes) 2019-12-16T22:45:42.289 INFO:teuthology.orchestra.run.smithi177.stdout:1216 trunc from 0x6c141f4 to 0xdddee0 2019-12-16T22:45:42.297 INFO:teuthology.orchestra.run.smithi177.stdout:1265 writesame 0xcf082f3 thru 0xcf140c4 data_size 0xb2(0xbdd2 bytes) 2019-12-16T22:45:42.306 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.306 INFO:teuthology.orchestra.run.smithi177.stdout:1268 read 0x311f295 thru 0x3122a2f (0x379b bytes) 2019-12-16T22:45:42.306 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.306 INFO:teuthology.orchestra.run.smithi177.stdout:1270 punch from 0xa5449e4 to 0xa54b0bd, (0x66d9 bytes) 2019-12-16T22:45:42.306 INFO:teuthology.orchestra.run.smithi177.stdout:1271 read 0x423ab6 thru 0x42d9f9 (0x9f44 bytes) 2019-12-16T22:45:42.307 INFO:teuthology.orchestra.run.smithi177.stdout:1272 punch from 0x817fa0c to 0x818df10, (0xe504 bytes) 2019-12-16T22:45:42.307 INFO:teuthology.orchestra.run.smithi177.stdout:1274 writesame 0x67bfdf9 thru 0x67cf718 data_size 0x10(0xf920 bytes) 2019-12-16T22:45:42.308 INFO:teuthology.orchestra.run.smithi177.stdout:1059 trunc from 0xea19ec7 to 0x9508ba 2019-12-16T22:45:42.326 INFO:teuthology.orchestra.run.smithi177.stdout:1275 writesame 0x2b15f5 thru 0x2be616 data_size 0x1(0xd022 bytes) 2019-12-16T22:45:42.331 INFO:teuthology.orchestra.run.smithi177.stdout:990 write 0x4d9e793 thru 0x4dac119 (0xd987 bytes) 2019-12-16T22:45:42.371 INFO:teuthology.orchestra.run.smithi177.stdout:1217 punch from 0x2fbe4d to 0x3001ee, (0x43a1 bytes) 2019-12-16T22:45:42.372 INFO:teuthology.orchestra.run.smithi177.stdout:1219 punch from 0x5e771 to 0x6c376, (0xdc05 bytes) 2019-12-16T22:45:42.372 INFO:teuthology.orchestra.run.smithi177.stdout:1220 read 0x36b5fd thru 0x378532 (0xcf36 bytes) 2019-12-16T22:45:42.380 INFO:teuthology.orchestra.run.smithi177.stdout:1277 write 0xeb58f1f thru 0xeb6752d (0xe60f bytes) 2019-12-16T22:45:42.391 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:45:42.386+0000 7f85ba142700 -1 osd.1 pg_epoch: 50 pg[2.d( v 50'638 (0'0,50'638] local-lis/les=13/14 n=48 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [1,2] r=0 lpr=13 luod=49'637 crt=50'638 lcod 49'636 mlcod 49'636 active+clean+snaptrim trimq=[55~1] ps=[4a~1]] removing snap head 2019-12-16T22:45:42.429 INFO:teuthology.orchestra.run.smithi177.stdout:1279 trunc from 0xed8a29d to 0xaab2a34 2019-12-16T22:45:42.445 INFO:teuthology.orchestra.run.smithi177.stdout:1221 write 0x3dd6604 thru 0x3dd9506 (0x2f03 bytes) 2019-12-16T22:45:42.463 INFO:teuthology.orchestra.run.smithi177.stdout:1223 read 0x321eb25 thru 0x3224286 (0x5762 bytes) 2019-12-16T22:45:42.463 INFO:teuthology.orchestra.run.smithi177.stdout:1226 punch from 0x19c7a05 to 0x19c9b51, (0x214c bytes) 2019-12-16T22:45:42.463 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.463 INFO:teuthology.orchestra.run.smithi177.stdout:1229 read 0x309fa41 thru 0x30a9684 (0x9c44 bytes) 2019-12-16T22:45:42.464 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.464 INFO:teuthology.orchestra.run.smithi177.stdout:1231 writesame 0x32e1e69 thru 0x32e30fa data_size 0x1(0x1292 bytes) 2019-12-16T22:45:42.468 INFO:teuthology.orchestra.run.smithi177.stdout:991 write 0x8acfca2 thru 0x8add892 (0xdbf1 bytes) 2019-12-16T22:45:42.475 INFO:teuthology.orchestra.run.smithi177.stdout:1232 read 0x40b846 thru 0x40dfa0 (0x275b bytes) 2019-12-16T22:45:42.476 INFO:teuthology.orchestra.run.smithi177.stdout:1233 write 0x2c2076 thru 0x2ce08f (0xc01a bytes) 2019-12-16T22:45:42.479 INFO:teuthology.orchestra.run.smithi177.stdout:1280 write 0x55006c8 thru 0x550475f (0x4098 bytes) 2019-12-16T22:45:42.484 INFO:teuthology.orchestra.run.smithi177.stdout:1234 read 0x280465c thru 0x280b235 (0x6bda bytes) 2019-12-16T22:45:42.485 INFO:teuthology.orchestra.run.smithi177.stdout:1235 punch from 0x1a1fa40 to 0x1a2e635, (0xebf5 bytes) 2019-12-16T22:45:42.490 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.492 INFO:teuthology.orchestra.run.smithi177.stdout:1281 read 0x1bbcd3a thru 0x1bc2f1a (0x61e1 bytes) 2019-12-16T22:45:42.500 INFO:teuthology.orchestra.run.smithi177.stdout:1236 trunc from 0x3dd9507 to 0x8a146aa 2019-12-16T22:45:42.501 INFO:teuthology.orchestra.run.smithi177.stdout:1061 trunc from 0x9508ba to 0x5552e94 2019-12-16T22:45:42.516 INFO:teuthology.orchestra.run.smithi177.stdout:992 write 0x6b20116 thru 0x6b2d8f8 (0xd7e3 bytes) 2019-12-16T22:45:42.525 INFO:teuthology.orchestra.run.smithi177.stdout:1062 writesame 0x229db63 thru 0x22ab8f1 data_size 0x1(0xdd8f bytes) 2019-12-16T22:45:42.531 INFO:teuthology.orchestra.run.smithi177.stdout:1238 read 0x4e30f28 thru 0x4e31098 (0x171 bytes) 2019-12-16T22:45:42.532 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.532 INFO:teuthology.orchestra.run.smithi177.stdout:1243 trunc from 0x8a146aa to 0x8e6e23c 2019-12-16T22:45:42.534 INFO:teuthology.orchestra.run.smithi177.stdout:1282 writesame 0xe425033 thru 0xe431d33 data_size 0xd(0xcd01 bytes) 2019-12-16T22:45:42.573 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone7 from 0x97e66af (overlap 0x2d4d3) to 0x0 2019-12-16T22:45:42.574 INFO:teuthology.orchestra.run.smithi177.stdout:1283 read 0xb99249c thru 0xb9a224b (0xfdb0 bytes) 2019-12-16T22:45:42.574 INFO:teuthology.orchestra.run.smithi177.stdout:1285 punch from 0xaebb273 to 0xaec6678, (0xb405 bytes) 2019-12-16T22:45:42.574 INFO:teuthology.orchestra.run.smithi177.stdout:1286 read 0x21a08c1 thru 0x21ab3c7 (0xab07 bytes) 2019-12-16T22:45:42.574 INFO:teuthology.orchestra.run.smithi177.stdout:1063 read 0x5444980 thru 0x544cb2b (0x81ac bytes) 2019-12-16T22:45:42.574 INFO:teuthology.orchestra.run.smithi177.stdout:1065 punch from 0x3dac481 to 0x3dba013, (0xdb92 bytes) 2019-12-16T22:45:42.575 INFO:teuthology.orchestra.run.smithi177.stdout:1066 read 0x2f28c6a thru 0x2f35851 (0xcbe8 bytes) 2019-12-16T22:45:42.575 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.576 INFO:teuthology.orchestra.run.smithi177.stdout:1070 read 0x14f493d thru 0x14f6050 (0x1714 bytes) 2019-12-16T22:45:42.576 INFO:teuthology.orchestra.run.smithi177.stdout:1073 punch from 0x5442b97 to 0x5449fc4, (0x742d bytes) 2019-12-16T22:45:42.576 INFO:teuthology.orchestra.run.smithi177.stdout:1074 read 0x8b8435 thru 0x8bb100 (0x2ccc bytes) 2019-12-16T22:45:42.576 INFO:teuthology.orchestra.run.smithi177.stdout:1075 writesame 0x2bc0926 thru 0x2bc826b data_size 0x13(0x7946 bytes) 2019-12-16T22:45:42.576 INFO:teuthology.orchestra.run.smithi177.stdout:1287 write 0x2404882 thru 0x240a89c (0x601b bytes) 2019-12-16T22:45:42.588 INFO:teuthology.orchestra.run.smithi177.stdout:1288 read 0x7ad6ce2 thru 0x7ade932 (0x7c51 bytes) 2019-12-16T22:45:42.588 INFO:teuthology.orchestra.run.smithi177.stdout:1289 punch from 0x4044fae to 0x40478e7, (0x2939 bytes) 2019-12-16T22:45:42.588 INFO:teuthology.orchestra.run.smithi177.stdout:1290 writesame 0x14828d0 thru 0x1484251 data_size 0x5(0x1982 bytes) 2019-12-16T22:45:42.596 INFO:teuthology.orchestra.run.smithi177.stdout:1292 read 0xd81f22c thru 0xd827db0 (0x8b85 bytes) 2019-12-16T22:45:42.609 INFO:teuthology.orchestra.run.smithi177.stdout:1244 write 0x71ab60d thru 0x71b3f16 (0x890a bytes) 2019-12-16T22:45:42.609 INFO:teuthology.orchestra.run.smithi177.stdout:1293 trunc from 0xe431d34 to 0x82fccc6 2019-12-16T22:45:42.610 INFO:teuthology.orchestra.run.smithi177.stdout:993 write 0xa4adbab thru 0xa4b8fb7 (0xb40d bytes) 2019-12-16T22:45:42.793 INFO:teuthology.orchestra.run.smithi177.stdout:1294 read 0x3fa7668 thru 0x3fb1fa1 (0xa93a bytes) 2019-12-16T22:45:42.793 INFO:teuthology.orchestra.run.smithi177.stdout:1295 read 0x14d33f8 thru 0x14e28ce (0xf4d7 bytes) 2019-12-16T22:45:42.800 INFO:teuthology.orchestra.run.smithi177.stdout:1076 writesame 0xd4ba1c4 thru 0xd4bc175 data_size 0x1(0x1fb2 bytes) 2019-12-16T22:45:42.821 INFO:teuthology.orchestra.run.smithi177.stdout:1246 writesame 0xad9fc60 thru 0xadaad4f data_size 0x13(0xb0f0 bytes) 2019-12-16T22:45:42.824 INFO:teuthology.orchestra.run.smithi177.stdout:1247 punch from 0x27e4bce to 0x27ef1d3, (0xa605 bytes) 2019-12-16T22:45:42.824 INFO:teuthology.orchestra.run.smithi177.stdout:1248 write 0x734f0ab thru 0x735585e (0x67b4 bytes) 2019-12-16T22:45:42.826 INFO:teuthology.orchestra.run.smithi177.stdout:1296 write 0x96590e3 thru 0x9668f1a (0xfe38 bytes) 2019-12-16T22:45:42.826 INFO:teuthology.orchestra.run.smithi177.stdout:994 read 0x45a69 thru 0x4c86d (0x6e05 bytes) 2019-12-16T22:45:42.828 INFO:teuthology.orchestra.run.smithi177.stdout:995 read 0x81ecf52 thru 0x81fad32 (0xdde1 bytes) 2019-12-16T22:45:42.829 INFO:teuthology.orchestra.run.smithi177.stdout:1077 trunc from 0xd4bc176 to 0xe3ba7 2019-12-16T22:45:42.833 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.0-clone11 intact 2019-12-16T22:45:42.839 INFO:teuthology.orchestra.run.smithi177.stdout:996 trunc from 0xe868cd4 to 0x7f65b7f 2019-12-16T22:45:42.841 INFO:teuthology.orchestra.run.smithi177.stdout:1298 read 0x81eaa3e thru 0x81f0543 (0x5b06 bytes) 2019-12-16T22:45:42.841 INFO:teuthology.orchestra.run.smithi177.stdout:1300 read 0x4197f19 thru 0x419a457 (0x253f bytes) 2019-12-16T22:45:42.842 INFO:teuthology.orchestra.run.smithi177.stdout:1301 trunc from 0x9668f1b to 0x90777ca 2019-12-16T22:45:42.843 INFO:teuthology.orchestra.run.smithi177.stdout:1249 writesame 0x28efefe thru 0x28fe48b data_size 0x1(0xe58e bytes) 2019-12-16T22:45:42.875 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #6, image image_cluster1.client.mirror.1-clone6 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent7 2019-12-16T22:45:42.898 INFO:teuthology.orchestra.run.smithi177.stdout:1252 writesame 0x254d829 thru 0x255d60e data_size 0x8a(0xfde6 bytes) 2019-12-16T22:45:42.902 INFO:teuthology.orchestra.run.smithi177.stdout:1253 read 0x5f57976 thru 0x5f6550b (0xdb96 bytes) 2019-12-16T22:45:42.903 INFO:teuthology.orchestra.run.smithi177.stdout:1254 read 0xcd5a38 thru 0xcd7087 (0x1650 bytes) 2019-12-16T22:45:42.903 INFO:teuthology.orchestra.run.smithi177.stdout:1255 write 0x2276b06 thru 0x2278d25 (0x2220 bytes) 2019-12-16T22:45:42.908 INFO:teuthology.orchestra.run.smithi177.stdout:1256 write 0x4c03500 thru 0x4c0bf7f (0x8a80 bytes) 2019-12-16T22:45:42.909 INFO:teuthology.orchestra.run.smithi177.stdout:997 write 0x6de5672 thru 0x6def6a3 (0xa032 bytes) 2019-12-16T22:45:42.912 INFO:teuthology.orchestra.run.smithi177.stdout:1078 trunc from 0xe3ba7 to 0x101d1bc 2019-12-16T22:45:42.917 INFO:teuthology.orchestra.run.smithi177.stdout:1257 write 0x94e4d4a thru 0x94eb07c (0x6333 bytes) 2019-12-16T22:45:42.933 INFO:teuthology.orchestra.run.smithi177.stdout:1258 write 0x159666e thru 0x159b95a (0x52ed bytes) 2019-12-16T22:45:42.933 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.933 INFO:teuthology.orchestra.run.smithi177.stdout:1080 read 0x7ed19a thru 0x7f5c8c (0x8af3 bytes) 2019-12-16T22:45:42.935 INFO:teuthology.orchestra.run.smithi177.stdout:1081 write 0xea0ab9 thru 0xeab7e3 (0xad2b bytes) 2019-12-16T22:45:42.936 INFO:teuthology.orchestra.run.smithi177.stdout:1305 write 0xeabdcd5 thru 0xeac1636 (0x3962 bytes) 2019-12-16T22:45:42.945 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.945 INFO:teuthology.orchestra.run.smithi177.stdout:1262 punch from 0x572aa16 to 0x57318bf, (0x6ea9 bytes) 2019-12-16T22:45:42.945 INFO:teuthology.orchestra.run.smithi177.stdout:1264 writesame 0x4b33cb6 thru 0x4b394df data_size 0x25(0x582a bytes) 2019-12-16T22:45:42.953 INFO:teuthology.orchestra.run.smithi177.stdout:1082 read 0x1513a7 thru 0x158253 (0x6ead bytes) 2019-12-16T22:45:42.953 INFO:teuthology.orchestra.run.smithi177.stdout:1083 read 0xc5f0a0 thru 0xc664ce (0x742f bytes) 2019-12-16T22:45:42.953 INFO:teuthology.orchestra.run.smithi177.stdout:1306 writesame 0x214cc2d thru 0x21509d8 data_size 0x2(0x3dac bytes) 2019-12-16T22:45:42.954 INFO:teuthology.orchestra.run.smithi177.stdout:1084 read 0x3bb109 thru 0x3c28fe (0x77f6 bytes) 2019-12-16T22:45:42.956 INFO:teuthology.orchestra.run.smithi177.stdout:1085 punch from 0x20c8cf to 0x2129e0, (0x6111 bytes) 2019-12-16T22:45:42.956 INFO:teuthology.orchestra.run.smithi177.stdout:1086 punch from 0xb608c7 to 0xb61201, (0x93a bytes) 2019-12-16T22:45:42.956 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.956 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:42.959 INFO:teuthology.orchestra.run.smithi177.stdout:998 write 0x3f07cf9 thru 0x3f124fe (0xa806 bytes) 2019-12-16T22:45:42.963 INFO:teuthology.orchestra.run.smithi177.stdout:1307 write 0x64390a2 thru 0x64428d7 (0x9836 bytes) 2019-12-16T22:45:42.967 INFO:teuthology.orchestra.run.smithi177.stdout:1266 writesame 0x56593c9 thru 0x566832b data_size 0x1(0xef63 bytes) 2019-12-16T22:45:43.025 INFO:teuthology.orchestra.run.smithi177.stdout:1308 read 0x5e3cf6e thru 0x5e42660 (0x56f3 bytes) 2019-12-16T22:45:43.026 INFO:teuthology.orchestra.run.smithi177.stdout:1309 read 0x75b27bf thru 0x75b40e2 (0x1924 bytes) 2019-12-16T22:45:43.026 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.026 INFO:teuthology.orchestra.run.smithi177.stdout:1312 writesame 0xdd44f15 thru 0xdd4d8b1 data_size 0x1(0x899d bytes) 2019-12-16T22:45:43.032 INFO:teuthology.orchestra.run.smithi177.stdout:1267 read 0x6c4eaa2 thru 0x6c5a85f (0xbdbe bytes) 2019-12-16T22:45:43.032 INFO:teuthology.orchestra.run.smithi177.stdout:1268 read 0x14c2abd thru 0x14cae10 (0x8354 bytes) 2019-12-16T22:45:43.033 INFO:teuthology.orchestra.run.smithi177.stdout:1270 punch from 0x40d20ec to 0x40d2410, (0x324 bytes) 2019-12-16T22:45:43.033 INFO:teuthology.orchestra.run.smithi177.stdout:1272 punch from 0xa0decbd to 0xa0e167c, (0x29bf bytes) 2019-12-16T22:45:43.033 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.045 INFO:teuthology.orchestra.run.smithi177.stdout:1089 write 0xc725013 thru 0xc731597 (0xc585 bytes) 2019-12-16T22:45:43.068 INFO:teuthology.orchestra.run.smithi177.stdout:1092 writesame 0x9a31fdc thru 0x9a35d94 data_size 0x17(0x3db9 bytes) 2019-12-16T22:45:43.068 INFO:teuthology.orchestra.run.smithi177.stdout:1314 trunc from 0xeac1637 to 0xe028932 2019-12-16T22:45:43.077 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.077 INFO:teuthology.orchestra.run.smithi177.stdout:1001 punch from 0x1c6cbb2 to 0x1c70407, (0x3855 bytes) 2019-12-16T22:45:43.078 INFO:teuthology.orchestra.run.smithi177.stdout:1002 write 0x1a7073 thru 0x1b0215 (0x91a3 bytes) 2019-12-16T22:45:43.078 INFO:teuthology.orchestra.run.smithi177.stdout:1094 write 0x230f642 thru 0x2319d78 (0xa737 bytes) 2019-12-16T22:45:43.088 INFO:teuthology.orchestra.run.smithi177.stdout:1275 writesame 0xd18ab9e thru 0xd18c3c3 data_size 0xb(0x1826 bytes) 2019-12-16T22:45:43.108 INFO:teuthology.orchestra.run.smithi177.stdout:1276 trunc from 0xd18c3c4 to 0xb15d1a5 2019-12-16T22:45:43.113 INFO:teuthology.orchestra.run.smithi177.stdout:1095 writesame 0x38e4048 thru 0x38f2bec data_size 0x5f(0xeba5 bytes) 2019-12-16T22:45:43.123 INFO:teuthology.orchestra.run.smithi177.stdout:1096 punch from 0xb33b5f1 to 0xb345318, (0x9d27 bytes) 2019-12-16T22:45:43.124 INFO:teuthology.orchestra.run.smithi177.stdout:1097 read 0x54519cb thru 0x545f91d (0xdf53 bytes) 2019-12-16T22:45:43.124 INFO:teuthology.orchestra.run.smithi177.stdout:1098 read 0x20e12e8 thru 0x20e3718 (0x2431 bytes) 2019-12-16T22:45:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:1099 read 0x54b3768 thru 0x54bd26f (0x9b08 bytes) 2019-12-16T22:45:43.126 INFO:teuthology.orchestra.run.smithi177.stdout:1101 read 0x9bec4d5 thru 0x9bf5124 (0x8c50 bytes) 2019-12-16T22:45:43.127 INFO:teuthology.orchestra.run.smithi177.stdout:1102 read 0x359d846 thru 0x35a72c4 (0x9a7f bytes) 2019-12-16T22:45:43.127 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.128 INFO:teuthology.orchestra.run.smithi177.stdout:1110 write 0xbca375c thru 0xbcae0ff (0xa9a4 bytes) 2019-12-16T22:45:43.129 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #10, image image_cluster1.client.mirror.0-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent11 2019-12-16T22:45:43.130 INFO:teuthology.orchestra.run.smithi177.stdout:1315 writesame 0x96ff66f thru 0x9709b3d data_size 0x1(0xa4cf bytes) 2019-12-16T22:45:43.146 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.146 INFO:teuthology.orchestra.run.smithi177.stdout:1281 writesame 0x128d812 thru 0x1299e5a data_size 0x1(0xc649 bytes) 2019-12-16T22:45:43.166 INFO:teuthology.orchestra.run.smithi177.stdout:1316 read 0x6251589 thru 0x625457c (0x2ff4 bytes) 2019-12-16T22:45:43.167 INFO:teuthology.orchestra.run.smithi177.stdout:1317 writesame 0x95232e5 thru 0x9530704 data_size 0x10(0xd420 bytes) 2019-12-16T22:45:43.180 INFO:teuthology.orchestra.run.smithi177.stdout:1318 punch from 0x9ecec4 to 0x9fb563, (0xe69f bytes) 2019-12-16T22:45:43.181 INFO:teuthology.orchestra.run.smithi177.stdout:1319 write 0x29e4313 thru 0x29e6094 (0x1d82 bytes) 2019-12-16T22:45:43.200 INFO:teuthology.orchestra.run.smithi177.stdout:1321 read 0xcfc8533 thru 0xcfd6c7b (0xe749 bytes) 2019-12-16T22:45:43.200 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.200 INFO:teuthology.orchestra.run.smithi177.stdout:1326 read 0x17be4e9 thru 0x17c4a85 (0x659d bytes) 2019-12-16T22:45:43.200 INFO:teuthology.orchestra.run.smithi177.stdout:1451 punch from 0x322e888 to 0x3233840, (0x4fb8 bytes) 2019-12-16T22:45:43.201 INFO:teuthology.orchestra.run.smithi177.stdout:1327 write 0x5aa41e8 thru 0x5aae06c (0x9e85 bytes) 2019-12-16T22:45:43.216 INFO:teuthology.orchestra.run.smithi177.stdout:1328 punch from 0xba0a592 to 0xba1562c, (0xb09a bytes) 2019-12-16T22:45:43.216 INFO:teuthology.orchestra.run.smithi177.stdout:1329 writesame 0x86dcea6 thru 0x86e834a data_size 0x5(0xb4a5 bytes) 2019-12-16T22:45:43.219 INFO:teuthology.orchestra.run.smithi177.stdout:1111 writesame 0xd22125e thru 0xd22b328 data_size 0x1(0xa0cb bytes) 2019-12-16T22:45:43.223 INFO:teuthology.orchestra.run.smithi177.stdout:1112 writesame 0xa668084 thru 0xa675e5a data_size 0x3d(0xddd7 bytes) 2019-12-16T22:45:43.223 INFO:teuthology.orchestra.run.smithi177.stdout:1452 write 0x548e6ff thru 0x54936ec (0x4fee bytes) 2019-12-16T22:45:43.227 INFO:teuthology.orchestra.run.smithi177.stdout:1330 write 0x5e12670 thru 0x5e1afab (0x893c bytes) 2019-12-16T22:45:43.232 INFO:teuthology.orchestra.run.smithi177.stdout:1003 writesame 0xb165708 thru 0xb16873f data_size 0x4(0x3038 bytes) 2019-12-16T22:45:43.233 INFO:teuthology.orchestra.run.smithi177.stdout:1113 clone 12 order 20 su 524288 sc 7 2019-12-16T22:45:43.233 INFO:teuthology.orchestra.run.smithi177.stdout:1453 read 0x6c6bd2b thru 0x6c78202 (0xc4d8 bytes) 2019-12-16T22:45:43.234 INFO:teuthology.orchestra.run.smithi177.stdout:1454 read 0x8505573 thru 0x850f4c7 (0x9f55 bytes) 2019-12-16T22:45:43.235 INFO:teuthology.orchestra.run.smithi177.stdout:1455 read 0x2f0d10d thru 0x2f1898d (0xb881 bytes) 2019-12-16T22:45:43.236 INFO:teuthology.orchestra.run.smithi177.stdout:1005 read 0x2cd2e30 thru 0x2ce11ca (0xe39b bytes) 2019-12-16T22:45:43.236 INFO:teuthology.orchestra.run.smithi177.stdout:1331 write 0x1a7fcc6 thru 0x1a874cb (0x7806 bytes) 2019-12-16T22:45:43.237 INFO:teuthology.orchestra.run.smithi177.stdout:1282 write 0xb98071f thru 0xb988af1 (0x83d3 bytes) 2019-12-16T22:45:43.237 INFO:teuthology.orchestra.run.smithi177.stdout:1007 read 0xb146509 thru 0xb14ed7a (0x8872 bytes) 2019-12-16T22:45:43.237 INFO:teuthology.orchestra.run.smithi177.stdout:1009 read 0x361d6ce thru 0x3622f04 (0x5837 bytes) 2019-12-16T22:45:43.238 INFO:teuthology.orchestra.run.smithi177.stdout:1011 writesame 0x55f4e6a thru 0x55ff79b data_size 0x3(0xa932 bytes) 2019-12-16T22:45:43.246 INFO:teuthology.orchestra.run.smithi177.stdout:1332 punch from 0xb0e25fa to 0xb0efa35, (0xd43b bytes) 2019-12-16T22:45:43.246 INFO:teuthology.orchestra.run.smithi177.stdout:1336 punch from 0x2fd7f60 to 0x2fd8772, (0x812 bytes) 2019-12-16T22:45:43.246 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.247 INFO:teuthology.orchestra.run.smithi177.stdout:1339 write 0x2688db6 thru 0x268b353 (0x259e bytes) 2019-12-16T22:45:43.247 INFO:teuthology.orchestra.run.smithi177.stdout:1283 write 0x5e9b829 thru 0x5ea3415 (0x7bed bytes) 2019-12-16T22:45:43.248 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.248 INFO:teuthology.orchestra.run.smithi177.stdout:1341 clone 11 order 19 su 16384 sc 10 2019-12-16T22:45:43.254 INFO:teuthology.orchestra.run.smithi177.stdout:1284 writesame 0x8e86359 thru 0x8e9219b data_size 0x1(0xbe43 bytes) 2019-12-16T22:45:43.283 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.283 INFO:teuthology.orchestra.run.smithi177.stdout:1287 write 0x29a39f0 thru 0x29a4ce6 (0x12f7 bytes) 2019-12-16T22:45:43.288 INFO:teuthology.orchestra.run.smithi177.stdout:1012 punch from 0x878035b to 0x8783309, (0x2fae bytes) 2019-12-16T22:45:43.295 INFO:teuthology.orchestra.run.smithi177.stdout:1289 read 0x6e09a9d thru 0x6e18980 (0xeee4 bytes) 2019-12-16T22:45:43.295 INFO:teuthology.orchestra.run.smithi177.stdout:1290 write 0x255a6a2 thru 0x25612d4 (0x6c33 bytes) 2019-12-16T22:45:43.295 INFO:teuthology.orchestra.run.smithi177.stdout:1797 punch from 0x6af96a9 to 0x6afcefc, (0x3853 bytes) 2019-12-16T22:45:43.296 INFO:teuthology.orchestra.run.smithi177.stdout:1291 read 0x4b25d6a thru 0x4b33fdb (0xe272 bytes) 2019-12-16T22:45:43.296 INFO:teuthology.orchestra.run.smithi177.stdout:1456 write 0xea91490 thru 0xea929e4 (0x1555 bytes) 2019-12-16T22:45:43.299 INFO:teuthology.orchestra.run.smithi177.stdout:1013 trunc from 0xb168740 to 0x53405c3 2019-12-16T22:45:43.302 INFO:teuthology.orchestra.run.smithi177.stdout:1458 writesame 0x52681f8 thru 0x527236d data_size 0x6(0xa176 bytes) 2019-12-16T22:45:43.309 INFO:teuthology.orchestra.run.smithi177.stdout:1799 read 0x44868ba thru 0x44933e4 (0xcb2b bytes) 2019-12-16T22:45:43.309 INFO:teuthology.orchestra.run.smithi177.stdout:1801 punch from 0x96e874 to 0x971554, (0x2ce0 bytes) 2019-12-16T22:45:43.309 INFO:teuthology.orchestra.run.smithi177.stdout:1802 writesame 0x5338cc3 thru 0x5344e66 data_size 0x36(0xc1a4 bytes) 2019-12-16T22:45:43.324 INFO:teuthology.orchestra.run.smithi177.stdout:1460 read 0x8470939 thru 0x847e88a (0xdf52 bytes) 2019-12-16T22:45:43.324 INFO:teuthology.orchestra.run.smithi177.stdout:1461 read 0x69103e7 thru 0x69111e5 (0xdff bytes) 2019-12-16T22:45:43.325 INFO:teuthology.orchestra.run.smithi177.stdout:1464 writesame 0xd40b3c3 thru 0xd40e9a7 data_size 0x1b(0x35e5 bytes) 2019-12-16T22:45:43.331 INFO:teuthology.orchestra.run.smithi177.stdout:1292 write 0xbaa177b thru 0xbaabc18 (0xa49e bytes) 2019-12-16T22:45:43.336 INFO:teuthology.orchestra.run.smithi177.stdout:1803 clone 9 order 24 su 262144 sc 15 2019-12-16T22:45:43.340 INFO:teuthology.orchestra.run.smithi177.stdout:1467 punch from 0x3aeb6e1 to 0x3af2628, (0x6f47 bytes) 2019-12-16T22:45:43.340 INFO:teuthology.orchestra.run.smithi177.stdout:1468 punch from 0x240b675 to 0x2416f66, (0xb8f1 bytes) 2019-12-16T22:45:43.341 INFO:teuthology.orchestra.run.smithi177.stdout:1469 read 0xb5ce14d thru 0xb5d6f51 (0x8e05 bytes) 2019-12-16T22:45:43.341 INFO:teuthology.orchestra.run.smithi177.stdout:1470 read 0xc3ff73 thru 0xc4c1e7 (0xc275 bytes) 2019-12-16T22:45:43.342 INFO:teuthology.orchestra.run.smithi177.stdout:1471 writesame 0x60bd629 thru 0x60ca1ab data_size 0x1(0xcb83 bytes) 2019-12-16T22:45:43.352 INFO:teuthology.orchestra.run.smithi177.stdout:1293 trunc from 0xbaabc19 to 0x8176bc8 2019-12-16T22:45:43.380 INFO:teuthology.orchestra.run.smithi177.stdout:1473 write 0x297e3c3 thru 0x297f09a (0xcd8 bytes) 2019-12-16T22:45:43.392 INFO:teuthology.orchestra.run.smithi177.stdout:1474 write 0x845c086 thru 0x8464926 (0x88a1 bytes) 2019-12-16T22:45:43.407 INFO:teuthology.orchestra.run.smithi177.stdout:1475 read 0x6c7f20 thru 0x6d2d53 (0xae34 bytes) 2019-12-16T22:45:43.407 INFO:teuthology.orchestra.run.smithi177.stdout:1476 read 0x1f7b4e8 thru 0x1f7d2bb (0x1dd4 bytes) 2019-12-16T22:45:43.409 INFO:teuthology.orchestra.run.smithi177.stdout:1477 read 0x63d4ab9 thru 0x63e02b4 (0xb7fc bytes) 2019-12-16T22:45:43.409 INFO:teuthology.orchestra.run.smithi177.stdout:1478 read 0xe3ebc1f thru 0xe3ee14b (0x252d bytes) 2019-12-16T22:45:43.409 INFO:teuthology.orchestra.run.smithi177.stdout:1479 write 0xa10ac43 thru 0xa10aef7 (0x2b5 bytes) 2019-12-16T22:45:43.414 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.414 INFO:teuthology.orchestra.run.smithi177.stdout:1483 punch from 0x81caa8 to 0x82210b, (0x5663 bytes) 2019-12-16T22:45:43.414 INFO:teuthology.orchestra.run.smithi177.stdout:1484 write 0x8326c50 thru 0x8332d93 (0xc144 bytes) 2019-12-16T22:45:43.424 INFO:teuthology.orchestra.run.smithi177.stdout:1485 read 0x16d9acd thru 0x16e3a4e (0x9f82 bytes) 2019-12-16T22:45:43.424 INFO:teuthology.orchestra.run.smithi177.stdout:1486 write 0xe73ef80 thru 0xe74253d (0x35be bytes) 2019-12-16T22:45:43.428 INFO:teuthology.orchestra.run.smithi177.stdout:1294 writesame 0xc635f36 thru 0xc63eb9d data_size 0x4(0x8c68 bytes) 2019-12-16T22:45:43.431 INFO:teuthology.orchestra.run.smithi177.stdout:1295 read 0x7d3629 thru 0x7df5ee (0xbfc6 bytes) 2019-12-16T22:45:43.431 INFO:teuthology.orchestra.run.smithi177.stdout:1297 write 0x493c9e5 thru 0x493d369 (0x985 bytes) 2019-12-16T22:45:43.432 INFO:teuthology.orchestra.run.smithi177.stdout:1014 write 0xc20d188 thru 0xc2184e2 (0xb35b bytes) 2019-12-16T22:45:43.432 INFO:teuthology.orchestra.run.smithi177.stdout:1487 read 0xc4b7f62 thru 0xc4bced5 (0x4f74 bytes) 2019-12-16T22:45:43.433 INFO:teuthology.orchestra.run.smithi177.stdout:1488 read 0x596f5b8 thru 0x5973d77 (0x47c0 bytes) 2019-12-16T22:45:43.435 INFO:teuthology.orchestra.run.smithi177.stdout:1298 read 0x28b9a04 thru 0x28bc25a (0x2857 bytes) 2019-12-16T22:45:43.436 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.436 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.436 INFO:teuthology.orchestra.run.smithi177.stdout:1302 punch from 0xb68f805 to 0xb68fc46, (0x441 bytes) 2019-12-16T22:45:43.437 INFO:teuthology.orchestra.run.smithi177.stdout:1304 punch from 0xb3f11ca to 0xb400bc1, (0xf9f7 bytes) 2019-12-16T22:45:43.437 INFO:teuthology.orchestra.run.smithi177.stdout:1305 punch from 0x81bae65 to 0x81c1318, (0x64b3 bytes) 2019-12-16T22:45:43.437 INFO:teuthology.orchestra.run.smithi177.stdout:1306 write 0x5ee46cd thru 0x5ef3b51 (0xf485 bytes) 2019-12-16T22:45:43.445 INFO:teuthology.orchestra.run.smithi177.stdout:1307 punch from 0x982ae27 to 0x9833837, (0x8a10 bytes) 2019-12-16T22:45:43.445 INFO:teuthology.orchestra.run.smithi177.stdout:1308 read 0x85f9253 thru 0x86025e2 (0x9390 bytes) 2019-12-16T22:45:43.445 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.446 INFO:teuthology.orchestra.run.smithi177.stdout:1310 read 0xba7bbd5 thru 0xba81fc3 (0x63ef bytes) 2019-12-16T22:45:43.446 INFO:teuthology.orchestra.run.smithi177.stdout:1311 read 0x6ba9c38 thru 0x6bb623e (0xc607 bytes) 2019-12-16T22:45:43.446 INFO:teuthology.orchestra.run.smithi177.stdout:1312 write 0x49b5aee thru 0x49c01df (0xa6f2 bytes) 2019-12-16T22:45:43.453 INFO:teuthology.orchestra.run.smithi177.stdout:1313 write 0xa09f39c thru 0xa0a78be (0x8523 bytes) 2019-12-16T22:45:43.457 INFO:teuthology.orchestra.run.smithi177.stdout:1489 trunc from 0xea929e5 to 0x1aad4f3 2019-12-16T22:45:43.463 INFO:teuthology.orchestra.run.smithi177.stdout:1016 read 0x8851ac0 thru 0x885e323 (0xc864 bytes) 2019-12-16T22:45:43.464 INFO:teuthology.orchestra.run.smithi177.stdout:1019 write 0x9585725 thru 0x958949e (0x3d7a bytes) 2019-12-16T22:45:43.464 INFO:teuthology.orchestra.run.smithi177.stdout:1314 read 0xc06bc3f thru 0xc0784a3 (0xc865 bytes) 2019-12-16T22:45:43.465 INFO:teuthology.orchestra.run.smithi177.stdout:1315 trunc from 0xc63eb9e to 0xc824b8e 2019-12-16T22:45:43.507 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.507 INFO:teuthology.orchestra.run.smithi177.stdout:1023 write 0xbe570ed thru 0xbe63ce0 (0xcbf4 bytes) 2019-12-16T22:45:43.515 INFO:teuthology.orchestra.run.smithi177.stdout:1316 write 0xc5428e6 thru 0xc54f3df (0xcafa bytes) 2019-12-16T22:45:43.532 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.548 INFO:teuthology.orchestra.run.smithi177.stdout:1319 trunc from 0xc824b8e to 0x5a43ef0 2019-12-16T22:45:43.556 INFO:teuthology.orchestra.run.smithi177.stdout:1026 read 0xba03844 thru 0xba092da (0x5a97 bytes) 2019-12-16T22:45:43.556 INFO:teuthology.orchestra.run.smithi177.stdout:1027 punch from 0xb82c5ad to 0xb83b7c7, (0xf21a bytes) 2019-12-16T22:45:43.556 INFO:teuthology.orchestra.run.smithi177.stdout:1028 write 0x3a71cc8 thru 0x3a76aae (0x4de7 bytes) 2019-12-16T22:45:43.562 INFO:teuthology.orchestra.run.smithi177.stdout:1490 read 0xc5110d thru 0xc5b0a2 (0x9f96 bytes) 2019-12-16T22:45:43.586 INFO:teuthology.orchestra.run.smithi177.stdout:1491 write 0x265bfae thru 0x26613cd (0x5420 bytes) 2019-12-16T22:45:43.588 INFO:teuthology.orchestra.run.smithi177.stdout:1029 writesame 0xb474caf thru 0xb480e51 data_size 0x1(0xc1a3 bytes) 2019-12-16T22:45:43.594 INFO:teuthology.orchestra.run.smithi177.stdout:1030 read 0x6e9b2df thru 0x6e9eba3 (0x38c5 bytes) 2019-12-16T22:45:43.595 INFO:teuthology.orchestra.run.smithi177.stdout:1031 write 0x4a8ac1c thru 0x4a8d37e (0x2763 bytes) 2019-12-16T22:45:43.603 INFO:teuthology.orchestra.run.smithi177.stdout:1495 read 0x21e7ff8 thru 0x21eec62 (0x6c6b bytes) 2019-12-16T22:45:43.604 INFO:teuthology.orchestra.run.smithi177.stdout:1496 read 0x60f46b thru 0x613848 (0x43de bytes) 2019-12-16T22:45:43.605 INFO:teuthology.orchestra.run.smithi177.stdout:1497 read 0xc7ce46 thru 0xc8a1dc (0xd397 bytes) 2019-12-16T22:45:43.606 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.606 INFO:teuthology.orchestra.run.smithi177.stdout:1499 punch from 0x198f6a1 to 0x199beed, (0xc84c bytes) 2019-12-16T22:45:43.607 INFO:teuthology.orchestra.run.smithi177.stdout:1500 read 0xb87608 thru 0xb91674 (0xa06d bytes) 2019-12-16T22:45:43.613 INFO:teuthology.orchestra.run.smithi177.stdout:1032 read 0xab50b18 thru 0xab5c70a (0xbbf3 bytes) 2019-12-16T22:45:43.614 INFO:teuthology.orchestra.run.smithi177.stdout:1033 read 0x3601c08 thru 0x36051ae (0x35a7 bytes) 2019-12-16T22:45:43.614 INFO:teuthology.orchestra.run.smithi177.stdout:1034 write 0xad0cd99 thru 0xad1b3fc (0xe664 bytes) 2019-12-16T22:45:43.615 INFO:teuthology.orchestra.run.smithi177.stdout:1321 write 0x953e140 thru 0x95456c6 (0x7587 bytes) 2019-12-16T22:45:43.646 INFO:teuthology.orchestra.run.smithi177.stdout:1501 write 0xa3c15ee thru 0xa3cc4f1 (0xaf04 bytes) 2019-12-16T22:45:43.653 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.653 INFO:teuthology.orchestra.run.smithi177.stdout:1505 write 0x4139701 thru 0x414785e (0xe15e bytes) 2019-12-16T22:45:43.654 INFO:teuthology.orchestra.run.smithi177.stdout:1323 writesame 0xa9444c4 thru 0xa948309 data_size 0x3(0x3e46 bytes) 2019-12-16T22:45:43.659 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.659 INFO:teuthology.orchestra.run.smithi177.stdout:1328 write 0x49133a thru 0x4962ed (0x4fb4 bytes) 2019-12-16T22:45:43.667 INFO:teuthology.orchestra.run.smithi177.stdout:1508 write 0x1d44c35 thru 0x1d4ec6b (0xa037 bytes) 2019-12-16T22:45:43.676 INFO:teuthology.orchestra.run.smithi177.stdout:1035 writesame 0xdac76b0 thru 0xdaca848 data_size 0x1(0x3199 bytes) 2019-12-16T22:45:43.676 INFO:teuthology.orchestra.run.smithi177.stdout:1509 punch from 0x1bd8dbf to 0x1bdfd01, (0x6f42 bytes) 2019-12-16T22:45:43.676 INFO:teuthology.orchestra.run.smithi177.stdout:1510 read 0x9309c95 thru 0x9313025 (0x9391 bytes) 2019-12-16T22:45:43.676 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.679 INFO:teuthology.orchestra.run.smithi177.stdout:1036 write 0x7e6d2e3 thru 0x7e79674 (0xc392 bytes) 2019-12-16T22:45:43.700 INFO:teuthology.orchestra.run.smithi177.stdout:1330 writesame 0xd14ce19 thru 0xd1554b5 data_size 0x15(0x869d bytes) 2019-12-16T22:45:43.705 INFO:teuthology.orchestra.run.smithi177.stdout:1512 writesame 0xc3fe68d thru 0xc403769 data_size 0x1(0x50dd bytes) 2019-12-16T22:45:43.708 INFO:teuthology.orchestra.run.smithi177.stdout:1515 read 0x7ebfa74 thru 0x7ec5603 (0x5b90 bytes) 2019-12-16T22:45:43.708 INFO:teuthology.orchestra.run.smithi177.stdout:1519 read 0x57759aa thru 0x5779070 (0x36c7 bytes) 2019-12-16T22:45:43.711 INFO:teuthology.orchestra.run.smithi177.stdout:1037 punch from 0x3f2cdb2 to 0x3f35c3c, (0x8e8a bytes) 2019-12-16T22:45:43.712 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.712 INFO:teuthology.orchestra.run.smithi177.stdout:1041 read 0x859b00d thru 0x859c945 (0x1939 bytes) 2019-12-16T22:45:43.712 INFO:teuthology.orchestra.run.smithi177.stdout:1042 write 0x264ce20 thru 0x2657aee (0xaccf bytes) 2019-12-16T22:45:43.719 INFO:teuthology.orchestra.run.smithi177.stdout:1331 trunc from 0xd1554b6 to 0x52a0054 2019-12-16T22:45:43.733 INFO:teuthology.orchestra.run.smithi177.stdout:1521 write 0xe40fa6e thru 0xe412003 (0x2596 bytes) 2019-12-16T22:45:43.749 INFO:teuthology.orchestra.run.smithi177.stdout:1523 read 0x721e5de thru 0x7228e3f (0xa862 bytes) 2019-12-16T22:45:43.749 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.749 INFO:teuthology.orchestra.run.smithi177.stdout:1527 write 0xc646fe5 thru 0xc64b161 (0x417d bytes) 2019-12-16T22:45:43.760 INFO:teuthology.orchestra.run.smithi177.stdout:1528 punch from 0xb00ff50 to 0xb012c10, (0x2cc0 bytes) 2019-12-16T22:45:43.760 INFO:teuthology.orchestra.run.smithi177.stdout:1529 write 0x4c79f05 thru 0x4c824af (0x85ab bytes) 2019-12-16T22:45:43.763 INFO:teuthology.orchestra.run.smithi177.stdout:1043 write 0x5fd343e thru 0x5fd9ad1 (0x6694 bytes) 2019-12-16T22:45:43.775 INFO:teuthology.orchestra.run.smithi177.stdout:1530 read 0x1fc22ab thru 0x1fcb3d7 (0x912d bytes) 2019-12-16T22:45:43.776 INFO:teuthology.orchestra.run.smithi177.stdout:1531 writesame 0x5848d21 thru 0x584b5cf data_size 0x1(0x28af bytes) 2019-12-16T22:45:43.777 INFO:teuthology.orchestra.run.smithi177.stdout:1332 trunc from 0x52a0054 to 0xab72d21 2019-12-16T22:45:43.791 INFO:teuthology.orchestra.run.smithi177.stdout:1532 write 0x2970f9c thru 0x297343b (0x24a0 bytes) 2019-12-16T22:45:43.792 INFO:teuthology.orchestra.run.smithi177.stdout:1044 writesame 0xa9a6147 thru 0xa9b2f2b data_size 0x1(0xcde5 bytes) 2019-12-16T22:45:43.806 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xee30476 2019-12-16T22:45:43.822 INFO:teuthology.orchestra.run.smithi177.stdout:1333 trunc from 0xab72d21 to 0xee30476 2019-12-16T22:45:43.830 INFO:teuthology.orchestra.run.smithi177.stdout:1533 trunc from 0xe412004 to 0x498a906 2019-12-16T22:45:43.841 INFO:teuthology.orchestra.run.smithi177.stdout:1334 read 0x8066a91 thru 0x806b388 (0x48f8 bytes) 2019-12-16T22:45:43.841 INFO:teuthology.orchestra.run.smithi177.stdout:1335 punch from 0x1883889 to 0x1888493, (0x4c0a bytes) 2019-12-16T22:45:43.842 INFO:teuthology.orchestra.run.smithi177.stdout:1336 read 0x36da4ee thru 0x36dcff9 (0x2b0c bytes) 2019-12-16T22:45:43.845 INFO:teuthology.orchestra.run.smithi177.stdout:1045 trunc from 0xdaca849 to 0x7da4fd1 2019-12-16T22:45:43.856 INFO:teuthology.orchestra.run.smithi177.stdout:1534 write 0x1be4636 thru 0x1bed139 (0x8b04 bytes) 2019-12-16T22:45:43.859 INFO:teuthology.orchestra.run.smithi177.stdout:1337 trunc from 0xee30476 to 0x67cf556 2019-12-16T22:45:43.873 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.886 INFO:teuthology.orchestra.run.smithi177.stdout:1338 write 0x3728d96 thru 0x3730d35 (0x7fa0 bytes) 2019-12-16T22:45:43.892 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:43.892 INFO:teuthology.orchestra.run.smithi177.stdout:1340 write 0x3a30aa6 thru 0x3a3d119 (0xc674 bytes) 2019-12-16T22:45:43.895 INFO:teuthology.orchestra.run.smithi177.stdout:1046 punch from 0x3c549d4 to 0x3c5c7cc, (0x7df8 bytes) 2019-12-16T22:45:43.895 INFO:teuthology.orchestra.run.smithi177.stdout:1047 read 0x180a2a8 thru 0x1817e9e (0xdbf7 bytes) 2019-12-16T22:45:43.898 INFO:teuthology.orchestra.run.smithi177.stdout:1536 writesame 0x7e50c36 thru 0x7e5c0cb data_size 0x8a(0xb496 bytes) 2019-12-16T22:45:43.900 INFO:teuthology.orchestra.run.smithi177.stdout:1342 writesame 0x2f681a6 thru 0x2f6c5b3 data_size 0x1f(0x440e bytes) 2019-12-16T22:45:43.902 INFO:teuthology.orchestra.run.smithi177.stdout:1048 trunc from 0x7da4fd1 to 0x5d1a02b 2019-12-16T22:45:43.906 INFO:teuthology.orchestra.run.smithi177.stdout:1343 punch from 0x66bce7 to 0x66c0e0, (0x3f9 bytes) 2019-12-16T22:45:43.910 INFO:teuthology.orchestra.run.smithi177.stdout:1537 trunc from 0x7e5c0cc to 0xc57f0c4 2019-12-16T22:45:43.932 INFO:teuthology.orchestra.run.smithi177.stdout:1539 writesame 0xacd38bd thru 0xace0a89 data_size 0x1(0xd1cd bytes) 2019-12-16T22:45:43.932 INFO:teuthology.orchestra.run.smithi177.stdout:1049 writesame 0x2b1e9d5 thru 0x2b22e96 data_size 0xd(0x44c2 bytes) 2019-12-16T22:45:43.941 INFO:teuthology.orchestra.run.smithi177.stdout:1344 write 0xe10a0eb thru 0xe10d575 (0x348b bytes) 2019-12-16T22:45:43.993 INFO:teuthology.orchestra.run.smithi177.stdout:1540 read 0x2fd1706 thru 0x2fddf8d (0xc888 bytes) 2019-12-16T22:45:43.993 INFO:teuthology.orchestra.run.smithi177.stdout:1542 punch from 0x8969afd to 0x896e648, (0x4b4b bytes) 2019-12-16T22:45:43.993 INFO:teuthology.orchestra.run.smithi177.stdout:1543 read 0x96a9a07 thru 0x96b6426 (0xca20 bytes) 2019-12-16T22:45:43.994 INFO:teuthology.orchestra.run.smithi177.stdout:1547 writesame 0xb4a6805 thru 0xb4abcca data_size 0x3(0x54c6 bytes) 2019-12-16T22:45:44.008 INFO:teuthology.orchestra.run.smithi177.stdout:1548 write 0x6cea00c thru 0x6cf2d57 (0x8d4c bytes) 2019-12-16T22:45:44.020 INFO:teuthology.orchestra.run.smithi177.stdout:1345 trunc from 0xe10d576 to 0x2399c35 2019-12-16T22:45:44.023 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:45:44.018+0000 7fe6e56c7700 -1 osd.1 pg_epoch: 38 pg[2.5( v 36'40 (0'0,36'40] local-lis/les=13/14 n=6 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [1,0] r=0 lpr=13 crt=36'40 lcod 36'39 mlcod 36'39 active+clean+snaptrim trimq=[25~1] ps=[23~1]] removing snap head 2019-12-16T22:45:44.027 INFO:teuthology.orchestra.run.smithi177.stdout:1549 read 0xe23dc4 thru 0xe29c60 (0x5e9d bytes) 2019-12-16T22:45:44.041 INFO:teuthology.orchestra.run.smithi177.stdout:1050 trunc from 0x5d1a02b to 0xa843bb2 2019-12-16T22:45:44.043 INFO:teuthology.orchestra.run.smithi177.stdout:1550 trunc from 0xc57f0c4 to 0x3726388 2019-12-16T22:45:44.066 INFO:teuthology.orchestra.run.smithi177.stdout:1346 trunc from 0x2399c35 to 0x16a005b 2019-12-16T22:45:44.077 INFO:teuthology.orchestra.run.smithi177.stdout:1551 read 0x508f72 thru 0x5185e3 (0xf672 bytes) 2019-12-16T22:45:44.078 INFO:teuthology.orchestra.run.smithi177.stdout:1552 punch from 0xc12416 to 0xc15e04, (0x39ee bytes) 2019-12-16T22:45:44.084 INFO:teuthology.orchestra.run.smithi177.stdout:1052 write 0xb43dd80 thru 0xb44af0a (0xd18b bytes) 2019-12-16T22:45:44.117 INFO:teuthology.orchestra.run.smithi177.stdout:1347 write 0x1cf1dc0 thru 0x1cf66a1 (0x48e2 bytes) 2019-12-16T22:45:44.120 INFO:teuthology.orchestra.run.smithi177.stdout:1554 write 0xb3708cf thru 0xb378e2b (0x855d bytes) 2019-12-16T22:45:44.129 INFO:teuthology.orchestra.run.smithi177.stdout:1348 read 0x892c26 thru 0x89f1fe (0xc5d9 bytes) 2019-12-16T22:45:44.129 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.133 INFO:teuthology.orchestra.run.smithi177.stdout:1555 write 0x58afee0 thru 0x58bb7cd (0xb8ee bytes) 2019-12-16T22:45:44.146 INFO:teuthology.orchestra.run.smithi177.stdout:1556 trunc from 0xb378e2c to 0xcd8742e 2019-12-16T22:45:44.158 INFO:teuthology.orchestra.run.smithi177.stdout:1053 writesame 0xe1495d9 thru 0xe14f283 data_size 0x1(0x5cab bytes) 2019-12-16T22:45:44.161 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.161 INFO:teuthology.orchestra.run.smithi177.stdout:1056 read 0xdfdf0e4 thru 0xdfec1f9 (0xd116 bytes) 2019-12-16T22:45:44.162 INFO:teuthology.orchestra.run.smithi177.stdout:1058 read 0x6ade17d thru 0x6ae1078 (0x2efc bytes) 2019-12-16T22:45:44.162 INFO:teuthology.orchestra.run.smithi177.stdout:1059 read 0x40fdf3b thru 0x410b9fc (0xdac2 bytes) 2019-12-16T22:45:44.165 INFO:teuthology.orchestra.run.smithi177.stdout:1350 write 0xa34cbb0 thru 0xa35697a (0x9dcb bytes) 2019-12-16T22:45:44.172 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone8 from 0x97e66af (overlap 0x97e66af) to 0x1e61489 2019-12-16T22:45:44.172 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone11 from 0xd22b329 (overlap 0xe3ba7) to 0x44518 2019-12-16T22:45:44.173 INFO:teuthology.orchestra.run.smithi177.stdout:1060 trunc from 0xe14f284 to 0x84ea2f4 2019-12-16T22:45:44.175 INFO:teuthology.orchestra.run.smithi177.stdout:1557 punch from 0x12eb5ae to 0x12efe84, (0x48d6 bytes) 2019-12-16T22:45:44.175 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.175 INFO:teuthology.orchestra.run.smithi177.stdout:1559 read 0x938336c thru 0x938cf7c (0x9c11 bytes) 2019-12-16T22:45:44.176 INFO:teuthology.orchestra.run.smithi177.stdout:1560 write 0x1efe6b7 thru 0x1f09732 (0xb07c bytes) 2019-12-16T22:45:44.176 INFO:teuthology.orchestra.run.smithi177.stdout:1352 write 0x2a9b56a thru 0x2aa576a (0xa201 bytes) 2019-12-16T22:45:44.187 INFO:teuthology.orchestra.run.smithi177.stdout:1562 punch from 0x6b711c9 to 0x6b78774, (0x75ab bytes) 2019-12-16T22:45:44.187 INFO:teuthology.orchestra.run.smithi177.stdout:1563 punch from 0xab02dad to 0xab076b7, (0x490a bytes) 2019-12-16T22:45:44.187 INFO:teuthology.orchestra.run.smithi177.stdout:1564 read 0xb842788 thru 0xb84623e (0x3ab7 bytes) 2019-12-16T22:45:44.187 INFO:teuthology.orchestra.run.smithi177.stdout:1566 write 0xb57a265 thru 0xb58863a (0xe3d6 bytes) 2019-12-16T22:45:44.188 INFO:teuthology.orchestra.run.smithi177.stdout:1353 read 0x407e062 thru 0x4082991 (0x4930 bytes) 2019-12-16T22:45:44.188 INFO:teuthology.orchestra.run.smithi177.stdout:1355 read 0x64e699b thru 0x64e7719 (0xd7f bytes) 2019-12-16T22:45:44.188 INFO:teuthology.orchestra.run.smithi177.stdout:1356 write 0x8eaa800 thru 0x8eb61f5 (0xb9f6 bytes) 2019-12-16T22:45:44.204 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.204 INFO:teuthology.orchestra.run.smithi177.stdout:1358 write 0x1490d10 thru 0x149c5c9 (0xb8ba bytes) 2019-12-16T22:45:44.208 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.208 INFO:teuthology.orchestra.run.smithi177.stdout:1569 clone 13 order 25 su 262144 sc 3 2019-12-16T22:45:44.220 INFO:teuthology.orchestra.run.smithi177.stdout:1360 write 0x9bc5942 thru 0x9bd21f3 (0xc8b2 bytes) 2019-12-16T22:45:44.233 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.234 INFO:teuthology.orchestra.run.smithi177.stdout:1362 write 0x67904c1 thru 0x679526c (0x4dac bytes) 2019-12-16T22:45:44.239 INFO:teuthology.orchestra.run.smithi177.stdout:1363 trunc from 0xa35697b to 0xaaf275f 2019-12-16T22:45:44.258 INFO:teuthology.orchestra.run.smithi177.stdout:1061 trunc from 0x84ea2f4 to 0xe0e7b5 2019-12-16T22:45:44.263 INFO:teuthology.orchestra.run.smithi177.stdout:1365 write 0x75b91ef thru 0x75bab33 (0x1945 bytes) 2019-12-16T22:45:44.285 INFO:teuthology.orchestra.run.smithi177.stdout:1366 writesame 0x6eb3b35 thru 0x6ec2cc0 data_size 0x6(0xf18c bytes) 2019-12-16T22:45:44.305 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.334 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #10, image image_cluster1.client.mirror.4-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent11 2019-12-16T22:45:44.336 INFO:teuthology.orchestra.run.smithi177.stdout:1368 write 0xac6f180 thru 0xac7878a (0x960b bytes) 2019-12-16T22:45:44.343 INFO:teuthology.orchestra.run.smithi177.stdout:1369 write 0x50dd716 thru 0x50e5910 (0x81fb bytes) 2019-12-16T22:45:44.352 INFO:teuthology.orchestra.run.smithi177.stdout:1371 read 0x4ec62a1 thru 0x4ed3c10 (0xd970 bytes) 2019-12-16T22:45:44.352 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.353 INFO:teuthology.orchestra.run.smithi177.stdout:1374 clone 11 order 23 su 2097152 sc 15 2019-12-16T22:45:44.355 INFO:teuthology.orchestra.run.smithi177.stdout:1063 trunc from 0xe0e7b5 to 0x1a785d2 2019-12-16T22:45:44.358 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #9, image image_cluster1.client.mirror.3-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent10 2019-12-16T22:45:44.361 INFO:teuthology.orchestra.run.smithi177.stdout:1114 write 0x5d5dc25 thru 0x5d62b44 (0x4f20 bytes) 2019-12-16T22:45:44.373 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #7, image image_cluster1.client.mirror.1-clone7 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent8 2019-12-16T22:45:44.384 INFO:teuthology.orchestra.run.smithi177.stdout:1115 writesame 0x63c5bce thru 0x63cf092 data_size 0x5(0x94c5 bytes) 2019-12-16T22:45:44.394 INFO:teuthology.orchestra.run.smithi177.stdout:1116 read 0x464f0b3 thru 0x4654ccb (0x5c19 bytes) 2019-12-16T22:45:44.394 INFO:teuthology.orchestra.run.smithi177.stdout:1117 punch from 0xb227ddb to 0xb229181, (0x13a6 bytes) 2019-12-16T22:45:44.394 INFO:teuthology.orchestra.run.smithi177.stdout:1118 read 0xade613c thru 0xaded816 (0x76db bytes) 2019-12-16T22:45:44.397 INFO:teuthology.orchestra.run.smithi177.stdout:1119 trunc from 0xd22b329 to 0xe986a2b 2019-12-16T22:45:44.407 INFO:teuthology.orchestra.run.smithi177.stdout:1067 writesame 0xd062977 thru 0xd06d04e data_size 0x4c(0xa6d8 bytes) 2019-12-16T22:45:44.409 INFO:teuthology.orchestra.run.smithi177.stdout:1068 read 0xb2fb4a6 thru 0xb3013fc (0x5f57 bytes) 2019-12-16T22:45:44.410 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.410 INFO:teuthology.orchestra.run.smithi177.stdout:1071 read 0x2d937f1 thru 0x2d9731f (0x3b2f bytes) 2019-12-16T22:45:44.410 INFO:teuthology.orchestra.run.smithi177.stdout:1072 write 0xb9b1bd2 thru 0xb9bc2e2 (0xa711 bytes) 2019-12-16T22:45:44.437 INFO:teuthology.orchestra.run.smithi177.stdout:1074 writesame 0x49a1689 thru 0x49adaa9 data_size 0x25(0xc421 bytes) 2019-12-16T22:45:44.438 INFO:teuthology.orchestra.run.smithi177.stdout:1120 trunc from 0xe986a2b to 0x1705704 2019-12-16T22:45:44.449 INFO:teuthology.orchestra.run.smithi177.stdout:1804 write 0xc6f1e65 thru 0xc6f271a (0x8b6 bytes) 2019-12-16T22:45:44.479 INFO:teuthology.orchestra.run.smithi177.stdout:1805 write 0xac1da71 thru 0xac22115 (0x46a5 bytes) 2019-12-16T22:45:44.490 INFO:teuthology.orchestra.run.smithi177.stdout:1075 trunc from 0xd06d04f to 0x5b981d7 2019-12-16T22:45:44.499 INFO:teuthology.orchestra.run.smithi177.stdout:1806 punch from 0x73df4a to 0x74780c, (0x98c2 bytes) 2019-12-16T22:45:44.500 INFO:teuthology.orchestra.run.smithi177.stdout:1807 read 0xae3bd73 thru 0xae3f11d (0x33ab bytes) 2019-12-16T22:45:44.500 INFO:teuthology.orchestra.run.smithi177.stdout:1808 read 0x7bd32bf thru 0x7bd8e80 (0x5bc2 bytes) 2019-12-16T22:45:44.500 INFO:teuthology.orchestra.run.smithi177.stdout:1809 read 0x574a399 thru 0x5755523 (0xb18b bytes) 2019-12-16T22:45:44.511 INFO:teuthology.orchestra.run.smithi177.stdout:1122 writesame 0x484e71f thru 0x4855549 data_size 0x4f(0x6e2b bytes) 2019-12-16T22:45:44.513 INFO:teuthology.orchestra.run.smithi177.stdout:1123 read 0x28e14ae thru 0x28ed840 (0xc393 bytes) 2019-12-16T22:45:44.513 INFO:teuthology.orchestra.run.smithi177.stdout:1124 read 0x26f618e thru 0x26f8919 (0x278c bytes) 2019-12-16T22:45:44.524 INFO:teuthology.orchestra.run.smithi177.stdout:1810 write 0xd9d3582 thru 0xd9db958 (0x83d7 bytes) 2019-12-16T22:45:44.524 INFO:teuthology.orchestra.run.smithi177.stdout:1076 read 0x378a292 thru 0x3792f09 (0x8c78 bytes) 2019-12-16T22:45:44.538 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.538 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.538 INFO:teuthology.orchestra.run.smithi177.stdout:1813 write 0xd8b9463 thru 0xd8bf799 (0x6337 bytes) 2019-12-16T22:45:44.545 INFO:teuthology.orchestra.run.smithi177.stdout:1125 writesame 0x99c9e78 thru 0x99d945f data_size 0xc(0xf5e8 bytes) 2019-12-16T22:45:44.549 INFO:teuthology.orchestra.run.smithi177.stdout:1077 write 0xbda951b thru 0xbdae55b (0x5041 bytes) 2019-12-16T22:45:44.555 INFO:teuthology.orchestra.run.smithi177.stdout:1814 writesame 0xcd801c thru 0xcd8b1b data_size 0x4(0xb00 bytes) 2019-12-16T22:45:44.569 INFO:teuthology.orchestra.run.smithi177.stdout:1816 write 0x847e3ce thru 0x8480535 (0x2168 bytes) 2019-12-16T22:45:44.571 INFO:teuthology.orchestra.run.smithi177.stdout:1078 punch from 0x64a4190 to 0x64b18c7, (0xd737 bytes) 2019-12-16T22:45:44.571 INFO:teuthology.orchestra.run.smithi177.stdout:1079 read 0x69d7f51 thru 0x69d9947 (0x19f7 bytes) 2019-12-16T22:45:44.571 INFO:teuthology.orchestra.run.smithi177.stdout:1080 read 0x3b8eba7 thru 0x3b9294a (0x3da4 bytes) 2019-12-16T22:45:44.572 INFO:teuthology.orchestra.run.smithi177.stdout:1081 write 0x90d99a9 thru 0x90e7765 (0xddbd bytes) 2019-12-16T22:45:44.581 INFO:teuthology.orchestra.run.smithi177.stdout:1126 write 0xddfad8e thru 0xddff228 (0x449b bytes) 2019-12-16T22:45:44.590 INFO:teuthology.orchestra.run.smithi177.stdout:1127 read 0x8169b75 thru 0x8176015 (0xc4a1 bytes) 2019-12-16T22:45:44.607 INFO:teuthology.orchestra.run.smithi177.stdout:1817 writesame 0xf5ef95 thru 0xf693b3 data_size 0x5(0xa41f bytes) 2019-12-16T22:45:44.621 INFO:teuthology.orchestra.run.smithi177.stdout:1818 write 0x66fa157 thru 0x670a0fe (0xffa8 bytes) 2019-12-16T22:45:44.625 INFO:teuthology.orchestra.run.smithi177.stdout:1128 write 0xde14056 thru 0xde1a113 (0x60be bytes) 2019-12-16T22:45:44.628 INFO:teuthology.orchestra.run.smithi177.stdout:1082 write 0x2aea123 thru 0x2af96cb (0xf5a9 bytes) 2019-12-16T22:45:44.639 INFO:teuthology.orchestra.run.smithi177.stdout:1132 writesame 0xb4ce6cc thru 0xb4ceec2 data_size 0x1(0x7f7 bytes) 2019-12-16T22:45:44.645 INFO:teuthology.orchestra.run.smithi177.stdout:1134 read 0x16fa60c thru 0x1702330 (0x7d25 bytes) 2019-12-16T22:45:44.646 INFO:teuthology.orchestra.run.smithi177.stdout:1137 writesame 0xaaa4748 thru 0xaaa8af6 data_size 0x1(0x43af bytes) 2019-12-16T22:45:44.650 INFO:teuthology.orchestra.run.smithi177.stdout:1820 trunc from 0xd9db959 to 0xe4c12da 2019-12-16T22:45:44.668 INFO:teuthology.orchestra.run.smithi177.stdout:1138 punch from 0x879bec4 to 0x879fa7b, (0x3bb7 bytes) 2019-12-16T22:45:44.679 INFO:teuthology.orchestra.run.smithi177.stdout:1139 trunc from 0xde1a114 to 0x791efec 2019-12-16T22:45:44.683 INFO:teuthology.orchestra.run.smithi177.stdout:1083 trunc from 0xbdae55c to 0x5bf13df 2019-12-16T22:45:44.683 INFO:teuthology.orchestra.run.smithi177.stdout:1821 read 0xbecab03 thru 0xbeccd3b (0x2239 bytes) 2019-12-16T22:45:44.684 INFO:teuthology.orchestra.run.smithi177.stdout:1823 read 0x5ef9d12 thru 0x5f031a4 (0x9493 bytes) 2019-12-16T22:45:44.685 INFO:teuthology.orchestra.run.smithi177.stdout:1824 read 0x3d29df6 thru 0x3d34328 (0xa533 bytes) 2019-12-16T22:45:44.687 INFO:teuthology.orchestra.run.smithi177.stdout:1825 trunc from 0xe4c12da to 0xe746c7e 2019-12-16T22:45:44.720 INFO:teuthology.orchestra.run.smithi177.stdout:1826 write 0x6be92b6 thru 0x6beca22 (0x376d bytes) 2019-12-16T22:45:44.726 INFO:teuthology.orchestra.run.smithi177.stdout:1828 read 0x4935a20 thru 0x493c352 (0x6933 bytes) 2019-12-16T22:45:44.726 INFO:teuthology.orchestra.run.smithi177.stdout:1140 punch from 0x48211fe to 0x4827539, (0x633b bytes) 2019-12-16T22:45:44.732 INFO:teuthology.orchestra.run.smithi177.stdout:1829 write 0x5e086f6 thru 0x5e15ac3 (0xd3ce bytes) 2019-12-16T22:45:44.732 INFO:teuthology.orchestra.run.smithi177.stdout:1085 writesame 0x596c229 thru 0x5970cb4 data_size 0x1a(0x4a8c bytes) 2019-12-16T22:45:44.733 INFO:teuthology.orchestra.run.smithi177.stdout:1141 read 0x6012bbe thru 0x6017a21 (0x4e64 bytes) 2019-12-16T22:45:44.734 INFO:teuthology.orchestra.run.smithi177.stdout:1833 read 0x2b6f2e thru 0x2c0891 (0x9964 bytes) 2019-12-16T22:45:44.735 INFO:teuthology.orchestra.run.smithi177.stdout:1834 write 0xcfe2531 thru 0xcfefcd6 (0xd7a6 bytes) 2019-12-16T22:45:44.756 INFO:teuthology.orchestra.run.smithi177.stdout:1142 write 0xdc258bc thru 0xdc30eff (0xb644 bytes) 2019-12-16T22:45:44.760 INFO:teuthology.orchestra.run.smithi177.stdout:1835 trunc from 0xe746c7e to 0x52b5dc8 2019-12-16T22:45:44.765 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.765 INFO:teuthology.orchestra.run.smithi177.stdout:1145 write 0xcaa776f thru 0xcaacae0 (0x5372 bytes) 2019-12-16T22:45:44.805 INFO:teuthology.orchestra.run.smithi177.stdout:1087 write 0xa9d78e4 thru 0xa9e7744 (0xfe61 bytes) 2019-12-16T22:45:44.806 INFO:teuthology.orchestra.run.smithi177.stdout:1343 trunc from 0xe028932 to 0x420d49c 2019-12-16T22:45:44.813 INFO:teuthology.orchestra.run.smithi177.stdout:1146 trunc from 0xdc30f00 to 0x475a943 2019-12-16T22:45:44.870 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.870 INFO:teuthology.orchestra.run.smithi177.stdout:1837 read 0xa997cf thru 0xa9b56f (0x1da1 bytes) 2019-12-16T22:45:44.873 INFO:teuthology.orchestra.run.smithi177.stdout:1147 write 0x1efc88b thru 0x1efcfed (0x763 bytes) 2019-12-16T22:45:44.887 INFO:teuthology.orchestra.run.smithi177.stdout:1148 trunc from 0x475a943 to 0x20e1baf 2019-12-16T22:45:44.890 INFO:teuthology.orchestra.run.smithi177.stdout:1838 write 0x55a4a9e thru 0x55b2154 (0xd6b7 bytes) 2019-12-16T22:45:44.894 INFO:teuthology.orchestra.run.smithi177.stdout:1089 write 0xc667f40 thru 0xc66e725 (0x67e6 bytes) 2019-12-16T22:45:44.897 INFO:teuthology.orchestra.run.smithi177.stdout:1344 read 0x2c9fa26 thru 0x2c9fb3e (0x119 bytes) 2019-12-16T22:45:44.897 INFO:teuthology.orchestra.run.smithi177.stdout:1345 read 0x28f4d9f thru 0x28f6998 (0x1bfa bytes) 2019-12-16T22:45:44.898 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:44.899 INFO:teuthology.orchestra.run.smithi177.stdout:1348 writesame 0x7fbdb9 thru 0x7fe5f7 data_size 0x1(0x283f bytes) 2019-12-16T22:45:44.911 INFO:teuthology.orchestra.run.smithi177.stdout:1149 read 0xb05145 thru 0xb125af (0xd46b bytes) 2019-12-16T22:45:44.936 INFO:teuthology.orchestra.run.smithi177.stdout:1840 write 0x8d5e7c2 thru 0x8d60f38 (0x2777 bytes) 2019-12-16T22:45:44.941 INFO:teuthology.orchestra.run.smithi177.stdout:1153 writesame 0x72b0c0a thru 0x72b5359 data_size 0x38(0x4750 bytes) 2019-12-16T22:45:44.941 INFO:teuthology.orchestra.run.smithi177.stdout:1090 trunc from 0xc66e726 to 0x56f179f 2019-12-16T22:45:44.942 INFO:teuthology.orchestra.run.smithi177.stdout:1349 read 0x265e039 thru 0x266a4e7 (0xc4af bytes) 2019-12-16T22:45:44.943 INFO:teuthology.orchestra.run.smithi177.stdout:1350 write 0x2451a66 thru 0x245ddc9 (0xc364 bytes) 2019-12-16T22:45:44.993 INFO:teuthology.orchestra.run.smithi177.stdout:1843 write 0xa5a1a6c thru 0xa5a38ed (0x1e82 bytes) 2019-12-16T22:45:44.993 INFO:teuthology.orchestra.run.smithi177.stdout:1351 writesame 0x1edf611 thru 0x1ee3f68 data_size 0x4(0x4958 bytes) 2019-12-16T22:45:45.001 INFO:teuthology.orchestra.run.smithi177.stdout:1091 punch from 0x1d83d0d to 0x1d93307, (0xf5fa bytes) 2019-12-16T22:45:45.001 INFO:teuthology.orchestra.run.smithi177.stdout:1093 read 0x439e39d thru 0x439f102 (0xd66 bytes) 2019-12-16T22:45:45.001 INFO:teuthology.orchestra.run.smithi177.stdout:1095 trunc from 0x56f179f to 0x486805f 2019-12-16T22:45:45.002 INFO:teuthology.orchestra.run.smithi177.stdout:1154 write 0x8740cd9 thru 0x874369f (0x29c7 bytes) 2019-12-16T22:45:45.002 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.008 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.008 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.014 INFO:teuthology.orchestra.run.smithi177.stdout:1848 trunc from 0xa5a38ee to 0x259f5a2 2019-12-16T22:45:45.019 INFO:teuthology.orchestra.run.smithi177.stdout:1354 punch from 0x1fa696a to 0x1fa9496, (0x2b2c bytes) 2019-12-16T22:45:45.019 INFO:teuthology.orchestra.run.smithi177.stdout:1355 read 0x865b37 thru 0x86f072 (0x953c bytes) 2019-12-16T22:45:45.020 INFO:teuthology.orchestra.run.smithi177.stdout:1356 write 0x3165f8 thru 0x3169ae (0x3b7 bytes) 2019-12-16T22:45:45.032 INFO:teuthology.orchestra.run.smithi177.stdout:1096 punch from 0x3c9958e to 0x3ca5937, (0xc3a9 bytes) 2019-12-16T22:45:45.034 INFO:teuthology.orchestra.run.smithi177.stdout:1098 trunc from 0x486805f to 0x3265727 2019-12-16T22:45:45.040 INFO:teuthology.orchestra.run.smithi177.stdout:1157 writesame 0x89c439a thru 0x89cbdb0 data_size 0x5f(0x7a17 bytes) 2019-12-16T22:45:45.044 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.044 INFO:teuthology.orchestra.run.smithi177.stdout:1159 writesame 0x2a86dd7 thru 0x2a94fb4 data_size 0x45(0xe1de bytes) 2019-12-16T22:45:45.050 INFO:teuthology.orchestra.run.smithi177.stdout:1357 read 0x163a3f3 thru 0x163abcf (0x7dd bytes) 2019-12-16T22:45:45.056 INFO:teuthology.orchestra.run.smithi177.stdout:1160 read 0x5ae803e thru 0x5aec7a4 (0x4767 bytes) 2019-12-16T22:45:45.058 INFO:teuthology.orchestra.run.smithi177.stdout:1162 read 0x6a69755 thru 0x6a6fc30 (0x64dc bytes) 2019-12-16T22:45:45.058 INFO:teuthology.orchestra.run.smithi177.stdout:1163 write 0x580d1ed thru 0x580fb11 (0x2925 bytes) 2019-12-16T22:45:45.065 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.065 INFO:teuthology.orchestra.run.smithi177.stdout:1166 read 0x6b49446 thru 0x6b55d3e (0xc8f9 bytes) 2019-12-16T22:45:45.065 INFO:teuthology.orchestra.run.smithi177.stdout:1167 writesame 0x81bcd0a thru 0x81beaa2 data_size 0x1(0x1d99 bytes) 2019-12-16T22:45:45.077 INFO:teuthology.orchestra.run.smithi177.stdout:1168 read 0x459436a thru 0x45a35a1 (0xf238 bytes) 2019-12-16T22:45:45.077 INFO:teuthology.orchestra.run.smithi177.stdout:1169 read 0x499a18d thru 0x499de61 (0x3cd5 bytes) 2019-12-16T22:45:45.077 INFO:teuthology.orchestra.run.smithi177.stdout:1170 writesame 0x31da8e4 thru 0x31e1c08 data_size 0x1(0x7325 bytes) 2019-12-16T22:45:45.090 INFO:teuthology.orchestra.run.smithi177.stdout:1849 write 0x7a370f1 thru 0x7a3b99d (0x48ad bytes) 2019-12-16T22:45:45.094 INFO:teuthology.orchestra.run.smithi177.stdout:1359 write 0xe5c3205 thru 0xe5ced4b (0xbb47 bytes) 2019-12-16T22:45:45.102 INFO:teuthology.orchestra.run.smithi177.stdout:1099 write 0x6b483d1 thru 0x6b558d3 (0xd503 bytes) 2019-12-16T22:45:45.121 INFO:teuthology.orchestra.run.smithi177.stdout:1360 trunc from 0xe5ced4c to 0xbd7db60 2019-12-16T22:45:45.124 INFO:teuthology.orchestra.run.smithi177.stdout:1171 trunc from 0x89cbdb1 to 0xbc46ad 2019-12-16T22:45:45.137 INFO:teuthology.orchestra.run.smithi177.stdout:1850 write 0xb3371d2 thru 0xb34139a (0xa1c9 bytes) 2019-12-16T22:45:45.150 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone10 from 0xac7878b (overlap 0xdddee0) to 0x9b4f36 2019-12-16T22:45:45.151 INFO:teuthology.orchestra.run.smithi177.stdout:1851 write 0x6b18647 thru 0x6b1cf4b (0x4905 bytes) 2019-12-16T22:45:45.158 INFO:teuthology.orchestra.run.smithi177.stdout:1852 punch from 0x753f694 to 0x7546a8a, (0x73f6 bytes) 2019-12-16T22:45:45.158 INFO:teuthology.orchestra.run.smithi177.stdout:1854 write 0x2025a5e thru 0x2029f18 (0x44bb bytes) 2019-12-16T22:45:45.164 INFO:teuthology.orchestra.run.smithi177.stdout:1361 write 0x2fc5982 thru 0x2fc9c1a (0x4299 bytes) 2019-12-16T22:45:45.168 INFO:teuthology.orchestra.run.smithi177.stdout:1855 read 0xe4ad08 thru 0xe5a6c5 (0xf9be bytes) 2019-12-16T22:45:45.169 INFO:teuthology.orchestra.run.smithi177.stdout:1856 read 0xd57d08 thru 0xd61a90 (0x9d89 bytes) 2019-12-16T22:45:45.170 INFO:teuthology.orchestra.run.smithi177.stdout:1858 read 0x3f94fc1 thru 0x3fa0424 (0xb464 bytes) 2019-12-16T22:45:45.183 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.188 INFO:teuthology.orchestra.run.smithi177.stdout:1100 writesame 0x8a660f2 thru 0x8a663c0 data_size 0x1(0x2cf bytes) 2019-12-16T22:45:45.195 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.195 INFO:teuthology.orchestra.run.smithi177.stdout:1173 read 0xa40f30 thru 0xa428cf (0x19a0 bytes) 2019-12-16T22:45:45.200 INFO:teuthology.orchestra.run.smithi177.stdout:1859 writesame 0xc4713b7 thru 0xc47306d data_size 0x1(0x1cb7 bytes) 2019-12-16T22:45:45.205 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.205 INFO:teuthology.orchestra.run.smithi177.stdout:1864 punch from 0x4c66099 to 0x4c75cad, (0xfc14 bytes) 2019-12-16T22:45:45.212 INFO:teuthology.orchestra.run.smithi177.stdout:1363 write 0xd934114 thru 0xd93831b (0x4208 bytes) 2019-12-16T22:45:45.216 INFO:teuthology.orchestra.run.smithi177.stdout:1175 write 0x1b64ee3 thru 0x1b6dfba (0x90d8 bytes) 2019-12-16T22:45:45.221 INFO:teuthology.orchestra.run.smithi177.stdout:1865 trunc from 0xc47306e to 0x3a518a3 2019-12-16T22:45:45.224 INFO:teuthology.orchestra.run.smithi177.stdout:1103 write 0xd139851 thru 0xd13b5e8 (0x1d98 bytes) 2019-12-16T22:45:45.227 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.227 INFO:teuthology.orchestra.run.smithi177.stdout:1364 write 0x4f4364f thru 0x4f4fa5c (0xc40e bytes) 2019-12-16T22:45:45.228 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone12 from 0xcd8742e (overlap 0x1aad4f3) to 0x1557728 2019-12-16T22:45:45.252 INFO:teuthology.orchestra.run.smithi177.stdout:1104 read 0x6e2d8c4 thru 0x6e371f4 (0x9931 bytes) 2019-12-16T22:45:45.253 INFO:teuthology.orchestra.run.smithi177.stdout:1105 read 0x4f0ca4f thru 0x4f17266 (0xa818 bytes) 2019-12-16T22:45:45.253 INFO:teuthology.orchestra.run.smithi177.stdout:1106 write 0xa665889 thru 0xa673db8 (0xe530 bytes) 2019-12-16T22:45:45.259 INFO:teuthology.orchestra.run.smithi177.stdout:1177 write 0x1bca2ce thru 0x1bd5b3d (0xb870 bytes) 2019-12-16T22:45:45.265 INFO:teuthology.orchestra.run.smithi177.stdout:1365 punch from 0x773afd to 0x77e610, (0xab13 bytes) 2019-12-16T22:45:45.265 INFO:teuthology.orchestra.run.smithi177.stdout:1366 writesame 0x5b1c734 thru 0x5b27b38 data_size 0xd(0xb405 bytes) 2019-12-16T22:45:45.266 INFO:teuthology.orchestra.run.smithi177.stdout:1866 read 0xcfeaeb thru 0xd08ac7 (0x9fdd bytes) 2019-12-16T22:45:45.273 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.287 INFO:teuthology.orchestra.run.smithi177.stdout:1367 read 0xbe2dcff thru 0xbe30a15 (0x2d17 bytes) 2019-12-16T22:45:45.287 INFO:teuthology.orchestra.run.smithi177.stdout:1369 read 0x16700b1 thru 0x16704c9 (0x419 bytes) 2019-12-16T22:45:45.288 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.288 INFO:teuthology.orchestra.run.smithi177.stdout:1373 write 0x7bfe3d7 thru 0x7c02a53 (0x467d bytes) 2019-12-16T22:45:45.292 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #9, image image_cluster1.client.mirror.5-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent10 2019-12-16T22:45:45.304 INFO:teuthology.orchestra.run.smithi177.stdout:1374 write 0xd708eeb thru 0xd715128 (0xc23e bytes) 2019-12-16T22:45:45.315 INFO:teuthology.orchestra.run.smithi177.stdout:1867 writesame 0xddac523 thru 0xddac86d data_size 0x1(0x34b bytes) 2019-12-16T22:45:45.316 INFO:teuthology.orchestra.run.smithi177.stdout:1108 write 0x44fed60 thru 0x4506649 (0x78ea bytes) 2019-12-16T22:45:45.320 INFO:teuthology.orchestra.run.smithi177.stdout:1180 write 0x5791ada thru 0x57923fb (0x922 bytes) 2019-12-16T22:45:45.322 INFO:teuthology.orchestra.run.smithi177.stdout:1868 writesame 0x8bf0941 thru 0x8bff575 data_size 0x1(0xec35 bytes) 2019-12-16T22:45:45.327 INFO:teuthology.orchestra.run.smithi177.stdout:1375 write 0x88e9576 thru 0x88eb89e (0x2329 bytes) 2019-12-16T22:45:45.366 INFO:teuthology.orchestra.run.smithi177.stdout:1376 trunc from 0xd93831c to 0x2311cf 2019-12-16T22:45:45.380 INFO:teuthology.orchestra.run.smithi177.stdout:1110 writesame 0x8d46b8b thru 0x8d4857d data_size 0xd(0x19f3 bytes) 2019-12-16T22:45:45.388 INFO:teuthology.orchestra.run.smithi177.stdout:1869 trunc from 0xddac86e to 0x70c96ca 2019-12-16T22:45:45.399 INFO:teuthology.orchestra.run.smithi177.stdout:1111 read 0x8b92c32 thru 0x8b9ebd8 (0xbfa7 bytes) 2019-12-16T22:45:45.399 INFO:teuthology.orchestra.run.smithi177.stdout:1112 writesame 0x460f832 thru 0x461c1c9 data_size 0x4(0xc998 bytes) 2019-12-16T22:45:45.415 INFO:teuthology.orchestra.run.smithi177.stdout:1181 write 0x994b2fc thru 0x9950ccc (0x59d1 bytes) 2019-12-16T22:45:45.430 INFO:teuthology.orchestra.run.smithi177.stdout:1115 write 0x553498e thru 0x5534ea9 (0x51c bytes) 2019-12-16T22:45:45.431 INFO:teuthology.orchestra.run.smithi177.stdout:1182 read 0x6af9c0e thru 0x6b0750d (0xd900 bytes) 2019-12-16T22:45:45.432 INFO:teuthology.orchestra.run.smithi177.stdout:1183 read 0x64a0838 thru 0x64a7f0e (0x76d7 bytes) 2019-12-16T22:45:45.432 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.432 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.437 INFO:teuthology.orchestra.run.smithi177.stdout:1188 trunc from 0x9950ccd to 0xd54dc5b 2019-12-16T22:45:45.438 INFO:teuthology.orchestra.run.smithi177.stdout:1870 read 0x6a2d988 thru 0x6a3a188 (0xc801 bytes) 2019-12-16T22:45:45.456 INFO:teuthology.orchestra.run.smithi177.stdout:1118 punch from 0xbe58659 to 0xbe5a4ed, (0x1e94 bytes) 2019-12-16T22:45:45.456 INFO:teuthology.orchestra.run.smithi177.stdout:1119 read 0x7cdc3e3 thru 0x7ce296f (0x658d bytes) 2019-12-16T22:45:45.456 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.456 INFO:teuthology.orchestra.run.smithi177.stdout:1123 write 0x2daa28d thru 0x2daba04 (0x1778 bytes) 2019-12-16T22:45:45.464 INFO:teuthology.orchestra.run.smithi177.stdout:1124 read 0xc5b0bb6 thru 0xc5bc7c0 (0xbc0b bytes) 2019-12-16T22:45:45.464 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.465 INFO:teuthology.orchestra.run.smithi177.stdout:1127 read 0x7944167 thru 0x7944d80 (0xc1a bytes) 2019-12-16T22:45:45.465 INFO:teuthology.orchestra.run.smithi177.stdout:1128 write 0xa5c7d01 thru 0xa5ca15b (0x245b bytes) 2019-12-16T22:45:45.467 INFO:teuthology.orchestra.run.smithi177.stdout:1189 punch from 0x5c0e761 to 0x5c14d73, (0x6612 bytes) 2019-12-16T22:45:45.467 INFO:teuthology.orchestra.run.smithi177.stdout:1190 write 0x923d455 thru 0x92412b5 (0x3e61 bytes) 2019-12-16T22:45:45.473 INFO:teuthology.orchestra.run.smithi177.stdout:1129 read 0xb83bad9 thru 0xb83fd86 (0x42ae bytes) 2019-12-16T22:45:45.473 INFO:teuthology.orchestra.run.smithi177.stdout:1130 write 0xb2fd36c thru 0xb3058f2 (0x8587 bytes) 2019-12-16T22:45:45.478 INFO:teuthology.orchestra.run.smithi177.stdout:1192 write 0x4595441 thru 0x459f1b5 (0x9d75 bytes) 2019-12-16T22:45:45.493 INFO:teuthology.orchestra.run.smithi177.stdout:1871 write 0xc2c1616 thru 0xc2cced1 (0xb8bc bytes) 2019-12-16T22:45:45.500 INFO:teuthology.orchestra.run.smithi177.stdout:1193 trunc from 0xd54dc5b to 0x821645c 2019-12-16T22:45:45.501 INFO:teuthology.orchestra.run.smithi177.stdout:1872 writesame 0x3465d48 thru 0x34687f1 data_size 0x2b(0x2aaa bytes) 2019-12-16T22:45:45.511 INFO:teuthology.orchestra.run.smithi177.stdout:1873 writesame 0x97670de thru 0x9770d66 data_size 0x1(0x9c89 bytes) 2019-12-16T22:45:45.556 INFO:teuthology.orchestra.run.smithi177.stdout:1874 read 0x67ffe18 thru 0x68091d4 (0x93bd bytes) 2019-12-16T22:45:45.556 INFO:teuthology.orchestra.run.smithi177.stdout:1875 writesame 0xb82ad33 thru 0xb835d45 data_size 0x19(0xb013 bytes) 2019-12-16T22:45:45.557 INFO:teuthology.orchestra.run.smithi177.stdout:1876 write 0x24dec99 thru 0x24e5451 (0x67b9 bytes) 2019-12-16T22:45:45.566 INFO:teuthology.orchestra.run.smithi177.stdout:1877 read 0xbf6ad38 thru 0xbf6bb69 (0xe32 bytes) 2019-12-16T22:45:45.573 INFO:teuthology.orchestra.run.smithi177.stdout:1377 read 0xedda2 thru 0xf8efd (0xb15c bytes) 2019-12-16T22:45:45.574 INFO:teuthology.orchestra.run.smithi177.stdout:1879 trunc from 0xc2cced2 to 0x7d38763 2019-12-16T22:45:45.582 INFO:teuthology.orchestra.run.smithi177.stdout:1195 writesame 0xba1a62d thru 0xba1ffbf data_size 0x1(0x5993 bytes) 2019-12-16T22:45:45.583 INFO:teuthology.orchestra.run.smithi177.stdout:1131 write 0xe148734 thru 0xe1519a8 (0x9275 bytes) 2019-12-16T22:45:45.586 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #11, image image_cluster1.client.mirror.0-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent12 2019-12-16T22:45:45.588 INFO:teuthology.orchestra.run.smithi177.stdout:1197 read 0x7aab7e4 thru 0x7ab570d (0x9f2a bytes) 2019-12-16T22:45:45.588 INFO:teuthology.orchestra.run.smithi177.stdout:1198 punch from 0x3c45de6 to 0x3c541b2, (0xe3cc bytes) 2019-12-16T22:45:45.588 INFO:teuthology.orchestra.run.smithi177.stdout:1200 read 0xa9f2ae9 thru 0xa9f3653 (0xb6b bytes) 2019-12-16T22:45:45.588 INFO:teuthology.orchestra.run.smithi177.stdout:1201 punch from 0xa085a35 to 0xa094d78, (0xf343 bytes) 2019-12-16T22:45:45.588 INFO:teuthology.orchestra.run.smithi177.stdout:1202 read 0x240cf78 thru 0x2410ac5 (0x3b4e bytes) 2019-12-16T22:45:45.589 INFO:teuthology.orchestra.run.smithi177.stdout:1203 read 0x30cb58 thru 0x313723 (0x6bcc bytes) 2019-12-16T22:45:45.589 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.589 INFO:teuthology.orchestra.run.smithi177.stdout:1205 read 0x2a176ad thru 0x2a1ebd7 (0x752b bytes) 2019-12-16T22:45:45.592 INFO:teuthology.orchestra.run.smithi177.stdout:1208 trunc from 0xba1ffc0 to 0xa799467 2019-12-16T22:45:45.594 INFO:teuthology.orchestra.run.smithi177.stdout:1379 trunc from 0x2311cf to 0xbce1b7c 2019-12-16T22:45:45.600 INFO:teuthology.orchestra.run.smithi177.stdout:1881 read 0x3db4794 thru 0x3dbb82e (0x709b bytes) 2019-12-16T22:45:45.601 INFO:teuthology.orchestra.run.smithi177.stdout:1884 write 0x59adbc thru 0x5a1ce2 (0x6f27 bytes) 2019-12-16T22:45:45.609 INFO:teuthology.orchestra.run.smithi177.stdout:1380 read 0x88f8c88 thru 0x8904170 (0xb4e9 bytes) 2019-12-16T22:45:45.610 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.611 INFO:teuthology.orchestra.run.smithi177.stdout:1886 write 0x68b6ca1 thru 0x68c106f (0xa3cf bytes) 2019-12-16T22:45:45.611 INFO:teuthology.orchestra.run.smithi177.stdout:1381 trunc from 0xbce1b7c to 0xaafe3d5 2019-12-16T22:45:45.619 INFO:teuthology.orchestra.run.smithi177.stdout:1209 punch from 0x748a095 to 0x748d315, (0x3280 bytes) 2019-12-16T22:45:45.619 INFO:teuthology.orchestra.run.smithi177.stdout:1211 write 0x19df726 thru 0x19e84ed (0x8dc8 bytes) 2019-12-16T22:45:45.628 INFO:teuthology.orchestra.run.smithi177.stdout:1213 writesame 0x6844b54 thru 0x684f825 data_size 0xb(0xacd2 bytes) 2019-12-16T22:45:45.631 INFO:teuthology.orchestra.run.smithi177.stdout:1382 read 0x7fd7df thru 0x8056d9 (0x7efb bytes) 2019-12-16T22:45:45.631 INFO:teuthology.orchestra.run.smithi177.stdout:1383 punch from 0x9f80900 to 0x9f8ef63, (0xe663 bytes) 2019-12-16T22:45:45.635 INFO:teuthology.orchestra.run.smithi177.stdout:1215 read 0x80fdd75 thru 0x810bfcf (0xe25b bytes) 2019-12-16T22:45:45.637 INFO:teuthology.orchestra.run.smithi177.stdout:1216 trunc from 0xa799467 to 0x9bb9fef 2019-12-16T22:45:45.647 INFO:teuthology.orchestra.run.smithi177.stdout:1887 write 0xc0cbdae thru 0xc0d2c4a (0x6e9d bytes) 2019-12-16T22:45:45.652 INFO:teuthology.orchestra.run.smithi177.stdout:1132 trunc from 0xe1519a9 to 0x3cccc5 2019-12-16T22:45:45.655 INFO:teuthology.orchestra.run.smithi177.stdout:1888 read 0x1d5ec54 thru 0x1d6b778 (0xcb25 bytes) 2019-12-16T22:45:45.656 INFO:teuthology.orchestra.run.smithi177.stdout:1219 write 0x89208bb thru 0x892ee96 (0xe5dc bytes) 2019-12-16T22:45:45.656 INFO:teuthology.orchestra.run.smithi177.stdout:1890 punch from 0x22953fd to 0x229863b, (0x323e bytes) 2019-12-16T22:45:45.667 INFO:teuthology.orchestra.run.smithi177.stdout:1891 trunc from 0xc0d2c4b to 0x559dcfa 2019-12-16T22:45:45.685 INFO:teuthology.orchestra.run.smithi177.stdout:1375 trunc from 0xac7878b to 0xa038ba7 2019-12-16T22:45:45.717 INFO:teuthology.orchestra.run.smithi177.stdout:1220 writesame 0xcad87e8 thru 0xcae116b data_size 0x1a(0x8984 bytes) 2019-12-16T22:45:45.736 INFO:teuthology.orchestra.run.smithi177.stdout:1221 trunc from 0xcae116c to 0x5163bbc 2019-12-16T22:45:45.754 INFO:teuthology.orchestra.run.smithi177.stdout:1893 writesame 0x8678b1e thru 0x868046d data_size 0x18(0x7950 bytes) 2019-12-16T22:45:45.765 INFO:teuthology.orchestra.run.smithi177.stdout:1895 punch from 0x11ec2b to 0x12b58d, (0xc962 bytes) 2019-12-16T22:45:45.765 INFO:teuthology.orchestra.run.smithi177.stdout:1896 writesame 0x73a60ab thru 0x73af579 data_size 0x13(0x94cf bytes) 2019-12-16T22:45:45.773 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.773 INFO:teuthology.orchestra.run.smithi177.stdout:1380 read 0x5cd8c18 thru 0x5cdf77c (0x6b65 bytes) 2019-12-16T22:45:45.774 INFO:teuthology.orchestra.run.smithi177.stdout:1383 punch from 0x137e04c to 0x1385e45, (0x7df9 bytes) 2019-12-16T22:45:45.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.776 INFO:teuthology.orchestra.run.smithi177.stdout:1224 read 0x85da80 thru 0x867553 (0x9ad4 bytes) 2019-12-16T22:45:45.777 INFO:teuthology.orchestra.run.smithi177.stdout:1384 trunc from 0xa038ba7 to 0x8c88f74 2019-12-16T22:45:45.777 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.777 INFO:teuthology.orchestra.run.smithi177.stdout:1229 read 0x295dd36 thru 0x2961325 (0x35f0 bytes) 2019-12-16T22:45:45.777 INFO:teuthology.orchestra.run.smithi177.stdout:1233 punch from 0x12ef958 to 0x12f7e9d, (0x8545 bytes) 2019-12-16T22:45:45.799 INFO:teuthology.orchestra.run.smithi177.stdout:1897 write 0x9d592c5 thru 0x9d63c8d (0xa9c9 bytes) 2019-12-16T22:45:45.801 INFO:teuthology.orchestra.run.smithi177.stdout:1898 write 0x19263b thru 0x1a1eca (0xf890 bytes) 2019-12-16T22:45:45.801 INFO:teuthology.orchestra.run.smithi177.stdout:1234 writesame 0x66efd5c thru 0x66fd8b0 data_size 0x1(0xdb55 bytes) 2019-12-16T22:45:45.809 INFO:teuthology.orchestra.run.smithi177.stdout:1900 read 0x77c551a thru 0x77c84fb (0x2fe2 bytes) 2019-12-16T22:45:45.810 INFO:teuthology.orchestra.run.smithi177.stdout:1235 trunc from 0x66fd8b1 to 0x424dba5 2019-12-16T22:45:45.822 INFO:teuthology.orchestra.run.smithi177.stdout:1133 write 0xcc44074 thru 0xcc50eb9 (0xce46 bytes) 2019-12-16T22:45:45.845 INFO:teuthology.orchestra.run.smithi177.stdout:1901 write 0xde71d0d thru 0xde7a258 (0x854c bytes) 2019-12-16T22:45:45.846 INFO:teuthology.orchestra.run.smithi177.stdout:1386 write 0xc84505b thru 0xc851fa1 (0xcf47 bytes) 2019-12-16T22:45:45.853 INFO:teuthology.orchestra.run.smithi177.stdout:1387 punch from 0xa6a473f to 0xa6aa917, (0x61d8 bytes) 2019-12-16T22:45:45.853 INFO:teuthology.orchestra.run.smithi177.stdout:1388 read 0xc26354e thru 0xc26af92 (0x7a45 bytes) 2019-12-16T22:45:45.854 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.854 INFO:teuthology.orchestra.run.smithi177.stdout:1390 write 0x8ddb635 thru 0x8ddf8d4 (0x42a0 bytes) 2019-12-16T22:45:45.856 INFO:teuthology.orchestra.run.smithi177.stdout:1902 write 0x37566f8 thru 0x3764c52 (0xe55b bytes) 2019-12-16T22:45:45.861 INFO:teuthology.orchestra.run.smithi177.stdout:1391 read 0xb8bfc1c thru 0xb8c5b88 (0x5f6d bytes) 2019-12-16T22:45:45.862 INFO:teuthology.orchestra.run.smithi177.stdout:1392 writesame 0x893c31f thru 0x8942ca9 data_size 0x1(0x698b bytes) 2019-12-16T22:45:45.863 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.863 INFO:teuthology.orchestra.run.smithi177.stdout:1135 read 0xad85ce4 thru 0xad86306 (0x623 bytes) 2019-12-16T22:45:45.864 INFO:teuthology.orchestra.run.smithi177.stdout:1903 punch from 0xd5ed9d1 to 0xd5f396f, (0x5f9e bytes) 2019-12-16T22:45:45.864 INFO:teuthology.orchestra.run.smithi177.stdout:1906 punch from 0x41cd443 to 0x41db8f0, (0xe4ad bytes) 2019-12-16T22:45:45.865 INFO:teuthology.orchestra.run.smithi177.stdout:1908 punch from 0xcd7290c to 0xcd7bce8, (0x93dc bytes) 2019-12-16T22:45:45.865 INFO:teuthology.orchestra.run.smithi177.stdout:1909 write 0xb069138 thru 0xb06d347 (0x4210 bytes) 2019-12-16T22:45:45.865 INFO:teuthology.orchestra.run.smithi177.stdout:1137 write 0x24f1555 thru 0x25007a9 (0xf255 bytes) 2019-12-16T22:45:45.880 INFO:teuthology.orchestra.run.smithi177.stdout:1910 write 0x3153ef0 thru 0x3159b46 (0x5c57 bytes) 2019-12-16T22:45:45.881 INFO:teuthology.orchestra.run.smithi177.stdout:1236 writesame 0xb7b9b0b thru 0xb7bd1bd data_size 0x13(0x36b3 bytes) 2019-12-16T22:45:45.884 INFO:teuthology.orchestra.run.smithi177.stdout:1393 read 0x92a785 thru 0x9303f6 (0x5c72 bytes) 2019-12-16T22:45:45.885 INFO:teuthology.orchestra.run.smithi177.stdout:1237 read 0x9ec40ce thru 0x9ec8a26 (0x4959 bytes) 2019-12-16T22:45:45.886 INFO:teuthology.orchestra.run.smithi177.stdout:1238 write 0xa666a92 thru 0xa670089 (0x95f8 bytes) 2019-12-16T22:45:45.886 INFO:teuthology.orchestra.run.smithi177.stdout:1394 writesame 0x8bf7f86 thru 0x8bfb8a4 data_size 0x1(0x391f bytes) 2019-12-16T22:45:45.889 INFO:teuthology.orchestra.run.smithi177.stdout:1914 read 0x346bcdb thru 0x346dd9e (0x20c4 bytes) 2019-12-16T22:45:45.890 INFO:teuthology.orchestra.run.smithi177.stdout:1916 write 0xbe668ce thru 0xbe76234 (0xf967 bytes) 2019-12-16T22:45:45.902 INFO:teuthology.orchestra.run.smithi177.stdout:1917 punch from 0xcef6554 to 0xcf04c98, (0xe744 bytes) 2019-12-16T22:45:45.902 INFO:teuthology.orchestra.run.smithi177.stdout:1919 writesame 0x1d11a3 thru 0x1d4e40 data_size 0x1(0x3c9e bytes) 2019-12-16T22:45:45.903 INFO:teuthology.orchestra.run.smithi177.stdout:1395 write 0xa7300ee thru 0xa73ff14 (0xfe27 bytes) 2019-12-16T22:45:45.903 INFO:teuthology.orchestra.run.smithi177.stdout:1239 read 0x21481ea thru 0x214aa55 (0x286c bytes) 2019-12-16T22:45:45.904 INFO:teuthology.orchestra.run.smithi177.stdout:1240 writesame 0x84b2544 thru 0x84beede data_size 0x49(0xc99b bytes) 2019-12-16T22:45:45.920 INFO:teuthology.orchestra.run.smithi177.stdout:1397 read 0x8291e6b thru 0x8298d27 (0x6ebd bytes) 2019-12-16T22:45:45.920 INFO:teuthology.orchestra.run.smithi177.stdout:1241 writesame 0xb73ab7a thru 0xb74a7ff data_size 0x1(0xfc86 bytes) 2019-12-16T22:45:45.921 INFO:teuthology.orchestra.run.smithi177.stdout:1920 writesame 0xf649ef thru 0xf6fe3f data_size 0x9(0xb451 bytes) 2019-12-16T22:45:45.927 INFO:teuthology.orchestra.run.smithi177.stdout:1571 writesame 0x90cbe7 thru 0x910662 data_size 0x26(0x3a7c bytes) 2019-12-16T22:45:45.928 INFO:teuthology.orchestra.run.smithi177.stdout:1924 punch from 0x3878498 to 0x3882bcb, (0xa733 bytes) 2019-12-16T22:45:45.928 INFO:teuthology.orchestra.run.smithi177.stdout:1925 read 0xb1ca5f1 thru 0xb1cda0f (0x341f bytes) 2019-12-16T22:45:45.929 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:45.929 INFO:teuthology.orchestra.run.smithi177.stdout:1928 punch from 0x18e6a58 to 0x18ed7b4, (0x6d5c bytes) 2019-12-16T22:45:45.929 INFO:teuthology.orchestra.run.smithi177.stdout:1929 punch from 0x4bafc7f to 0x4bb40dd, (0x445e bytes) 2019-12-16T22:45:45.930 INFO:teuthology.orchestra.run.smithi177.stdout:1931 writesame 0x25b7cc thru 0x2685d7 data_size 0x2(0xce0c bytes) 2019-12-16T22:45:45.934 INFO:teuthology.orchestra.run.smithi177.stdout:1139 trunc from 0xcc50eba to 0x804e5a6 2019-12-16T22:45:45.953 INFO:teuthology.orchestra.run.smithi177.stdout:1932 punch from 0x8b48086 to 0x8b53bf3, (0xbb6d bytes) 2019-12-16T22:45:45.954 INFO:teuthology.orchestra.run.smithi177.stdout:1933 writesame 0x56f8e5c thru 0x56fe9ec data_size 0x1(0x5b91 bytes) 2019-12-16T22:45:45.992 INFO:teuthology.orchestra.run.smithi177.stdout:1934 read 0xf34aed thru 0xf3a8e3 (0x5df7 bytes) 2019-12-16T22:45:45.999 INFO:teuthology.orchestra.run.smithi177.stdout:1398 write 0xdf56cab thru 0xdf61894 (0xabea bytes) 2019-12-16T22:45:46.006 INFO:teuthology.orchestra.run.smithi177.stdout:1242 trunc from 0xb7bd1be to 0x17d95d 2019-12-16T22:45:46.008 INFO:teuthology.orchestra.run.smithi177.stdout:1385 trunc from 0xaafe3d5 to 0x88e6e57 2019-12-16T22:45:46.009 INFO:teuthology.orchestra.run.smithi177.stdout:1400 writesame 0x8d2c5d2 thru 0x8d30d00 data_size 0x1(0x472f bytes) 2019-12-16T22:45:46.020 INFO:teuthology.orchestra.run.smithi177.stdout:1937 trunc from 0xde7a259 to 0x62019a 2019-12-16T22:45:46.025 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.027 INFO:teuthology.orchestra.run.smithi177.stdout:1401 punch from 0xb93c483 to 0xb943c02, (0x777f bytes) 2019-12-16T22:45:46.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:45:46.038+0000 7f66f9929700 -1 reset not still connected to 0x55a369ad9740 2019-12-16T22:45:46.038 INFO:teuthology.orchestra.run.smithi177.stdout:1402 trunc from 0xdf61895 to 0x8874535 2019-12-16T22:45:46.040 INFO:teuthology.orchestra.run.smithi177.stdout:1140 read 0x739df13 thru 0x73a44ae (0x659c bytes) 2019-12-16T22:45:46.040 INFO:teuthology.orchestra.run.smithi177.stdout:1141 clone 10 order 21 su 262144 sc 15 2019-12-16T22:45:46.046 INFO:teuthology.orchestra.run.smithi177.stdout:1573 trunc from 0xcd8742e to 0x708d9c 2019-12-16T22:45:46.056 INFO:teuthology.orchestra.run.smithi177.stdout:1386 trunc from 0x88e6e57 to 0xb8c565b 2019-12-16T22:45:46.096 INFO:teuthology.orchestra.run.smithi177.stdout:1403 punch from 0x28d7eef to 0x28e1466, (0x9577 bytes) 2019-12-16T22:45:46.098 INFO:teuthology.orchestra.run.smithi177.stdout:1387 write 0x33a863e thru 0x33b671d (0xe0e0 bytes) 2019-12-16T22:45:46.107 INFO:teuthology.orchestra.run.smithi177.stdout:1939 writesame 0xd661dca thru 0xd669e0f data_size 0x27(0x8046 bytes) 2019-12-16T22:45:46.116 INFO:teuthology.orchestra.run.smithi177.stdout:1941 read 0x36acac7 thru 0x36b0ecc (0x4406 bytes) 2019-12-16T22:45:46.117 INFO:teuthology.orchestra.run.smithi177.stdout:1942 punch from 0x5befc05 to 0x5bf4328, (0x4723 bytes) 2019-12-16T22:45:46.117 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.117 INFO:teuthology.orchestra.run.smithi177.stdout:1945 write 0xbab3a82 thru 0xbab9255 (0x57d4 bytes) 2019-12-16T22:45:46.118 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.119 INFO:teuthology.orchestra.run.smithi177.stdout:1405 write 0x9383237 thru 0x9386680 (0x344a bytes) 2019-12-16T22:45:46.121 INFO:teuthology.orchestra.run.smithi177.stdout:1388 read 0x4161e5c thru 0x4169e93 (0x8038 bytes) 2019-12-16T22:45:46.121 INFO:teuthology.orchestra.run.smithi177.stdout:1389 read 0x12da080 thru 0x12e2f63 (0x8ee4 bytes) 2019-12-16T22:45:46.121 INFO:teuthology.orchestra.run.smithi177.stdout:1390 write 0x1b8d89b thru 0x1b91331 (0x3a97 bytes) 2019-12-16T22:45:46.123 INFO:teuthology.orchestra.run.smithi177.stdout:1946 writesame 0xa0710e1 thru 0xa078ed1 data_size 0xb(0x7df1 bytes) 2019-12-16T22:45:46.132 INFO:teuthology.orchestra.run.smithi177.stdout:1947 writesame 0x5cac81b thru 0x5cadfc1 data_size 0x7(0x17a7 bytes) 2019-12-16T22:45:46.137 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.138 INFO:teuthology.orchestra.run.smithi177.stdout:1394 writesame 0x5a57623 thru 0x5a6328e data_size 0x3e(0xbc6c bytes) 2019-12-16T22:45:46.138 INFO:teuthology.orchestra.run.smithi177.stdout:1408 write 0x64b4baa thru 0x64ba16c (0x55c3 bytes) 2019-12-16T22:45:46.141 INFO:teuthology.orchestra.run.smithi177.stdout:1948 writesame 0x19a472b thru 0x19b10c9 data_size 0x6f(0xc99f bytes) 2019-12-16T22:45:46.142 INFO:teuthology.orchestra.run.smithi177.stdout:1243 write 0xa74a78b thru 0xa75567e (0xaef4 bytes) 2019-12-16T22:45:46.152 INFO:teuthology.orchestra.run.smithi177.stdout:1949 read 0xbde44b8 thru 0xbde5f5e (0x1aa7 bytes) 2019-12-16T22:45:46.152 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.153 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.153 INFO:teuthology.orchestra.run.smithi177.stdout:1953 punch from 0xaf9f9a7 to 0xafaca9b, (0xd0f4 bytes) 2019-12-16T22:45:46.153 INFO:teuthology.orchestra.run.smithi177.stdout:1954 write 0x7ff392b thru 0x7ff75b0 (0x3c86 bytes) 2019-12-16T22:45:46.158 INFO:teuthology.orchestra.run.smithi177.stdout:1395 write 0x99329e6 thru 0x9935225 (0x2840 bytes) 2019-12-16T22:45:46.159 INFO:teuthology.orchestra.run.smithi177.stdout:1955 write 0xc9ec605 thru 0xc9f5493 (0x8e8f bytes) 2019-12-16T22:45:46.166 INFO:teuthology.orchestra.run.smithi177.stdout:1577 write 0xd8dac80 thru 0xd8e0a44 (0x5dc5 bytes) 2019-12-16T22:45:46.171 INFO:teuthology.orchestra.run.smithi177.stdout:1396 read 0x9995df1 thru 0x999ab2b (0x4d3b bytes) 2019-12-16T22:45:46.171 INFO:teuthology.orchestra.run.smithi177.stdout:1397 read 0xa467ef8 thru 0xa475483 (0xd58c bytes) 2019-12-16T22:45:46.172 INFO:teuthology.orchestra.run.smithi177.stdout:1398 read 0xb42a700 thru 0xb42e1d2 (0x3ad3 bytes) 2019-12-16T22:45:46.172 INFO:teuthology.orchestra.run.smithi177.stdout:1400 read 0x4a3ccfc thru 0x4a3e924 (0x1c29 bytes) 2019-12-16T22:45:46.175 INFO:teuthology.orchestra.run.smithi177.stdout:1578 writesame 0x994a883 thru 0x994cc3d data_size 0x1(0x23bb bytes) 2019-12-16T22:45:46.176 INFO:teuthology.orchestra.run.smithi177.stdout:1956 trunc from 0xd669e10 to 0x92f3cb9 2019-12-16T22:45:46.186 INFO:teuthology.orchestra.run.smithi177.stdout:1245 write 0xa95ca30 thru 0xa96a674 (0xdc45 bytes) 2019-12-16T22:45:46.186 INFO:teuthology.orchestra.run.smithi177.stdout:1579 writesame 0x650ef83 thru 0x651729b data_size 0x71(0x8319 bytes) 2019-12-16T22:45:46.187 INFO:teuthology.orchestra.run.smithi177.stdout:1409 write 0xd4f0580 thru 0xd4fff6b (0xf9ec bytes) 2019-12-16T22:45:46.199 INFO:teuthology.orchestra.run.smithi177.stdout:1410 read 0x7d718b1 thru 0x7d7edc8 (0xd518 bytes) 2019-12-16T22:45:46.199 INFO:teuthology.orchestra.run.smithi177.stdout:1580 write 0x77e1a62 thru 0x77e6b96 (0x5135 bytes) 2019-12-16T22:45:46.200 INFO:teuthology.orchestra.run.smithi177.stdout:1411 read 0x157ce29 thru 0x1584a61 (0x7c39 bytes) 2019-12-16T22:45:46.201 INFO:teuthology.orchestra.run.smithi177.stdout:1412 write 0x82ca139 thru 0x82d6834 (0xc6fc bytes) 2019-12-16T22:45:46.201 INFO:teuthology.orchestra.run.smithi177.stdout:1246 punch from 0x9caf2b5 to 0x9cb16a0, (0x23eb bytes) 2019-12-16T22:45:46.211 INFO:teuthology.orchestra.run.smithi177.stdout:1401 write 0xea3c676 thru 0xea49b7b (0xd506 bytes) 2019-12-16T22:45:46.214 INFO:teuthology.orchestra.run.smithi177.stdout:1413 trunc from 0xd4fff6c to 0xa27492c 2019-12-16T22:45:46.216 INFO:teuthology.orchestra.run.smithi177.stdout:1957 writesame 0x4f02e8e thru 0x4f0cd9d data_size 0x14(0x9f10 bytes) 2019-12-16T22:45:46.222 INFO:teuthology.orchestra.run.smithi177.stdout:1958 writesame 0x214663d thru 0x2149ca5 data_size 0x1(0x3669 bytes) 2019-12-16T22:45:46.237 INFO:teuthology.orchestra.run.smithi177.stdout:1960 read 0x34b927d thru 0x34bfe1c (0x6ba0 bytes) 2019-12-16T22:45:46.240 INFO:teuthology.orchestra.run.smithi177.stdout:1247 write 0xc6518c9 thru 0xc653650 (0x1d88 bytes) 2019-12-16T22:45:46.240 INFO:teuthology.orchestra.run.smithi177.stdout:1402 read 0xadbf896 thru 0xadc0fc9 (0x1734 bytes) 2019-12-16T22:45:46.241 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.241 INFO:teuthology.orchestra.run.smithi177.stdout:1405 punch from 0x9af1bd8 to 0x9af71fb, (0x5623 bytes) 2019-12-16T22:45:46.241 INFO:teuthology.orchestra.run.smithi177.stdout:1406 read 0x6dcdd2b thru 0x6dcf06a (0x1340 bytes) 2019-12-16T22:45:46.242 INFO:teuthology.orchestra.run.smithi177.stdout:1407 write 0x9122a7b thru 0x912b06a (0x85f0 bytes) 2019-12-16T22:45:46.244 INFO:teuthology.orchestra.run.smithi177.stdout:1581 write 0xe78de6e thru 0xe7978aa (0x9a3d bytes) 2019-12-16T22:45:46.251 INFO:teuthology.orchestra.run.smithi177.stdout:1249 punch from 0x2947fa5 to 0x294ce7b, (0x4ed6 bytes) 2019-12-16T22:45:46.251 INFO:teuthology.orchestra.run.smithi177.stdout:1250 punch from 0x3bc2e3d to 0x3bcff04, (0xd0c7 bytes) 2019-12-16T22:45:46.251 INFO:teuthology.orchestra.run.smithi177.stdout:1253 punch from 0x8a6487f to 0x8a6d23e, (0x89bf bytes) 2019-12-16T22:45:46.251 INFO:teuthology.orchestra.run.smithi177.stdout:1254 read 0x8952547 thru 0x89620f2 (0xfbac bytes) 2019-12-16T22:45:46.252 INFO:teuthology.orchestra.run.smithi177.stdout:1255 writesame 0x7c76552 thru 0x7c80798 data_size 0x1(0xa247 bytes) 2019-12-16T22:45:46.255 INFO:teuthology.orchestra.run.smithi177.stdout:1414 read 0x4b67a82 thru 0x4b6ae88 (0x3407 bytes) 2019-12-16T22:45:46.255 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.256 INFO:teuthology.orchestra.run.smithi177.stdout:1417 read 0x7f2448e thru 0x7f32a8b (0xe5fe bytes) 2019-12-16T22:45:46.256 INFO:teuthology.orchestra.run.smithi177.stdout:1582 read 0xe79642b thru 0xe7978aa (0x1480 bytes) 2019-12-16T22:45:46.268 INFO:teuthology.orchestra.run.smithi177.stdout:1418 writesame 0x68ffb2f thru 0x690c74c data_size 0x9(0xcc1e bytes) 2019-12-16T22:45:46.269 INFO:teuthology.orchestra.run.smithi177.stdout:1583 read 0xb30febc thru 0xb318de3 (0x8f28 bytes) 2019-12-16T22:45:46.269 INFO:teuthology.orchestra.run.smithi177.stdout:1584 read 0x1ba3c83 thru 0x1ba89f8 (0x4d76 bytes) 2019-12-16T22:45:46.269 INFO:teuthology.orchestra.run.smithi177.stdout:1585 punch from 0xbd48980 to 0xbd50029, (0x76a9 bytes) 2019-12-16T22:45:46.269 INFO:teuthology.orchestra.run.smithi177.stdout:1587 read 0x6ecdf4d thru 0x6ecf1fd (0x12b1 bytes) 2019-12-16T22:45:46.270 INFO:teuthology.orchestra.run.smithi177.stdout:1588 write 0x97136f1 thru 0x9720f50 (0xd860 bytes) 2019-12-16T22:45:46.270 INFO:teuthology.orchestra.run.smithi177.stdout:1408 write 0x78e0331 thru 0x78ea9d5 (0xa6a5 bytes) 2019-12-16T22:45:46.286 INFO:teuthology.orchestra.run.smithi177.stdout:1589 punch from 0x4e4c661 to 0x4e55398, (0x8d37 bytes) 2019-12-16T22:45:46.287 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.287 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.287 INFO:teuthology.orchestra.run.smithi177.stdout:1592 read 0xde9cc47 thru 0xdea4fd2 (0x838c bytes) 2019-12-16T22:45:46.287 INFO:teuthology.orchestra.run.smithi177.stdout:1593 read 0x83c4fe6 thru 0x83cc172 (0x718d bytes) 2019-12-16T22:45:46.288 INFO:teuthology.orchestra.run.smithi177.stdout:1594 write 0x8aafdd thru 0x8b22dc (0x7300 bytes) 2019-12-16T22:45:46.292 INFO:teuthology.orchestra.run.smithi177.stdout:1961 write 0xbb771ba thru 0xbb78a9a (0x18e1 bytes) 2019-12-16T22:45:46.294 INFO:teuthology.orchestra.run.smithi177.stdout:1256 punch from 0x3ffc4a4 to 0x400655f, (0xa0bb bytes) 2019-12-16T22:45:46.294 INFO:teuthology.orchestra.run.smithi177.stdout:1257 writesame 0x9c7ccb8 thru 0x9c7f589 data_size 0x19(0x28d2 bytes) 2019-12-16T22:45:46.296 INFO:teuthology.orchestra.run.smithi177.stdout:1595 read 0xaf1e3d2 thru 0xaf2da83 (0xf6b2 bytes) 2019-12-16T22:45:46.297 INFO:teuthology.orchestra.run.smithi177.stdout:1596 writesame 0xd29c814 thru 0xd29fdd9 data_size 0x1(0x35c6 bytes) 2019-12-16T22:45:46.299 INFO:teuthology.orchestra.run.smithi177.stdout:1409 punch from 0x70459ff to 0x704a9fc, (0x4ffd bytes) 2019-12-16T22:45:46.299 INFO:teuthology.orchestra.run.smithi177.stdout:1410 read 0xe1beb33 thru 0xe1cc4ca (0xd998 bytes) 2019-12-16T22:45:46.300 INFO:teuthology.orchestra.run.smithi177.stdout:1411 writesame 0x7cba023 thru 0x7cbb709 data_size 0xd(0x16e7 bytes) 2019-12-16T22:45:46.300 INFO:teuthology.orchestra.run.smithi177.stdout:1962 punch from 0x6e963da to 0x6ea516a, (0xed90 bytes) 2019-12-16T22:45:46.300 INFO:teuthology.orchestra.run.smithi177.stdout:1963 write 0x4d0d7db thru 0x4d12b58 (0x537e bytes) 2019-12-16T22:45:46.305 INFO:teuthology.orchestra.run.smithi177.stdout:1258 trunc from 0xc653651 to 0xba0f7cb 2019-12-16T22:45:46.308 INFO:teuthology.orchestra.run.smithi177.stdout:1964 trunc from 0xbb78a9b to 0xb4cc7d4 2019-12-16T22:45:46.311 INFO:teuthology.orchestra.run.smithi177.stdout:1597 write 0x362dae1 thru 0x363a24b (0xc76b bytes) 2019-12-16T22:45:46.317 INFO:teuthology.orchestra.run.smithi177.stdout:1419 write 0xab17c77 thru 0xab1e0bb (0x6445 bytes) 2019-12-16T22:45:46.318 INFO:teuthology.orchestra.run.smithi177.stdout:1412 write 0x86dc5d3 thru 0x86e1f3d (0x596b bytes) 2019-12-16T22:45:46.324 INFO:teuthology.orchestra.run.smithi177.stdout:1599 read 0xa5b610 thru 0xa5c234 (0xc25 bytes) 2019-12-16T22:45:46.333 INFO:teuthology.orchestra.run.smithi177.stdout:1420 write 0x6ff1312 thru 0x700004f (0xed3e bytes) 2019-12-16T22:45:46.335 INFO:teuthology.orchestra.run.smithi177.stdout:1413 punch from 0x8673330 to 0x8674df5, (0x1ac5 bytes) 2019-12-16T22:45:46.336 INFO:teuthology.orchestra.run.smithi177.stdout:1414 write 0x2845180 thru 0x284ac74 (0x5af5 bytes) 2019-12-16T22:45:46.347 INFO:teuthology.orchestra.run.smithi177.stdout:1600 trunc from 0xe7978ab to 0x308c89c 2019-12-16T22:45:46.352 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.353 INFO:teuthology.orchestra.run.smithi177.stdout:1422 read 0x704b554 thru 0x7059b72 (0xe61f bytes) 2019-12-16T22:45:46.354 INFO:teuthology.orchestra.run.smithi177.stdout:1423 punch from 0x6724ea0 to 0x672e3cb, (0x952b bytes) 2019-12-16T22:45:46.354 INFO:teuthology.orchestra.run.smithi177.stdout:1425 read 0x3167cb4 thru 0x3175f1a (0xe267 bytes) 2019-12-16T22:45:46.354 INFO:teuthology.orchestra.run.smithi177.stdout:1426 read 0x75a9fc4 thru 0x75b85f9 (0xe636 bytes) 2019-12-16T22:45:46.354 INFO:teuthology.orchestra.run.smithi177.stdout:1427 read 0x8fc43f4 thru 0x8fd32d3 (0xeee0 bytes) 2019-12-16T22:45:46.355 INFO:teuthology.orchestra.run.smithi177.stdout:1260 writesame 0xa1b89e8 thru 0xa1c2149 data_size 0x9(0x9762 bytes) 2019-12-16T22:45:46.357 INFO:teuthology.orchestra.run.smithi177.stdout:1966 read 0x67a3394 thru 0x67a903e (0x5cab bytes) 2019-12-16T22:45:46.357 INFO:teuthology.orchestra.run.smithi177.stdout:1967 read 0x6340341 thru 0x6344dbc (0x4a7c bytes) 2019-12-16T22:45:46.362 INFO:teuthology.orchestra.run.smithi177.stdout:1428 trunc from 0xab1e0bc to 0x722441c 2019-12-16T22:45:46.366 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.368 INFO:teuthology.orchestra.run.smithi177.stdout:1266 trunc from 0xba0f7cb to 0xa7a9f9c 2019-12-16T22:45:46.374 INFO:teuthology.orchestra.run.smithi177.stdout:1416 trunc from 0xea49b7c to 0x418e822 2019-12-16T22:45:46.393 INFO:teuthology.orchestra.run.smithi177.stdout:1968 write 0xb718475 thru 0xb71a5a8 (0x2134 bytes) 2019-12-16T22:45:46.396 INFO:teuthology.orchestra.run.smithi177.stdout:1969 punch from 0x271cede to 0x27260d7, (0x91f9 bytes) 2019-12-16T22:45:46.396 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.397 INFO:teuthology.orchestra.run.smithi177.stdout:1971 punch from 0xb3416a to 0xb422d1, (0xe167 bytes) 2019-12-16T22:45:46.397 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.397 INFO:teuthology.orchestra.run.smithi177.stdout:1975 read 0xabe51e7 thru 0xabe88ff (0x3719 bytes) 2019-12-16T22:45:46.419 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.419 INFO:teuthology.orchestra.run.smithi177.stdout:1430 write 0x848fa1 thru 0x852afd (0x9b5d bytes) 2019-12-16T22:45:46.423 INFO:teuthology.orchestra.run.smithi177.stdout:1417 read 0x2b8c062 thru 0x2b93b77 (0x7b16 bytes) 2019-12-16T22:45:46.424 INFO:teuthology.orchestra.run.smithi177.stdout:1418 punch from 0x1437265 to 0x143e152, (0x6eed bytes) 2019-12-16T22:45:46.424 INFO:teuthology.orchestra.run.smithi177.stdout:1419 read 0x2b637bb thru 0x2b64632 (0xe78 bytes) 2019-12-16T22:45:46.425 INFO:teuthology.orchestra.run.smithi177.stdout:1420 punch from 0x1adfea2 to 0x1ae5f8f, (0x60ed bytes) 2019-12-16T22:45:46.425 INFO:teuthology.orchestra.run.smithi177.stdout:1421 punch from 0x182a82b to 0x18397f5, (0xefca bytes) 2019-12-16T22:45:46.426 INFO:teuthology.orchestra.run.smithi177.stdout:1978 writesame 0xd349fa2 thru 0xd34a12f data_size 0x1(0x18e bytes) 2019-12-16T22:45:46.429 INFO:teuthology.orchestra.run.smithi177.stdout:1601 write 0xcb58653 thru 0xcb668fc (0xe2aa bytes) 2019-12-16T22:45:46.431 INFO:teuthology.orchestra.run.smithi177.stdout:1979 read 0xb5178af thru 0xb51ca45 (0x5197 bytes) 2019-12-16T22:45:46.432 INFO:teuthology.orchestra.run.smithi177.stdout:1980 read 0x9822052 thru 0x982fe47 (0xddf6 bytes) 2019-12-16T22:45:46.432 INFO:teuthology.orchestra.run.smithi177.stdout:1981 read 0x6064e28 thru 0x606ed65 (0x9f3e bytes) 2019-12-16T22:45:46.433 INFO:teuthology.orchestra.run.smithi177.stdout:1431 read 0x45d5190 thru 0x45dcdf1 (0x7c62 bytes) 2019-12-16T22:45:46.433 INFO:teuthology.orchestra.run.smithi177.stdout:1982 write 0x8d6b825 thru 0x8d74972 (0x914e bytes) 2019-12-16T22:45:46.433 INFO:teuthology.orchestra.run.smithi177.stdout:1432 write 0x6d4c4 thru 0x7016c (0x2ca9 bytes) 2019-12-16T22:45:46.438 INFO:teuthology.orchestra.run.smithi177.stdout:1267 writesame 0xd260718 thru 0xd26781d data_size 0x17(0x7106 bytes) 2019-12-16T22:45:46.439 INFO:teuthology.orchestra.run.smithi177.stdout:1983 write 0xc4f7b0e thru 0xc500898 (0x8d8b bytes) 2019-12-16T22:45:46.442 INFO:teuthology.orchestra.run.smithi177.stdout:1268 punch from 0xaff344 to 0xb07edc, (0x8b98 bytes) 2019-12-16T22:45:46.442 INFO:teuthology.orchestra.run.smithi177.stdout:1270 write 0xb4e38ae thru 0xb4ecb51 (0x92a4 bytes) 2019-12-16T22:45:46.443 INFO:teuthology.orchestra.run.smithi177.stdout:1603 punch from 0xa3415dc to 0xa3441b5, (0x2bd9 bytes) 2019-12-16T22:45:46.443 INFO:teuthology.orchestra.run.smithi177.stdout:1604 write 0x4806cbe thru 0x481157f (0xa8c2 bytes) 2019-12-16T22:45:46.451 INFO:teuthology.orchestra.run.smithi177.stdout:1985 read 0x7dc24ab thru 0x7dd0072 (0xdbc8 bytes) 2019-12-16T22:45:46.452 INFO:teuthology.orchestra.run.smithi177.stdout:1986 write 0x6ce4dbc thru 0x6ce94b9 (0x46fe bytes) 2019-12-16T22:45:46.455 INFO:teuthology.orchestra.run.smithi177.stdout:1605 write 0x2200b0b thru 0x220786e (0x6d64 bytes) 2019-12-16T22:45:46.457 INFO:teuthology.orchestra.run.smithi177.stdout:1433 trunc from 0x722441c to 0x4a31699 2019-12-16T22:45:46.464 INFO:teuthology.orchestra.run.smithi177.stdout:1987 writesame 0x950784a thru 0x950f598 data_size 0x33(0x7d4f bytes) 2019-12-16T22:45:46.464 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.465 INFO:teuthology.orchestra.run.smithi177.stdout:1609 writesame 0xab85ee9 thru 0xab931db data_size 0x2f(0xd2f3 bytes) 2019-12-16T22:45:46.465 INFO:teuthology.orchestra.run.smithi177.stdout:1422 write 0xcbc4d7f thru 0xcbcca30 (0x7cb2 bytes) 2019-12-16T22:45:46.470 INFO:teuthology.orchestra.run.smithi177.stdout:1271 trunc from 0xd26781e to 0x7865077 2019-12-16T22:45:46.473 INFO:teuthology.orchestra.run.smithi177.stdout:1989 punch from 0xbdfe865 to 0xbe0e660, (0xfdfb bytes) 2019-12-16T22:45:46.474 INFO:teuthology.orchestra.run.smithi177.stdout:1990 read 0xa4ecc2e thru 0xa4fa84e (0xdc21 bytes) 2019-12-16T22:45:46.474 INFO:teuthology.orchestra.run.smithi177.stdout:1991 write 0x561ca89 thru 0x561fa05 (0x2f7d bytes) 2019-12-16T22:45:46.480 INFO:teuthology.orchestra.run.smithi177.stdout:1610 write 0x362ee57 thru 0x363be0c (0xcfb6 bytes) 2019-12-16T22:45:46.489 INFO:teuthology.orchestra.run.smithi177.stdout:1992 read 0xb0fb0c thru 0xb1817b (0x8670 bytes) 2019-12-16T22:45:46.491 INFO:teuthology.orchestra.run.smithi177.stdout:1993 read 0x2cfa310 thru 0x2d09954 (0xf645 bytes) 2019-12-16T22:45:46.491 INFO:teuthology.orchestra.run.smithi177.stdout:1994 write 0x765a448 thru 0x7666f4f (0xcb08 bytes) 2019-12-16T22:45:46.493 INFO:teuthology.orchestra.run.smithi177.stdout:1611 read 0x226afa0 thru 0x22717fa (0x685b bytes) 2019-12-16T22:45:46.493 INFO:teuthology.orchestra.run.smithi177.stdout:1612 write 0x39e2ef2 thru 0x39eaae8 (0x7bf7 bytes) 2019-12-16T22:45:46.501 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xe9e7138 2019-12-16T22:45:46.501 INFO:teuthology.orchestra.run.smithi177.stdout:1423 read 0xa44b8b0 thru 0xa44bd66 (0x4b7 bytes) 2019-12-16T22:45:46.502 INFO:teuthology.orchestra.run.smithi177.stdout:1425 write 0xb7802e7 thru 0xb783522 (0x323c bytes) 2019-12-16T22:45:46.504 INFO:teuthology.orchestra.run.smithi177.stdout:1995 trunc from 0xd34a130 to 0xe9e7138 2019-12-16T22:45:46.514 INFO:teuthology.orchestra.run.smithi177.stdout:1426 read 0x2844a72 thru 0x284646b (0x19fa bytes) 2019-12-16T22:45:46.515 INFO:teuthology.orchestra.run.smithi177.stdout:1429 read 0xb464590 thru 0xb4659fb (0x146c bytes) 2019-12-16T22:45:46.516 INFO:teuthology.orchestra.run.smithi177.stdout:1430 read 0x527d10 thru 0x533d79 (0xc06a bytes) 2019-12-16T22:45:46.516 INFO:teuthology.orchestra.run.smithi177.stdout:1431 write 0x6684217 thru 0x668907e (0x4e68 bytes) 2019-12-16T22:45:46.518 INFO:teuthology.orchestra.run.smithi177.stdout:1435 read 0x2780879 thru 0x2782c42 (0x23ca bytes) 2019-12-16T22:45:46.519 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.521 INFO:teuthology.orchestra.run.smithi177.stdout:1437 writesame 0x3e7c359 thru 0x3e837bf data_size 0x63(0x7467 bytes) 2019-12-16T22:45:46.523 INFO:teuthology.orchestra.run.smithi177.stdout:1438 read 0x3bf8649 thru 0x3bfd711 (0x50c9 bytes) 2019-12-16T22:45:46.528 INFO:teuthology.orchestra.run.smithi177.stdout:1432 read 0x1caf790 thru 0x1cb753a (0x7dab bytes) 2019-12-16T22:45:46.529 INFO:teuthology.orchestra.run.smithi177.stdout:1433 read 0x1fcbe09 thru 0x1fd737a (0xb572 bytes) 2019-12-16T22:45:46.529 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.530 INFO:teuthology.orchestra.run.smithi177.stdout:1274 write 0x4bd3fc5 thru 0x4bdbf2d (0x7f69 bytes) 2019-12-16T22:45:46.530 INFO:teuthology.orchestra.run.smithi177.stdout:1434 writesame 0x6df1b80 thru 0x6dfece5 data_size 0x31(0xd166 bytes) 2019-12-16T22:45:46.544 INFO:teuthology.orchestra.run.smithi177.stdout:1997 write 0x91b3fdb thru 0x91ba075 (0x609b bytes) 2019-12-16T22:45:46.545 INFO:teuthology.orchestra.run.smithi177.stdout:1613 writesame 0xd298f96 thru 0xd2a6df2 data_size 0x73(0xde5d bytes) 2019-12-16T22:45:46.545 INFO:teuthology.orchestra.run.smithi177.stdout:1614 clone 14 order 24 su 2097152 sc 8 2019-12-16T22:45:46.545 INFO:teuthology.orchestra.run.smithi177.stdout:1276 read 0x4284f99 thru 0x4291900 (0xc968 bytes) 2019-12-16T22:45:46.546 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.546 INFO:teuthology.orchestra.run.smithi177.stdout:1278 writesame 0x4e7aa53 thru 0x4e811fb data_size 0x11(0x67a9 bytes) 2019-12-16T22:45:46.546 INFO:teuthology.orchestra.run.smithi177.stdout:1998 punch from 0xbf581e9 to 0xbf5880f, (0x626 bytes) 2019-12-16T22:45:46.546 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.546 INFO:teuthology.orchestra.run.smithi177.stdout:2005 writesame 0x3183608 thru 0x3189999 data_size 0x5(0x6392 bytes) 2019-12-16T22:45:46.549 INFO:teuthology.orchestra.run.smithi177.stdout:2006 write 0x694fbcc thru 0x6955c14 (0x6049 bytes) 2019-12-16T22:45:46.550 INFO:teuthology.orchestra.run.smithi177.stdout:1435 read 0x894428 thru 0x8a25ca (0xe1a3 bytes) 2019-12-16T22:45:46.550 INFO:teuthology.orchestra.run.smithi177.stdout:1437 read 0xc862a7c thru 0xc866ca4 (0x4229 bytes) 2019-12-16T22:45:46.550 INFO:teuthology.orchestra.run.smithi177.stdout:1438 write 0x21f03e1 thru 0x21fa3d3 (0x9ff3 bytes) 2019-12-16T22:45:46.559 INFO:teuthology.orchestra.run.smithi177.stdout:2007 punch from 0x707c40d to 0x707d113, (0xd06 bytes) 2019-12-16T22:45:46.559 INFO:teuthology.orchestra.run.smithi177.stdout:2008 clone 10 order 25 su 262144 sc 5 2019-12-16T22:45:46.561 INFO:teuthology.orchestra.run.smithi177.stdout:1279 read 0x43653b1 thru 0x436ac23 (0x5873 bytes) 2019-12-16T22:45:46.561 INFO:teuthology.orchestra.run.smithi177.stdout:1280 read 0x585743f thru 0x5857ed7 (0xa99 bytes) 2019-12-16T22:45:46.562 INFO:teuthology.orchestra.run.smithi177.stdout:1281 punch from 0x63a6294 to 0x63ad103, (0x6e6f bytes) 2019-12-16T22:45:46.562 INFO:teuthology.orchestra.run.smithi177.stdout:1282 writesame 0x473dda2 thru 0x4746837 data_size 0x51(0x8a96 bytes) 2019-12-16T22:45:46.566 INFO:teuthology.orchestra.run.smithi177.stdout:1439 writesame 0x8de84fc thru 0x8df0095 data_size 0xd(0x7b9a bytes) 2019-12-16T22:45:46.568 INFO:teuthology.orchestra.run.smithi177.stdout:1442 writesame 0x285ee89 thru 0x2864ae9 data_size 0x1(0x5c61 bytes) 2019-12-16T22:45:46.571 INFO:teuthology.orchestra.run.smithi177.stdout:1283 read 0x58afd5e thru 0x58bceba (0xd15d bytes) 2019-12-16T22:45:46.571 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.572 INFO:teuthology.orchestra.run.smithi177.stdout:1285 write 0x302134c thru 0x302fc3b (0xe8f0 bytes) 2019-12-16T22:45:46.572 INFO:teuthology.orchestra.run.smithi177.stdout:1440 writesame 0x5ff9dc9 thru 0x600028a data_size 0x9(0x64c2 bytes) 2019-12-16T22:45:46.585 INFO:teuthology.orchestra.run.smithi177.stdout:1442 punch from 0x767ad3d to 0x7684c06, (0x9ec9 bytes) 2019-12-16T22:45:46.586 INFO:teuthology.orchestra.run.smithi177.stdout:1443 writesame 0x4b795a6 thru 0x4b87653 data_size 0x1(0xe0ae bytes) 2019-12-16T22:45:46.592 INFO:teuthology.orchestra.run.smithi177.stdout:1443 write 0x9e12859 thru 0x9e202ae (0xda56 bytes) 2019-12-16T22:45:46.610 INFO:teuthology.orchestra.run.smithi177.stdout:1286 trunc from 0x7865077 to 0x16fcce7 2019-12-16T22:45:46.634 INFO:teuthology.orchestra.run.smithi177.stdout:1444 read 0x82b4a30 thru 0x82c131e (0xc8ef bytes) 2019-12-16T22:45:46.634 INFO:teuthology.orchestra.run.smithi177.stdout:1445 punch from 0x11354ab to 0x1135ccd, (0x822 bytes) 2019-12-16T22:45:46.635 INFO:teuthology.orchestra.run.smithi177.stdout:1448 writesame 0x863175a thru 0x8634b73 data_size 0x39(0x341a bytes) 2019-12-16T22:45:46.638 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.638 INFO:teuthology.orchestra.run.smithi177.stdout:1447 write 0xa7e0818 thru 0xa7ea969 (0xa152 bytes) 2019-12-16T22:45:46.641 INFO:teuthology.orchestra.run.smithi177.stdout:1449 writesame 0x33bb09d thru 0x33c7f3f data_size 0x21(0xcea3 bytes) 2019-12-16T22:45:46.646 INFO:teuthology.orchestra.run.smithi177.stdout:1450 punch from 0x54d5d88 to 0x54e53ce, (0xf646 bytes) 2019-12-16T22:45:46.646 INFO:teuthology.orchestra.run.smithi177.stdout:1451 read 0x2ab2fa4 thru 0x2ac2486 (0xf4e3 bytes) 2019-12-16T22:45:46.653 INFO:teuthology.orchestra.run.smithi177.stdout:1289 writesame 0x649320 thru 0x650eda data_size 0x7(0x7bbb bytes) 2019-12-16T22:45:46.653 INFO:teuthology.orchestra.run.smithi177.stdout:1448 read 0x116526d thru 0x1166746 (0x14da bytes) 2019-12-16T22:45:46.653 INFO:teuthology.orchestra.run.smithi177.stdout:1449 write 0xa6ca62c thru 0xa6ce03f (0x3a14 bytes) 2019-12-16T22:45:46.662 INFO:teuthology.orchestra.run.smithi177.stdout:1450 read 0x6bdd5ee thru 0x6be510b (0x7b1e bytes) 2019-12-16T22:45:46.662 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.662 INFO:teuthology.orchestra.run.smithi177.stdout:1452 writesame 0x9657359 thru 0x965765f data_size 0x5(0x307 bytes) 2019-12-16T22:45:46.663 INFO:teuthology.orchestra.run.smithi177.stdout:1452 trunc from 0x8df0096 to 0xc516a3 2019-12-16T22:45:46.668 INFO:teuthology.orchestra.run.smithi177.stdout:1453 read 0xbcd7da9 thru 0xbce50f2 (0xd34a bytes) 2019-12-16T22:45:46.668 INFO:teuthology.orchestra.run.smithi177.stdout:1454 punch from 0x9356b09 to 0x93598b2, (0x2da9 bytes) 2019-12-16T22:45:46.692 INFO:teuthology.orchestra.run.smithi177.stdout:1455 trunc from 0xcbcca31 to 0x4513895 2019-12-16T22:45:46.711 INFO:teuthology.orchestra.run.smithi177.stdout:1291 write 0x8c0095c thru 0x8c01c36 (0x12db bytes) 2019-12-16T22:45:46.721 INFO:teuthology.orchestra.run.smithi177.stdout:1295 read 0x7bdf5eb thru 0x7be90b7 (0x9acd bytes) 2019-12-16T22:45:46.721 INFO:teuthology.orchestra.run.smithi177.stdout:1296 punch from 0x8092acb to 0x8098124, (0x5659 bytes) 2019-12-16T22:45:46.721 INFO:teuthology.orchestra.run.smithi177.stdout:1453 read 0xaa1eb3 thru 0xaa4936 (0x2a84 bytes) 2019-12-16T22:45:46.725 INFO:teuthology.orchestra.run.smithi177.stdout:1299 trunc from 0x8c01c37 to 0x56f6722 2019-12-16T22:45:46.739 INFO:teuthology.orchestra.run.smithi177.stdout:1456 trunc from 0x4513895 to 0xb9dbf7b 2019-12-16T22:45:46.739 INFO:teuthology.orchestra.run.smithi177.stdout:1454 write 0x1e33339 thru 0x1e3904d (0x5d15 bytes) 2019-12-16T22:45:46.757 INFO:teuthology.orchestra.run.smithi177.stdout:1460 write 0x5d51319 thru 0x5d5d464 (0xc14c bytes) 2019-12-16T22:45:46.777 INFO:teuthology.orchestra.run.smithi177.stdout:1300 write 0xa658bc3 thru 0xa666c2b (0xe069 bytes) 2019-12-16T22:45:46.777 INFO:teuthology.orchestra.run.smithi177.stdout:1465 writesame 0x73076fd thru 0x73088fd data_size 0x1(0x1201 bytes) 2019-12-16T22:45:46.777 INFO:teuthology.orchestra.run.smithi177.stdout:1456 writesame 0x4dc5238 thru 0x4dc6677 data_size 0x4(0x1440 bytes) 2019-12-16T22:45:46.784 INFO:teuthology.orchestra.run.smithi177.stdout:1457 punch from 0x3b2c90d to 0x3b331d5, (0x68c8 bytes) 2019-12-16T22:45:46.784 INFO:teuthology.orchestra.run.smithi177.stdout:1458 read 0xe72d67 thru 0xe7c976 (0x9c10 bytes) 2019-12-16T22:45:46.785 INFO:teuthology.orchestra.run.smithi177.stdout:1460 punch from 0x2c3ae88 to 0x2c43650, (0x87c8 bytes) 2019-12-16T22:45:46.785 INFO:teuthology.orchestra.run.smithi177.stdout:1461 read 0x2c22092 thru 0x2c22401 (0x370 bytes) 2019-12-16T22:45:46.788 INFO:teuthology.orchestra.run.smithi177.stdout:1462 trunc from 0x4dc6678 to 0x5bee16c 2019-12-16T22:45:46.788 INFO:teuthology.orchestra.run.smithi177.stdout:1466 write 0x247f8b thru 0x252553 (0xa5c9 bytes) 2019-12-16T22:45:46.791 INFO:teuthology.orchestra.run.smithi177.stdout:1301 read 0x59dd993 thru 0x59e7dbc (0xa42a bytes) 2019-12-16T22:45:46.791 INFO:teuthology.orchestra.run.smithi177.stdout:1302 writesame 0x2bc987b thru 0x2bd6d3b data_size 0x5(0xd4c1 bytes) 2019-12-16T22:45:46.813 INFO:teuthology.orchestra.run.smithi177.stdout:1467 read 0x75f7381 thru 0x75fb233 (0x3eb3 bytes) 2019-12-16T22:45:46.813 INFO:teuthology.orchestra.run.smithi177.stdout:1468 write 0x8e382c4 thru 0x8e3b2a9 (0x2fe6 bytes) 2019-12-16T22:45:46.820 INFO:teuthology.orchestra.run.smithi177.stdout:1469 read 0x97a7c35 thru 0x97b2afb (0xaec7 bytes) 2019-12-16T22:45:46.821 INFO:teuthology.orchestra.run.smithi177.stdout:1470 write 0x5b001c1 thru 0x5b01ed0 (0x1d10 bytes) 2019-12-16T22:45:46.823 INFO:teuthology.orchestra.run.smithi177.stdout:1463 trunc from 0x5bee16c to 0x136428e 2019-12-16T22:45:46.824 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.824 INFO:teuthology.orchestra.run.smithi177.stdout:1472 writesame 0x7d10c03 thru 0x7d11444 data_size 0x7(0x842 bytes) 2019-12-16T22:45:46.827 INFO:teuthology.orchestra.run.smithi177.stdout:1303 trunc from 0xa666c2c to 0x14d3a79 2019-12-16T22:45:46.833 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.833 INFO:teuthology.orchestra.run.smithi177.stdout:1475 write 0xb91cf60 thru 0xb921d0f (0x4db0 bytes) 2019-12-16T22:45:46.842 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.842 INFO:teuthology.orchestra.run.smithi177.stdout:1478 write 0x22b81c thru 0x2388fd (0xd0e2 bytes) 2019-12-16T22:45:46.858 INFO:teuthology.orchestra.run.smithi177.stdout:1479 write 0x575c99f thru 0x575ee43 (0x24a5 bytes) 2019-12-16T22:45:46.865 INFO:teuthology.orchestra.run.smithi177.stdout:1481 punch from 0xb94a2a3 to 0xb950053, (0x5db0 bytes) 2019-12-16T22:45:46.865 INFO:teuthology.orchestra.run.smithi177.stdout:1482 write 0x3451485 thru 0x3457b47 (0x66c3 bytes) 2019-12-16T22:45:46.874 INFO:teuthology.orchestra.run.smithi177.stdout:1483 write 0x7c0a492 thru 0x7c1302f (0x8b9e bytes) 2019-12-16T22:45:46.891 INFO:teuthology.orchestra.run.smithi177.stdout:1464 writesame 0xdf45326 thru 0xdf5415f data_size 0x1(0xee3a bytes) 2019-12-16T22:45:46.891 INFO:teuthology.orchestra.run.smithi177.stdout:1465 trunc from 0xdf54160 to 0xe842e46 2019-12-16T22:45:46.894 INFO:teuthology.orchestra.run.smithi177.stdout:1304 write 0x733e378 thru 0x734516b (0x6df4 bytes) 2019-12-16T22:45:46.901 INFO:teuthology.orchestra.run.smithi177.stdout:1305 read 0x6fc8a29 thru 0x6fd3792 (0xad6a bytes) 2019-12-16T22:45:46.902 INFO:teuthology.orchestra.run.smithi177.stdout:1307 writesame 0x7165c62 thru 0x716a6cd data_size 0x16(0x4a6c bytes) 2019-12-16T22:45:46.908 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.911 INFO:teuthology.orchestra.run.smithi177.stdout:1466 writesame 0x96099e6 thru 0x960bdcd data_size 0xc(0x23e8 bytes) 2019-12-16T22:45:46.913 INFO:teuthology.orchestra.run.smithi177.stdout:1486 write 0xcdb2e1d thru 0xcdb3d71 (0xf55 bytes) 2019-12-16T22:45:46.918 INFO:teuthology.orchestra.run.smithi177.stdout:1310 trunc from 0x734516c to 0xb9dd8d2 2019-12-16T22:45:46.918 INFO:teuthology.orchestra.run.smithi177.stdout:1467 read 0x868b761 thru 0x868c2d7 (0xb77 bytes) 2019-12-16T22:45:46.918 INFO:teuthology.orchestra.run.smithi177.stdout:1468 punch from 0xc4a6e51 to 0xc4adb57, (0x6d06 bytes) 2019-12-16T22:45:46.925 INFO:teuthology.orchestra.run.smithi177.stdout:1487 punch from 0xbf80322 to 0xbf84119, (0x3df7 bytes) 2019-12-16T22:45:46.927 INFO:teuthology.orchestra.run.smithi177.stdout:1473 trunc from 0xe842e46 to 0xaa49a73 2019-12-16T22:45:46.934 INFO:teuthology.orchestra.run.smithi177.stdout:1490 trunc from 0xcdb3d72 to 0x69e6021 2019-12-16T22:45:46.937 INFO:teuthology.orchestra.run.smithi177.stdout:1311 punch from 0xa722040 to 0xa72442d, (0x23ed bytes) 2019-12-16T22:45:46.938 INFO:teuthology.orchestra.run.smithi177.stdout:1312 punch from 0x81f72be to 0x81f7ee1, (0xc23 bytes) 2019-12-16T22:45:46.938 INFO:teuthology.orchestra.run.smithi177.stdout:1313 writesame 0x7ac22b thru 0x7ae5d7 data_size 0x1(0x23ad bytes) 2019-12-16T22:45:46.949 INFO:teuthology.orchestra.run.smithi177.stdout:1314 read 0x97289a8 thru 0x97355e1 (0xcc3a bytes) 2019-12-16T22:45:46.950 INFO:teuthology.orchestra.run.smithi177.stdout:1315 write 0x1b4649a thru 0x1b51623 (0xb18a bytes) 2019-12-16T22:45:46.952 INFO:teuthology.orchestra.run.smithi177.stdout:1474 read 0x267076a thru 0x2673b6b (0x3402 bytes) 2019-12-16T22:45:46.953 INFO:teuthology.orchestra.run.smithi177.stdout:1475 punch from 0x9cfa600 to 0x9cfd7e5, (0x31e5 bytes) 2019-12-16T22:45:46.953 INFO:teuthology.orchestra.run.smithi177.stdout:1476 write 0x709daec thru 0x70a6dd0 (0x92e5 bytes) 2019-12-16T22:45:46.960 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.960 INFO:teuthology.orchestra.run.smithi177.stdout:1319 read 0x2226d5e thru 0x2234685 (0xd928 bytes) 2019-12-16T22:45:46.962 INFO:teuthology.orchestra.run.smithi177.stdout:1320 trunc from 0xb9dd8d2 to 0xadc008c 2019-12-16T22:45:46.968 INFO:teuthology.orchestra.run.smithi177.stdout:1477 trunc from 0xaa49a73 to 0x83d2636 2019-12-16T22:45:46.972 INFO:teuthology.orchestra.run.smithi177.stdout:1491 read 0x1d409f9 thru 0x1d4ffe1 (0xf5e9 bytes) 2019-12-16T22:45:46.972 INFO:teuthology.orchestra.run.smithi177.stdout:1493 writesame 0x5abcbf9 thru 0x5ac40ed data_size 0x1(0x74f5 bytes) 2019-12-16T22:45:46.997 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:46.998 INFO:teuthology.orchestra.run.smithi177.stdout:1496 writesame 0x65c66c4 thru 0x65ce058 data_size 0xf(0x7995 bytes) 2019-12-16T22:45:47.000 INFO:teuthology.orchestra.run.smithi177.stdout:1479 writesame 0x806c3c6 thru 0x8075bc9 data_size 0x8d(0x9804 bytes) 2019-12-16T22:45:47.013 INFO:teuthology.orchestra.run.smithi177.stdout:1480 write 0x108e3b3 thru 0x1090ac3 (0x2711 bytes) 2019-12-16T22:45:47.013 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.013 INFO:teuthology.orchestra.run.smithi177.stdout:1326 write 0xa4f19d thru 0xa59598 (0xa3fc bytes) 2019-12-16T22:45:47.021 INFO:teuthology.orchestra.run.smithi177.stdout:1497 clone 12 order 19 su 16384 sc 8 2019-12-16T22:45:47.031 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.031 INFO:teuthology.orchestra.run.smithi177.stdout:1483 read 0x56299ce thru 0x562ded1 (0x4504 bytes) 2019-12-16T22:45:47.033 INFO:teuthology.orchestra.run.smithi177.stdout:1484 write 0x4321fe thru 0x43d9c9 (0xb7cc bytes) 2019-12-16T22:45:47.043 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.044 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.044 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.044 INFO:teuthology.orchestra.run.smithi177.stdout:1489 write 0x1676e24 thru 0x1677b1b (0xcf8 bytes) 2019-12-16T22:45:47.047 INFO:teuthology.orchestra.run.smithi177.stdout:1490 writesame 0x6778eaf thru 0x677dcf8 data_size 0xb(0x4e4a bytes) 2019-12-16T22:45:47.050 INFO:teuthology.orchestra.run.smithi177.stdout:1327 trunc from 0xadc008c to 0x670560f 2019-12-16T22:45:47.088 INFO:teuthology.orchestra.run.smithi177.stdout:1328 writesame 0x60e5c18 thru 0x60e9a2a data_size 0x1(0x3e13 bytes) 2019-12-16T22:45:47.104 INFO:teuthology.orchestra.run.smithi177.stdout:1491 write 0xecddec6 thru 0xece22a7 (0x43e2 bytes) 2019-12-16T22:45:47.107 INFO:teuthology.orchestra.run.smithi177.stdout:1329 writesame 0x2d25e47 thru 0x2d27589 data_size 0x5(0x1743 bytes) 2019-12-16T22:45:47.113 INFO:teuthology.orchestra.run.smithi177.stdout:1493 read 0x4989c43 thru 0x498e605 (0x49c3 bytes) 2019-12-16T22:45:47.114 INFO:teuthology.orchestra.run.smithi177.stdout:1494 punch from 0x9d32bb0 to 0x9d378a6, (0x4cf6 bytes) 2019-12-16T22:45:47.115 INFO:teuthology.orchestra.run.smithi177.stdout:1330 punch from 0x6074161 to 0x607beca, (0x7d69 bytes) 2019-12-16T22:45:47.116 INFO:teuthology.orchestra.run.smithi177.stdout:1332 writesame 0x36bcfe thru 0x371eee data_size 0x1(0x61f1 bytes) 2019-12-16T22:45:47.136 INFO:teuthology.orchestra.run.smithi177.stdout:1495 trunc from 0xece22a8 to 0x1844584 2019-12-16T22:45:47.153 INFO:teuthology.orchestra.run.smithi177.stdout:1333 read 0x28de957 thru 0x28ee159 (0xf803 bytes) 2019-12-16T22:45:47.154 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.2-clone9 intact 2019-12-16T22:45:47.165 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.1-clone9 2019-12-16T22:45:47.173 INFO:teuthology.orchestra.run.smithi177.stdout:1334 write 0xbeeaaf1 thru 0xbefa96d (0xfe7d bytes) 2019-12-16T22:45:47.182 INFO:teuthology.orchestra.run.smithi177.stdout:1335 read 0x61a173b thru 0x61a9ea0 (0x8766 bytes) 2019-12-16T22:45:47.182 INFO:teuthology.orchestra.run.smithi177.stdout:1336 read 0x3d3eff4 thru 0x3d4109e (0x20ab bytes) 2019-12-16T22:45:47.182 INFO:teuthology.orchestra.run.smithi177.stdout:1337 punch from 0x5545529 to 0x5546995, (0x146c bytes) 2019-12-16T22:45:47.182 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.182 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.182 INFO:teuthology.orchestra.run.smithi177.stdout:1342 write 0x33f5b83 thru 0x33f78ff (0x1d7d bytes) 2019-12-16T22:45:47.188 INFO:teuthology.orchestra.run.smithi177.stdout:1343 punch from 0x15042b to 0x1548c0, (0x4495 bytes) 2019-12-16T22:45:47.188 INFO:teuthology.orchestra.run.smithi177.stdout:1344 write 0x8753eed thru 0x8758348 (0x445c bytes) 2019-12-16T22:45:47.190 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone13 from 0xd2a6df3 (overlap 0x708d9c) to 0x1682b8 2019-12-16T22:45:47.201 INFO:teuthology.orchestra.run.smithi177.stdout:1496 write 0x80dd056 thru 0x80de321 (0x12cc bytes) 2019-12-16T22:45:47.216 INFO:teuthology.orchestra.run.smithi177.stdout:1346 trunc from 0xbefa96e to 0x196f658 2019-12-16T22:45:47.238 INFO:teuthology.orchestra.run.smithi177.stdout:1497 writesame 0xd92bd04 thru 0xd935f42 data_size 0xf(0xa23f bytes) 2019-12-16T22:45:47.240 INFO:teuthology.orchestra.run.smithi177.stdout:1498 write 0x2f48d45 thru 0x2f5188d (0x8b49 bytes) 2019-12-16T22:45:47.241 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.241 INFO:teuthology.orchestra.run.smithi177.stdout:1348 write 0x15ba31e thru 0x15c2a01 (0x86e4 bytes) 2019-12-16T22:45:47.252 INFO:teuthology.orchestra.run.smithi177.stdout:1500 read 0x723c768 thru 0x7242a9e (0x6337 bytes) 2019-12-16T22:45:47.254 INFO:teuthology.orchestra.run.smithi177.stdout:1350 read 0x16b31ac thru 0x16bc983 (0x97d8 bytes) 2019-12-16T22:45:47.254 INFO:teuthology.orchestra.run.smithi177.stdout:1351 read 0x162b0d9 thru 0x163a4c1 (0xf3e9 bytes) 2019-12-16T22:45:47.254 INFO:teuthology.orchestra.run.smithi177.stdout:1352 punch from 0x106eae7 to 0x1072962, (0x3e7b bytes) 2019-12-16T22:45:47.254 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.255 INFO:teuthology.orchestra.run.smithi177.stdout:1354 read 0xaa104a thru 0xaa31c2 (0x2179 bytes) 2019-12-16T22:45:47.277 INFO:teuthology.orchestra.run.smithi177.stdout:1501 trunc from 0xd935f43 to 0x4820c07 2019-12-16T22:45:47.277 INFO:teuthology.orchestra.run.smithi177.stdout:1355 writesame 0x3c0668c thru 0x3c0d7b6 data_size 0x9(0x712b bytes) 2019-12-16T22:45:47.294 INFO:teuthology.orchestra.run.smithi177.stdout:1502 read 0x199ab7 thru 0x19afd3 (0x151d bytes) 2019-12-16T22:45:47.294 INFO:teuthology.orchestra.run.smithi177.stdout:1504 read 0x40bcde3 thru 0x40bd865 (0xa83 bytes) 2019-12-16T22:45:47.296 INFO:teuthology.orchestra.run.smithi177.stdout:1505 writesame 0x2d2b24d thru 0x2d37d62 data_size 0xf(0xcb16 bytes) 2019-12-16T22:45:47.296 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #8, image image_cluster1.client.mirror.2-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent9 2019-12-16T22:45:47.305 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.309 INFO:teuthology.orchestra.run.smithi177.stdout:1357 write 0xa4aa754 thru 0xa4af018 (0x48c5 bytes) 2019-12-16T22:45:47.316 INFO:teuthology.orchestra.run.smithi177.stdout:1359 punch from 0xdc5d97 to 0xdd48fe, (0xeb67 bytes) 2019-12-16T22:45:47.316 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.316 INFO:teuthology.orchestra.run.smithi177.stdout:1361 read 0x7625635 thru 0x7627960 (0x232c bytes) 2019-12-16T22:45:47.337 INFO:teuthology.orchestra.run.smithi177.stdout:1362 trunc from 0xa4af019 to 0xd74531 2019-12-16T22:45:47.337 INFO:teuthology.orchestra.run.smithi177.stdout:1508 writesame 0x9686466 thru 0x968c0b9 data_size 0x26(0x5c54 bytes) 2019-12-16T22:45:47.337 INFO:teuthology.orchestra.run.smithi177.stdout:1509 write 0x77006da thru 0x7708975 (0x829c bytes) 2019-12-16T22:45:47.347 INFO:teuthology.orchestra.run.smithi177.stdout:1510 write 0x47ad6e3 thru 0x47bd615 (0xff33 bytes) 2019-12-16T22:45:47.354 INFO:teuthology.orchestra.run.smithi177.stdout:1513 write 0x76f01de thru 0x76f4625 (0x4448 bytes) 2019-12-16T22:45:47.367 INFO:teuthology.orchestra.run.smithi177.stdout:1514 trunc from 0x968c0ba to 0xc810012 2019-12-16T22:45:47.384 INFO:teuthology.orchestra.run.smithi177.stdout:1363 writesame 0x149155e thru 0x149b796 data_size 0x6d(0xa239 bytes) 2019-12-16T22:45:47.391 INFO:teuthology.orchestra.run.smithi177.stdout:1517 punch from 0x8ae26dd to 0x8aeb92d, (0x9250 bytes) 2019-12-16T22:45:47.392 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.392 INFO:teuthology.orchestra.run.smithi177.stdout:1520 read 0xa4bb1b7 thru 0xa4bca33 (0x187d bytes) 2019-12-16T22:45:47.392 INFO:teuthology.orchestra.run.smithi177.stdout:1521 read 0x7438c88 thru 0x743c6a5 (0x3a1e bytes) 2019-12-16T22:45:47.392 INFO:teuthology.orchestra.run.smithi177.stdout:1522 punch from 0x2683ff2 to 0x2693123, (0xf131 bytes) 2019-12-16T22:45:47.411 INFO:teuthology.orchestra.run.smithi177.stdout:1364 writesame 0x4ec6b14 thru 0x4ecbccd data_size 0x21(0x51ba bytes) 2019-12-16T22:45:47.411 INFO:teuthology.orchestra.run.smithi177.stdout:1524 trunc from 0xc810012 to 0x966a99 2019-12-16T22:45:47.412 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #8, image image_cluster1.client.mirror.1-clone8 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent9 2019-12-16T22:45:47.413 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.443 INFO:teuthology.orchestra.run.smithi177.stdout:1369 writesame 0x7271b1e thru 0x7278d67 data_size 0x1(0x724a bytes) 2019-12-16T22:45:47.450 INFO:teuthology.orchestra.run.smithi177.stdout:1370 trunc from 0x7278d68 to 0x92591dd 2019-12-16T22:45:47.454 INFO:teuthology.orchestra.run.smithi177.stdout:1526 punch from 0x6eca0a to 0x6f9d4e, (0xd344 bytes) 2019-12-16T22:45:47.472 INFO:teuthology.orchestra.run.smithi177.stdout:1527 write 0x2bbb8f5 thru 0x2bbc87c (0xf88 bytes) 2019-12-16T22:45:47.476 INFO:teuthology.orchestra.run.smithi177.stdout:1371 trunc from 0x92591dd to 0x744bcfb 2019-12-16T22:45:47.477 INFO:teuthology.orchestra.run.smithi177.stdout:1528 read 0x7b832 thru 0x87de9 (0xc5b8 bytes) 2019-12-16T22:45:47.491 INFO:teuthology.orchestra.run.smithi177.stdout:1372 write 0x6931847 thru 0x693311f (0x18d9 bytes) 2019-12-16T22:45:47.495 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.495 INFO:teuthology.orchestra.run.smithi177.stdout:2010 write 0x489f940 thru 0x48aebbd (0xf27e bytes) 2019-12-16T22:45:47.495 INFO:teuthology.orchestra.run.smithi177.stdout:1530 write 0x32d8dd8 thru 0x32e61a4 (0xd3cd bytes) 2019-12-16T22:45:47.505 INFO:teuthology.orchestra.run.smithi177.stdout:1373 write 0x7183dc6 thru 0x7193a3e (0xfc79 bytes) 2019-12-16T22:45:47.512 INFO:teuthology.orchestra.run.smithi177.stdout:1374 write 0x457d587 thru 0x458d4de (0xff58 bytes) 2019-12-16T22:45:47.530 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.530 INFO:teuthology.orchestra.run.smithi177.stdout:2012 write 0x71d9d7a thru 0x71e18c2 (0x7b49 bytes) 2019-12-16T22:45:47.535 INFO:teuthology.orchestra.run.smithi177.stdout:2013 read 0x5aaff8b thru 0x5abdc8f (0xdd05 bytes) 2019-12-16T22:45:47.536 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.536 INFO:teuthology.orchestra.run.smithi177.stdout:2016 read 0xe4d4e60 thru 0xe4dfe3b (0xafdc bytes) 2019-12-16T22:45:47.537 INFO:teuthology.orchestra.run.smithi177.stdout:2017 write 0x85c7152 thru 0x85d0d7e (0x9c2d bytes) 2019-12-16T22:45:47.547 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.550 INFO:teuthology.orchestra.run.smithi177.stdout:2019 trunc from 0xe9e7138 to 0xcaf378b 2019-12-16T22:45:47.553 INFO:teuthology.orchestra.run.smithi177.stdout:1143 write 0x963a74c thru 0x964052a (0x5ddf bytes) 2019-12-16T22:45:47.554 INFO:teuthology.orchestra.run.smithi177.stdout:1531 writesame 0xd312174 thru 0xd319f9f data_size 0x4c(0x7e2c bytes) 2019-12-16T22:45:47.556 INFO:teuthology.orchestra.run.smithi177.stdout:1532 write 0x847529b thru 0x8478419 (0x317f bytes) 2019-12-16T22:45:47.562 INFO:teuthology.orchestra.run.smithi177.stdout:1375 writesame 0xa68c975 thru 0xa694f73 data_size 0x1(0x85ff bytes) 2019-12-16T22:45:47.571 INFO:teuthology.orchestra.run.smithi177.stdout:1533 write 0x73e69a thru 0x7472f7 (0x8c5e bytes) 2019-12-16T22:45:47.571 INFO:teuthology.orchestra.run.smithi177.stdout:1376 write 0x998d344 thru 0x99996ed (0xc3aa bytes) 2019-12-16T22:45:47.580 INFO:teuthology.orchestra.run.smithi177.stdout:1535 read 0xd21d30d thru 0xd228a1e (0xb712 bytes) 2019-12-16T22:45:47.583 INFO:teuthology.orchestra.run.smithi177.stdout:1377 write 0x93f6830 thru 0x93fdaf3 (0x72c4 bytes) 2019-12-16T22:45:47.591 INFO:teuthology.orchestra.run.smithi177.stdout:1379 read 0x5f0f79f thru 0x5f13ef7 (0x4759 bytes) 2019-12-16T22:45:47.592 INFO:teuthology.orchestra.run.smithi177.stdout:2020 write 0xa78268e thru 0xa78813f (0x5ab2 bytes) 2019-12-16T22:45:47.594 INFO:teuthology.orchestra.run.smithi177.stdout:1536 trunc from 0xd319fa0 to 0x730de90 2019-12-16T22:45:47.595 INFO:teuthology.orchestra.run.smithi177.stdout:1146 writesame 0xa2e9622 thru 0xa2f8bca data_size 0x1(0xf5a9 bytes) 2019-12-16T22:45:47.598 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.600 INFO:teuthology.orchestra.run.smithi177.stdout:2021 writesame 0x9032af6 thru 0x903e521 data_size 0xa(0xba2c bytes) 2019-12-16T22:45:47.600 INFO:teuthology.orchestra.run.smithi177.stdout:1149 trunc from 0xa2f8bcb to 0x897f6cf 2019-12-16T22:45:47.614 INFO:teuthology.orchestra.run.smithi177.stdout:2022 write 0x75293d5 thru 0x752efe2 (0x5c0e bytes) 2019-12-16T22:45:47.616 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #12, image image_cluster1.client.mirror.0-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent13 2019-12-16T22:45:47.626 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.626 INFO:teuthology.orchestra.run.smithi177.stdout:1539 write 0x3368e74 thru 0x336b824 (0x29b1 bytes) 2019-12-16T22:45:47.626 INFO:teuthology.orchestra.run.smithi177.stdout:1380 write 0xcd37242 thru 0xcd3a914 (0x36d3 bytes) 2019-12-16T22:45:47.660 INFO:teuthology.orchestra.run.smithi177.stdout:1382 trunc from 0xcd3a915 to 0x15025ef 2019-12-16T22:45:47.687 INFO:teuthology.orchestra.run.smithi177.stdout:2023 write 0xe4d6cb9 thru 0xe4e3bd5 (0xcf1d bytes) 2019-12-16T22:45:47.691 INFO:teuthology.orchestra.run.smithi177.stdout:1540 write 0xdb67899 thru 0xdb7118b (0x98f3 bytes) 2019-12-16T22:45:47.702 INFO:teuthology.orchestra.run.smithi177.stdout:1541 punch from 0x2e54ba9 to 0x2e633df, (0xe836 bytes) 2019-12-16T22:45:47.702 INFO:teuthology.orchestra.run.smithi177.stdout:1542 punch from 0x4e7242a to 0x4e7d66a, (0xb240 bytes) 2019-12-16T22:45:47.702 INFO:teuthology.orchestra.run.smithi177.stdout:1543 write 0x7d3df06 thru 0x7d3f08b (0x1186 bytes) 2019-12-16T22:45:47.704 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.704 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.710 INFO:teuthology.orchestra.run.smithi177.stdout:1544 write 0x35a0ebb thru 0x35a451a (0x3660 bytes) 2019-12-16T22:45:47.712 INFO:teuthology.orchestra.run.smithi177.stdout:2026 trunc from 0xe4e3bd6 to 0x8057c1b 2019-12-16T22:45:47.715 INFO:teuthology.orchestra.run.smithi177.stdout:1546 writesame 0xa21c767 thru 0xa227a67 data_size 0x4b(0xb301 bytes) 2019-12-16T22:45:47.717 INFO:teuthology.orchestra.run.smithi177.stdout:1383 trunc from 0x15025ef to 0xc7d090 2019-12-16T22:45:47.718 INFO:teuthology.orchestra.run.smithi177.stdout:1152 trunc from 0x897f6cf to 0x1a365b9 2019-12-16T22:45:47.724 INFO:teuthology.orchestra.run.smithi177.stdout:1548 read 0xbcde280 thru 0xbce6207 (0x7f88 bytes) 2019-12-16T22:45:47.725 INFO:teuthology.orchestra.run.smithi177.stdout:1549 write 0x70e60b1 thru 0x70e8516 (0x2466 bytes) 2019-12-16T22:45:47.728 INFO:teuthology.orchestra.run.smithi177.stdout:1615 write 0x2ba70ce thru 0x2bb0240 (0x9173 bytes) 2019-12-16T22:45:47.736 INFO:teuthology.orchestra.run.smithi177.stdout:1551 write 0x38b22a4 thru 0x38b8987 (0x66e4 bytes) 2019-12-16T22:45:47.759 INFO:teuthology.orchestra.run.smithi177.stdout:1385 punch from 0x35ed47 to 0x36dda8, (0xf061 bytes) 2019-12-16T22:45:47.760 INFO:teuthology.orchestra.run.smithi177.stdout:1386 read 0x59050a thru 0x59a910 (0xa407 bytes) 2019-12-16T22:45:47.760 INFO:teuthology.orchestra.run.smithi177.stdout:1387 read 0xab4f4c thru 0xab5d65 (0xe1a bytes) 2019-12-16T22:45:47.760 INFO:teuthology.orchestra.run.smithi177.stdout:1552 writesame 0x8e6fd89 thru 0x8e7d24c data_size 0x6(0xd4c4 bytes) 2019-12-16T22:45:47.774 INFO:teuthology.orchestra.run.smithi177.stdout:1553 read 0x3813afe thru 0x381a5c1 (0x6ac4 bytes) 2019-12-16T22:45:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:1554 read 0x86c6647 thru 0x86d373f (0xd0f9 bytes) 2019-12-16T22:45:47.776 INFO:teuthology.orchestra.run.smithi177.stdout:1555 write 0x5068ba thru 0x50fb3a (0x9281 bytes) 2019-12-16T22:45:47.779 INFO:teuthology.orchestra.run.smithi177.stdout:1616 read 0xb59cc39 thru 0xb5a8290 (0xb658 bytes) 2019-12-16T22:45:47.779 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.779 INFO:teuthology.orchestra.run.smithi177.stdout:1618 clone 15 order 23 su 2097152 sc 13 2019-12-16T22:45:47.781 INFO:teuthology.orchestra.run.smithi177.stdout:1556 punch from 0xbba5b78 to 0xbba87fd, (0x2c85 bytes) 2019-12-16T22:45:47.781 INFO:teuthology.orchestra.run.smithi177.stdout:1557 punch from 0x91ab522 to 0x91baafa, (0xf5d8 bytes) 2019-12-16T22:45:47.787 INFO:teuthology.orchestra.run.smithi177.stdout:2027 trunc from 0x8057c1b to 0x75fc480 2019-12-16T22:45:47.794 INFO:teuthology.orchestra.run.smithi177.stdout:1558 trunc from 0xdb7118c to 0x758d7b9 2019-12-16T22:45:47.806 INFO:teuthology.orchestra.run.smithi177.stdout:1388 writesame 0xac311ef thru 0xac40722 data_size 0x6(0xf534 bytes) 2019-12-16T22:45:47.811 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.812 INFO:teuthology.orchestra.run.smithi177.stdout:1390 read 0x374a007 thru 0x3754e28 (0xae22 bytes) 2019-12-16T22:45:47.812 INFO:teuthology.orchestra.run.smithi177.stdout:1391 punch from 0x51c543d to 0x51cceef, (0x7ab2 bytes) 2019-12-16T22:45:47.812 INFO:teuthology.orchestra.run.smithi177.stdout:1392 punch from 0x96f097d to 0x96f55ec, (0x4c6f bytes) 2019-12-16T22:45:47.812 INFO:teuthology.orchestra.run.smithi177.stdout:1393 punch from 0x99775da to 0x997a193, (0x2bb9 bytes) 2019-12-16T22:45:47.818 INFO:teuthology.orchestra.run.smithi177.stdout:2028 read 0x6bffc96 thru 0x6c0f09a (0xf405 bytes) 2019-12-16T22:45:47.818 INFO:teuthology.orchestra.run.smithi177.stdout:2030 punch from 0x57bb7a1 to 0x57ca57b, (0xedda bytes) 2019-12-16T22:45:47.819 INFO:teuthology.orchestra.run.smithi177.stdout:2031 read 0x59d6c3f thru 0x59dca16 (0x5dd8 bytes) 2019-12-16T22:45:47.819 INFO:teuthology.orchestra.run.smithi177.stdout:2032 write 0x615699b thru 0x6165bc6 (0xf22c bytes) 2019-12-16T22:45:47.825 INFO:teuthology.orchestra.run.smithi177.stdout:1154 punch from 0x25280f to 0x2555d2, (0x2dc3 bytes) 2019-12-16T22:45:47.825 INFO:teuthology.orchestra.run.smithi177.stdout:1155 read 0xaae74 thru 0xb376b (0x88f8 bytes) 2019-12-16T22:45:47.834 INFO:teuthology.orchestra.run.smithi177.stdout:1394 write 0xb760c7f thru 0xb760e92 (0x214 bytes) 2019-12-16T22:45:47.850 INFO:teuthology.orchestra.run.smithi177.stdout:1157 write 0x42d7132 thru 0x42db266 (0x4135 bytes) 2019-12-16T22:45:47.854 INFO:teuthology.orchestra.run.smithi177.stdout:1560 write 0xa7018a7 thru 0xa708311 (0x6a6b bytes) 2019-12-16T22:45:47.858 INFO:teuthology.orchestra.run.smithi177.stdout:1158 read 0x2a1e1f7 thru 0x2a2530a (0x7114 bytes) 2019-12-16T22:45:47.858 INFO:teuthology.orchestra.run.smithi177.stdout:1159 punch from 0xeb8d24 to 0xec8724, (0xfa00 bytes) 2019-12-16T22:45:47.863 INFO:teuthology.orchestra.run.smithi177.stdout:2033 write 0xa95fd79 thru 0xa96439a (0x4622 bytes) 2019-12-16T22:45:47.869 INFO:teuthology.orchestra.run.smithi177.stdout:1395 write 0xd8a8d62 thru 0xd8b249c (0x973b bytes) 2019-12-16T22:45:47.872 INFO:teuthology.orchestra.run.smithi177.stdout:2034 writesame 0x75946cc thru 0x75a09b8 data_size 0x1(0xc2ed bytes) 2019-12-16T22:45:47.882 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.882 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.883 INFO:teuthology.orchestra.run.smithi177.stdout:1400 punch from 0x49da5a5 to 0x49dd94e, (0x33a9 bytes) 2019-12-16T22:45:47.883 INFO:teuthology.orchestra.run.smithi177.stdout:1401 punch from 0xf5f27c to 0xf6bd83, (0xcb07 bytes) 2019-12-16T22:45:47.883 INFO:teuthology.orchestra.run.smithi177.stdout:1402 writesame 0x8a1d675 thru 0x8a27642 data_size 0x5(0x9fce bytes) 2019-12-16T22:45:47.887 INFO:teuthology.orchestra.run.smithi177.stdout:1160 write 0x5445548 thru 0x544ee15 (0x98ce bytes) 2019-12-16T22:45:47.914 INFO:teuthology.orchestra.run.smithi177.stdout:1404 punch from 0xc15bbe3 to 0xc1679fe, (0xbe1b bytes) 2019-12-16T22:45:47.914 INFO:teuthology.orchestra.run.smithi177.stdout:1405 punch from 0x5abdd8 to 0x5b36ac, (0x78d4 bytes) 2019-12-16T22:45:47.914 INFO:teuthology.orchestra.run.smithi177.stdout:1407 writesame 0x84f650 thru 0x84fef2 data_size 0xb(0x8a3 bytes) 2019-12-16T22:45:47.923 INFO:teuthology.orchestra.run.smithi177.stdout:1408 punch from 0x2c4d13a to 0x2c57fd9, (0xae9f bytes) 2019-12-16T22:45:47.923 INFO:teuthology.orchestra.run.smithi177.stdout:1409 write 0x2a198d8 thru 0x2a291b7 (0xf8e0 bytes) 2019-12-16T22:45:47.927 INFO:teuthology.orchestra.run.smithi177.stdout:1561 write 0xbeb8d66 thru 0xbebfb80 (0x6e1b bytes) 2019-12-16T22:45:47.937 INFO:teuthology.orchestra.run.smithi177.stdout:1410 write 0x589ae45 thru 0x58a6adc (0xbc98 bytes) 2019-12-16T22:45:47.940 INFO:teuthology.orchestra.run.smithi177.stdout:1563 write 0x1338d4a thru 0x1342e94 (0xa14b bytes) 2019-12-16T22:45:47.948 INFO:teuthology.orchestra.run.smithi177.stdout:1411 read 0xacf51e4 thru 0xacf9528 (0x4345 bytes) 2019-12-16T22:45:47.948 INFO:teuthology.orchestra.run.smithi177.stdout:1412 writesame 0xd1ba665 thru 0xd1ca321 data_size 0x75(0xfcbd bytes) 2019-12-16T22:45:47.949 INFO:teuthology.orchestra.run.smithi177.stdout:2035 writesame 0xd38e94a thru 0xd397867 data_size 0x7(0x8f1e bytes) 2019-12-16T22:45:47.949 INFO:teuthology.orchestra.run.smithi177.stdout:1565 write 0x4a3a21d thru 0x4a3e43a (0x421e bytes) 2019-12-16T22:45:47.951 INFO:teuthology.orchestra.run.smithi177.stdout:2036 read 0x8abccb0 thru 0x8ac091a (0x3c6b bytes) 2019-12-16T22:45:47.951 INFO:teuthology.orchestra.run.smithi177.stdout:2037 write 0x3c7b2c3 thru 0x3c8a5ce (0xf30c bytes) 2019-12-16T22:45:47.956 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:47.957 INFO:teuthology.orchestra.run.smithi177.stdout:1415 read 0xe89f0 thru 0xebfda (0x35eb bytes) 2019-12-16T22:45:47.957 INFO:teuthology.orchestra.run.smithi177.stdout:1416 writesame 0x8fc5acc thru 0x8fcb1f1 data_size 0x2e(0x5726 bytes) 2019-12-16T22:45:47.959 INFO:teuthology.orchestra.run.smithi177.stdout:1567 read 0x2ccd4d9 thru 0x2cd883e (0xb366 bytes) 2019-12-16T22:45:47.960 INFO:teuthology.orchestra.run.smithi177.stdout:1568 write 0x203e744 thru 0x203e89c (0x159 bytes) 2019-12-16T22:45:47.982 INFO:teuthology.orchestra.run.smithi177.stdout:1161 write 0xc05925c thru 0xc061870 (0x8615 bytes) 2019-12-16T22:45:47.983 INFO:teuthology.orchestra.run.smithi177.stdout:1569 write 0x7ab5075 thru 0x7abeb64 (0x9af0 bytes) 2019-12-16T22:45:47.983 INFO:teuthology.orchestra.run.smithi177.stdout:2038 trunc from 0xd397868 to 0xedf8ff 2019-12-16T22:45:47.993 INFO:teuthology.orchestra.run.smithi177.stdout:1417 write 0x7e94671 thru 0x7e9d242 (0x8bd2 bytes) 2019-12-16T22:45:48.004 INFO:teuthology.orchestra.run.smithi177.stdout:1570 punch from 0x66f966d to 0x6703ebc, (0xa84f bytes) 2019-12-16T22:45:48.004 INFO:teuthology.orchestra.run.smithi177.stdout:1571 punch from 0x2573f95 to 0x257eef0, (0xaf5b bytes) 2019-12-16T22:45:48.005 INFO:teuthology.orchestra.run.smithi177.stdout:1572 read 0xb6481e thru 0xb70644 (0xbe27 bytes) 2019-12-16T22:45:48.005 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.005 INFO:teuthology.orchestra.run.smithi177.stdout:1574 writesame 0x1d3ff14 thru 0x1d4653f data_size 0x4(0x662c bytes) 2019-12-16T22:45:48.029 INFO:teuthology.orchestra.run.smithi177.stdout:1576 trunc from 0xbebfb81 to 0xe2751e1 2019-12-16T22:45:48.042 INFO:teuthology.orchestra.run.smithi177.stdout:1163 write 0xcbd8c49 thru 0xcbe46fb (0xbab3 bytes) 2019-12-16T22:45:48.051 INFO:teuthology.orchestra.run.smithi177.stdout:1418 write 0xdeac84f thru 0xdeb454d (0x7cff bytes) 2019-12-16T22:45:48.059 INFO:teuthology.orchestra.run.smithi177.stdout:1419 write 0xb9a8288 thru 0xb9b8210 (0xff89 bytes) 2019-12-16T22:45:48.059 INFO:teuthology.orchestra.run.smithi177.stdout:1577 write 0xd1a2bea thru 0xd1ad7eb (0xac02 bytes) 2019-12-16T22:45:48.071 INFO:teuthology.orchestra.run.smithi177.stdout:1581 write 0xb83c13e thru 0xb848df9 (0xccbc bytes) 2019-12-16T22:45:48.075 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.081 INFO:teuthology.orchestra.run.smithi177.stdout:1165 writesame 0xd4eab06 thru 0xd4f15a8 data_size 0x1(0x6aa3 bytes) 2019-12-16T22:45:48.083 INFO:teuthology.orchestra.run.smithi177.stdout:1584 read 0xc4940e9 thru 0xc4a184d (0xd765 bytes) 2019-12-16T22:45:48.083 INFO:teuthology.orchestra.run.smithi177.stdout:1585 read 0x21bab15 thru 0x21be3dc (0x38c8 bytes) 2019-12-16T22:45:48.084 INFO:teuthology.orchestra.run.smithi177.stdout:1166 read 0x91ca320 thru 0x91d9af1 (0xf7d2 bytes) 2019-12-16T22:45:48.084 INFO:teuthology.orchestra.run.smithi177.stdout:1167 write 0x3deda3a thru 0x3def7de (0x1da5 bytes) 2019-12-16T22:45:48.084 INFO:teuthology.orchestra.run.smithi177.stdout:1586 writesame 0x97cf013 thru 0x97d8a16 data_size 0x2(0x9a04 bytes) 2019-12-16T22:45:48.094 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.094 INFO:teuthology.orchestra.run.smithi177.stdout:1169 write 0x8b12b36 thru 0x8b18207 (0x56d2 bytes) 2019-12-16T22:45:48.108 INFO:teuthology.orchestra.run.smithi177.stdout:1588 writesame 0xdf7a465 thru 0xdf850f1 data_size 0x1(0xac8d bytes) 2019-12-16T22:45:48.111 INFO:teuthology.orchestra.run.smithi177.stdout:1421 write 0xe63cd27 thru 0xe64abd6 (0xdeb0 bytes) 2019-12-16T22:45:48.116 INFO:teuthology.orchestra.run.smithi177.stdout:2039 write 0xed4b37f thru 0xed59c5e (0xe8e0 bytes) 2019-12-16T22:45:48.129 INFO:teuthology.orchestra.run.smithi177.stdout:1170 trunc from 0xd4f15a9 to 0x32c0537 2019-12-16T22:45:48.140 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xeddb469 2019-12-16T22:45:48.140 INFO:teuthology.orchestra.run.smithi177.stdout:2040 trunc from 0xed59c5f to 0xeddb469 2019-12-16T22:45:48.149 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.149 INFO:teuthology.orchestra.run.smithi177.stdout:1590 write 0x4a86a10 thru 0x4a93eaa (0xd49b bytes) 2019-12-16T22:45:48.156 INFO:teuthology.orchestra.run.smithi177.stdout:1423 writesame 0x93e0db8 thru 0x93e1241 data_size 0x7(0x48a bytes) 2019-12-16T22:45:48.158 INFO:teuthology.orchestra.run.smithi177.stdout:1591 read 0xcac72bd thru 0xcac7d1d (0xa61 bytes) 2019-12-16T22:45:48.159 INFO:teuthology.orchestra.run.smithi177.stdout:1592 read 0x29d9ed9 thru 0x29e4e6c (0xaf94 bytes) 2019-12-16T22:45:48.159 INFO:teuthology.orchestra.run.smithi177.stdout:1594 read 0x932fd2c thru 0x93326c3 (0x2998 bytes) 2019-12-16T22:45:48.159 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.164 INFO:teuthology.orchestra.run.smithi177.stdout:2041 writesame 0xc7604d0 thru 0xc764a81 data_size 0xb(0x45b2 bytes) 2019-12-16T22:45:48.164 INFO:teuthology.orchestra.run.smithi177.stdout:1424 read 0xb9a66f7 thru 0xb9aa0d6 (0x39e0 bytes) 2019-12-16T22:45:48.165 INFO:teuthology.orchestra.run.smithi177.stdout:1426 writesame 0x353f0bf thru 0x354b116 data_size 0x14(0xc058 bytes) 2019-12-16T22:45:48.167 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone11 from 0x69e6021 (overlap 0x2311cf) to 0x1f9007 2019-12-16T22:45:48.172 INFO:teuthology.orchestra.run.smithi177.stdout:2042 write 0xbcb140f thru 0xbcb5e6a (0x4a5c bytes) 2019-12-16T22:45:48.177 INFO:teuthology.orchestra.run.smithi177.stdout:1427 write 0xe24d6b5 thru 0xe24eb0b (0x1457 bytes) 2019-12-16T22:45:48.182 INFO:teuthology.orchestra.run.smithi177.stdout:2043 read 0x6414cb7 thru 0x641aeb9 (0x6203 bytes) 2019-12-16T22:45:48.184 INFO:teuthology.orchestra.run.smithi177.stdout:2044 punch from 0xa8b49cc to 0xa8beb14, (0xa148 bytes) 2019-12-16T22:45:48.184 INFO:teuthology.orchestra.run.smithi177.stdout:2046 read 0x18d53a3 thru 0x18da17b (0x4dd9 bytes) 2019-12-16T22:45:48.184 INFO:teuthology.orchestra.run.smithi177.stdout:2047 punch from 0x97d44ab to 0x97ddac0, (0x9615 bytes) 2019-12-16T22:45:48.185 INFO:teuthology.orchestra.run.smithi177.stdout:2048 write 0x845be62 thru 0x84698eb (0xda8a bytes) 2019-12-16T22:45:48.190 INFO:teuthology.orchestra.run.smithi177.stdout:1596 write 0xe97050c thru 0xe97b0b9 (0xabae bytes) 2019-12-16T22:45:48.198 INFO:teuthology.orchestra.run.smithi177.stdout:1428 read 0x8b6e8c4 thru 0x8b75687 (0x6dc4 bytes) 2019-12-16T22:45:48.200 INFO:teuthology.orchestra.run.smithi177.stdout:2049 read 0xca9062 thru 0xcb3b72 (0xab11 bytes) 2019-12-16T22:45:48.200 INFO:teuthology.orchestra.run.smithi177.stdout:2050 writesame 0x1f5ecd8 thru 0x1f67f3e data_size 0xd(0x9267 bytes) 2019-12-16T22:45:48.203 INFO:teuthology.orchestra.run.smithi177.stdout:1430 trunc from 0xe64abd7 to 0xc256fb7 2019-12-16T22:45:48.208 INFO:teuthology.orchestra.run.smithi177.stdout:2051 read 0x3d0df29 thru 0x3d1cbb1 (0xec89 bytes) 2019-12-16T22:45:48.209 INFO:teuthology.orchestra.run.smithi177.stdout:2053 read 0x2d7fbb thru 0x2e450b (0xc551 bytes) 2019-12-16T22:45:48.210 INFO:teuthology.orchestra.run.smithi177.stdout:2055 writesame 0x755d375 thru 0x7567cb6 data_size 0x23(0xa942 bytes) 2019-12-16T22:45:48.215 INFO:teuthology.orchestra.run.smithi177.stdout:1597 trunc from 0xe97b0ba to 0x9d2f209 2019-12-16T22:45:48.220 INFO:teuthology.orchestra.run.smithi177.stdout:2056 writesame 0xe05a2ff thru 0xe05b5cc data_size 0x2(0x12ce bytes) 2019-12-16T22:45:48.222 INFO:teuthology.orchestra.run.smithi177.stdout:1171 write 0xe0694ef thru 0xe06b080 (0x1b92 bytes) 2019-12-16T22:45:48.247 INFO:teuthology.orchestra.run.smithi177.stdout:2057 punch from 0xd98ba32 to 0xd98e3df, (0x29ad bytes) 2019-12-16T22:45:48.247 INFO:teuthology.orchestra.run.smithi177.stdout:2058 write 0x8384c0f thru 0x83897b5 (0x4ba7 bytes) 2019-12-16T22:45:48.247 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.247 INFO:teuthology.orchestra.run.smithi177.stdout:2060 read 0xb0ff898 thru 0xb10d0e1 (0xd84a bytes) 2019-12-16T22:45:48.248 INFO:teuthology.orchestra.run.smithi177.stdout:2061 write 0x9c0d2be thru 0x9c1a24b (0xcf8e bytes) 2019-12-16T22:45:48.248 INFO:teuthology.orchestra.run.smithi177.stdout:1172 read 0xdce10d6 thru 0xdce6e16 (0x5d41 bytes) 2019-12-16T22:45:48.248 INFO:teuthology.orchestra.run.smithi177.stdout:1173 writesame 0xdf5502f thru 0xdf63d90 data_size 0xa(0xed62 bytes) 2019-12-16T22:45:48.252 INFO:teuthology.orchestra.run.smithi177.stdout:1174 read 0x5c76cc9 thru 0x5c7f801 (0x8b39 bytes) 2019-12-16T22:45:48.252 INFO:teuthology.orchestra.run.smithi177.stdout:1178 read 0x26fc66f thru 0x26fec3c (0x25ce bytes) 2019-12-16T22:45:48.252 INFO:teuthology.orchestra.run.smithi177.stdout:1180 write 0x3d736e3 thru 0x3d7dfe0 (0xa8fe bytes) 2019-12-16T22:45:48.253 INFO:teuthology.orchestra.run.smithi177.stdout:2064 read 0x731c28 thru 0x737ffc (0x63d5 bytes) 2019-12-16T22:45:48.253 INFO:teuthology.orchestra.run.smithi177.stdout:2065 write 0x300f31 thru 0x3063d2 (0x54a2 bytes) 2019-12-16T22:45:48.256 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.256 INFO:teuthology.orchestra.run.smithi177.stdout:1433 writesame 0xb11e5c0 thru 0xb121f0a data_size 0x1(0x394b bytes) 2019-12-16T22:45:48.259 INFO:teuthology.orchestra.run.smithi177.stdout:2067 writesame 0x14abe2a thru 0x14bba20 data_size 0x9(0xfbf7 bytes) 2019-12-16T22:45:48.261 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.261 INFO:teuthology.orchestra.run.smithi177.stdout:1599 read 0x7d75a74 thru 0x7d83abf (0xe04c bytes) 2019-12-16T22:45:48.262 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.262 INFO:teuthology.orchestra.run.smithi177.stdout:1184 punch from 0xaeded02 to 0xaee18ec, (0x2bea bytes) 2019-12-16T22:45:48.262 INFO:teuthology.orchestra.run.smithi177.stdout:1185 writesame 0x513bd1f thru 0x514b306 data_size 0x8(0xf5e8 bytes) 2019-12-16T22:45:48.262 INFO:teuthology.orchestra.run.smithi177.stdout:1602 write 0x7df4aa9 thru 0x7e0225b (0xd7b3 bytes) 2019-12-16T22:45:48.269 INFO:teuthology.orchestra.run.smithi177.stdout:2068 read 0x6333f21 thru 0x6334452 (0x532 bytes) 2019-12-16T22:45:48.269 INFO:teuthology.orchestra.run.smithi177.stdout:2069 write 0x31402f6 thru 0x314c6a7 (0xc3b2 bytes) 2019-12-16T22:45:48.270 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.0-clone14 2019-12-16T22:45:48.277 INFO:teuthology.orchestra.run.smithi177.stdout:1434 read 0xab28448 thru 0xab2c809 (0x43c2 bytes) 2019-12-16T22:45:48.286 INFO:teuthology.orchestra.run.smithi177.stdout:2071 write 0xd7c3e33 thru 0xd7c814f (0x431d bytes) 2019-12-16T22:45:48.290 INFO:teuthology.orchestra.run.smithi177.stdout:1604 punch from 0xfb1248 to 0xfc0f62, (0xfd1a bytes) 2019-12-16T22:45:48.290 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.290 INFO:teuthology.orchestra.run.smithi177.stdout:1606 punch from 0x287ad0c to 0x2886bcd, (0xbec1 bytes) 2019-12-16T22:45:48.302 INFO:teuthology.orchestra.run.smithi177.stdout:1186 read 0x4bffc44 thru 0x4c063bf (0x677c bytes) 2019-12-16T22:45:48.302 INFO:teuthology.orchestra.run.smithi177.stdout:1187 read 0x1721fd thru 0x1789e0 (0x67e4 bytes) 2019-12-16T22:45:48.305 INFO:teuthology.orchestra.run.smithi177.stdout:1188 writesame 0x6455846 thru 0x64622bb data_size 0x49(0xca76 bytes) 2019-12-16T22:45:48.305 INFO:teuthology.orchestra.run.smithi177.stdout:2072 write 0xa32ee8b thru 0xa337fe9 (0x915f bytes) 2019-12-16T22:45:48.315 INFO:teuthology.orchestra.run.smithi177.stdout:1189 read 0x63d2323 thru 0x63e1d7b (0xfa59 bytes) 2019-12-16T22:45:48.319 INFO:teuthology.orchestra.run.smithi177.stdout:2073 write 0x2a4cb00 thru 0x2a56e77 (0xa378 bytes) 2019-12-16T22:45:48.328 INFO:teuthology.orchestra.run.smithi177.stdout:1436 writesame 0xc7908c6 thru 0xc79af2d data_size 0x4b(0xa668 bytes) 2019-12-16T22:45:48.329 INFO:teuthology.orchestra.run.smithi177.stdout:1607 write 0xad38edd thru 0xad43e17 (0xaf3b bytes) 2019-12-16T22:45:48.332 INFO:teuthology.orchestra.run.smithi177.stdout:1437 write 0x1a70590 thru 0x1a74aa6 (0x4517 bytes) 2019-12-16T22:45:48.332 INFO:teuthology.orchestra.run.smithi177.stdout:1190 trunc from 0xe06b081 to 0x6e8d095 2019-12-16T22:45:48.341 INFO:teuthology.orchestra.run.smithi177.stdout:1608 flatten 2019-12-16T22:45:48.342 INFO:teuthology.orchestra.run.smithi177.stdout:2075 trunc from 0xeddb469 to 0x7b171b2 2019-12-16T22:45:48.344 INFO:teuthology.orchestra.run.smithi177.stdout:1438 punch from 0x1e07ed5 to 0x1e0df6a, (0x6095 bytes) 2019-12-16T22:45:48.344 INFO:teuthology.orchestra.run.smithi177.stdout:1439 write 0xb0f0b31 thru 0xb0fb68d (0xab5d bytes) 2019-12-16T22:45:48.354 INFO:teuthology.orchestra.run.smithi177.stdout:1440 punch from 0x52f6287 to 0x52fed15, (0x8a8e bytes) 2019-12-16T22:45:48.354 INFO:teuthology.orchestra.run.smithi177.stdout:1441 read 0x20a5e46 thru 0x20b3497 (0xd652 bytes) 2019-12-16T22:45:48.354 INFO:teuthology.orchestra.run.smithi177.stdout:1442 write 0x16cdff3 thru 0x16cee2c (0xe3a bytes) 2019-12-16T22:45:48.359 INFO:teuthology.orchestra.run.smithi177.stdout:1443 writesame 0x37a4584 thru 0x37add22 data_size 0x7(0x979f bytes) 2019-12-16T22:45:48.363 INFO:teuthology.orchestra.run.smithi177.stdout:1609 punch from 0x83e32b0 to 0x83e4379, (0x10c9 bytes) 2019-12-16T22:45:48.364 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.370 INFO:teuthology.orchestra.run.smithi177.stdout:1191 write 0xb3d1ea thru 0xb3d5ca (0x3e1 bytes) 2019-12-16T22:45:48.372 INFO:teuthology.orchestra.run.smithi177.stdout:1444 write 0x987b8db thru 0x9884779 (0x8e9f bytes) 2019-12-16T22:45:48.373 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #10, image image_cluster1.client.mirror.3-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent11 2019-12-16T22:45:48.383 INFO:teuthology.orchestra.run.smithi177.stdout:1192 writesame 0x3534e2e thru 0x3540fcf data_size 0x5(0xc1a2 bytes) 2019-12-16T22:45:48.386 INFO:teuthology.orchestra.run.smithi177.stdout:1445 writesame 0x84d0627 thru 0x84d50a4 data_size 0x5(0x4a7e bytes) 2019-12-16T22:45:48.387 INFO:teuthology.orchestra.run.smithi177.stdout:2076 read 0x304a491 thru 0x305113c (0x6cac bytes) 2019-12-16T22:45:48.388 INFO:teuthology.orchestra.run.smithi177.stdout:1612 write 0xb6267d1 thru 0xb6339f8 (0xd228 bytes) 2019-12-16T22:45:48.399 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.399 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.399 INFO:teuthology.orchestra.run.smithi177.stdout:1448 read 0xc6b4155 thru 0xc6b93a1 (0x524d bytes) 2019-12-16T22:45:48.399 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.399 INFO:teuthology.orchestra.run.smithi177.stdout:1450 punch from 0x53d81b4 to 0x53d8ac3, (0x90f bytes) 2019-12-16T22:45:48.400 INFO:teuthology.orchestra.run.smithi177.stdout:1451 read 0x9a1f9ec thru 0x9a22d6a (0x337f bytes) 2019-12-16T22:45:48.400 INFO:teuthology.orchestra.run.smithi177.stdout:1452 punch from 0xa2ed574 to 0xa2fcded, (0xf879 bytes) 2019-12-16T22:45:48.400 INFO:teuthology.orchestra.run.smithi177.stdout:1454 write 0x9b4a7a4 thru 0x9b4e6a8 (0x3f05 bytes) 2019-12-16T22:45:48.400 INFO:teuthology.orchestra.run.smithi177.stdout:1194 write 0x495a907 thru 0x496a170 (0xf86a bytes) 2019-12-16T22:45:48.400 INFO:teuthology.orchestra.run.smithi177.stdout:1613 write 0x46d49e4 thru 0x46d6652 (0x1c6f bytes) 2019-12-16T22:45:48.409 INFO:teuthology.orchestra.run.smithi177.stdout:1455 read 0x4278091 thru 0x4284edf (0xce4f bytes) 2019-12-16T22:45:48.410 INFO:teuthology.orchestra.run.smithi177.stdout:1615 writesame 0x9eea107 thru 0x9ef4405 data_size 0x7(0xa2ff bytes) 2019-12-16T22:45:48.414 INFO:teuthology.orchestra.run.smithi177.stdout:1456 trunc from 0xc79af2e to 0x98a1bbd 2019-12-16T22:45:48.419 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.419 INFO:teuthology.orchestra.run.smithi177.stdout:1197 read 0x3ba69ab thru 0x3bb1c26 (0xb27c bytes) 2019-12-16T22:45:48.419 INFO:teuthology.orchestra.run.smithi177.stdout:1198 read 0x6b7f418 thru 0x6b84e4e (0x5a37 bytes) 2019-12-16T22:45:48.419 INFO:teuthology.orchestra.run.smithi177.stdout:1617 write 0x43fe540 thru 0x440b2a7 (0xcd68 bytes) 2019-12-16T22:45:48.427 INFO:teuthology.orchestra.run.smithi177.stdout:1618 punch from 0xdf69c to 0xe8e8b, (0x97ef bytes) 2019-12-16T22:45:48.428 INFO:teuthology.orchestra.run.smithi177.stdout:1620 writesame 0x71475b thru 0x71c126 data_size 0xa(0x79cc bytes) 2019-12-16T22:45:48.429 INFO:teuthology.orchestra.run.smithi177.stdout:2077 writesame 0xcf7f51c thru 0xcf87c6a data_size 0x2f(0x874f bytes) 2019-12-16T22:45:48.432 INFO:teuthology.orchestra.run.smithi177.stdout:2078 read 0x6aec0ca thru 0x6af98d0 (0xd807 bytes) 2019-12-16T22:45:48.433 INFO:teuthology.orchestra.run.smithi177.stdout:2079 read 0x438b48f thru 0x438c0cc (0xc3e bytes) 2019-12-16T22:45:48.433 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.434 INFO:teuthology.orchestra.run.smithi177.stdout:2081 write 0x450fb58 thru 0x451f2ec (0xf795 bytes) 2019-12-16T22:45:48.435 INFO:teuthology.orchestra.run.smithi177.stdout:1621 punch from 0x1561139 to 0x156931a, (0x81e1 bytes) 2019-12-16T22:45:48.440 INFO:teuthology.orchestra.run.smithi177.stdout:2082 writesame 0x211772a thru 0x211e479 data_size 0x6a(0x6d50 bytes) 2019-12-16T22:45:48.445 INFO:teuthology.orchestra.run.smithi177.stdout:2083 read 0x51f2f61 thru 0x51f6c35 (0x3cd5 bytes) 2019-12-16T22:45:48.446 INFO:teuthology.orchestra.run.smithi177.stdout:2085 write 0x46003d thru 0x46a4e8 (0xa4ac bytes) 2019-12-16T22:45:48.448 INFO:teuthology.orchestra.run.smithi177.stdout:1622 trunc from 0xb6339f9 to 0x3e61fa0 2019-12-16T22:45:48.460 INFO:teuthology.orchestra.run.smithi177.stdout:1199 write 0xbc08f5b thru 0xbc1121b (0x82c1 bytes) 2019-12-16T22:45:48.462 INFO:teuthology.orchestra.run.smithi177.stdout:2087 trunc from 0xcf87c6b to 0x9693898 2019-12-16T22:45:48.465 INFO:teuthology.orchestra.run.smithi177.stdout:1458 trunc from 0x98a1bbd to 0x303d760 2019-12-16T22:45:48.485 INFO:teuthology.orchestra.run.smithi177.stdout:1200 punch from 0x368978f to 0x368d5bf, (0x3e30 bytes) 2019-12-16T22:45:48.485 INFO:teuthology.orchestra.run.smithi177.stdout:1202 read 0x2f31e40 thru 0x2f3c43e (0xa5ff bytes) 2019-12-16T22:45:48.485 INFO:teuthology.orchestra.run.smithi177.stdout:1203 writesame 0x12eac6b thru 0x12eb154 data_size 0x2(0x4ea bytes) 2019-12-16T22:45:48.501 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.503 INFO:teuthology.orchestra.run.smithi177.stdout:2088 read 0x242ad3b thru 0x242cb50 (0x1e16 bytes) 2019-12-16T22:45:48.504 INFO:teuthology.orchestra.run.smithi177.stdout:2089 writesame 0xa1788b thru 0xa212b8 data_size 0x5(0x9a2e bytes) 2019-12-16T22:45:48.510 INFO:teuthology.orchestra.run.smithi177.stdout:1204 trunc from 0xbc1121c to 0x2075a28 2019-12-16T22:45:48.510 INFO:teuthology.orchestra.run.smithi177.stdout:1459 punch from 0x1153719 to 0x115f162, (0xba49 bytes) 2019-12-16T22:45:48.518 INFO:teuthology.orchestra.run.smithi177.stdout:2090 punch from 0x78b184d to 0x78b825f, (0x6a12 bytes) 2019-12-16T22:45:48.522 INFO:teuthology.orchestra.run.smithi177.stdout:1625 trunc from 0x3e61fa0 to 0xd633679 2019-12-16T22:45:48.525 INFO:teuthology.orchestra.run.smithi177.stdout:2092 trunc from 0x9693898 to 0xd042dde 2019-12-16T22:45:48.528 INFO:teuthology.orchestra.run.smithi177.stdout:1460 trunc from 0x303d760 to 0xc76196f 2019-12-16T22:45:48.543 INFO:teuthology.orchestra.run.smithi177.stdout:1627 write 0x8f8affc thru 0x8f974f9 (0xc4fe bytes) 2019-12-16T22:45:48.550 INFO:teuthology.orchestra.run.smithi177.stdout:1462 writesame 0x21bbfed thru 0x21be02f data_size 0x1(0x2043 bytes) 2019-12-16T22:45:48.553 INFO:teuthology.orchestra.run.smithi177.stdout:2093 punch from 0x570382c to 0x5705bfe, (0x23d2 bytes) 2019-12-16T22:45:48.554 INFO:teuthology.orchestra.run.smithi177.stdout:1628 write 0x71fbb9a thru 0x71fd000 (0x1467 bytes) 2019-12-16T22:45:48.576 INFO:teuthology.orchestra.run.smithi177.stdout:2095 trunc from 0xd042dde to 0x593ce31 2019-12-16T22:45:48.577 INFO:teuthology.orchestra.run.smithi177.stdout:1630 trunc from 0xd633679 to 0x78b25b1 2019-12-16T22:45:48.596 INFO:teuthology.orchestra.run.smithi177.stdout:1463 write 0xc7e4413 thru 0xc7e6f28 (0x2b16 bytes) 2019-12-16T22:45:48.600 INFO:teuthology.orchestra.run.smithi177.stdout:2096 write 0x4c87593 thru 0x4c885bb (0x1029 bytes) 2019-12-16T22:45:48.602 INFO:teuthology.orchestra.run.smithi177.stdout:1205 writesame 0xd8e5ce6 thru 0xd8e8159 data_size 0x2(0x2474 bytes) 2019-12-16T22:45:48.612 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.613 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.613 INFO:teuthology.orchestra.run.smithi177.stdout:1208 read 0xc854f77 thru 0xc85ca41 (0x7acb bytes) 2019-12-16T22:45:48.613 INFO:teuthology.orchestra.run.smithi177.stdout:1209 read 0xc98d859 thru 0xc98e5d6 (0xd7e bytes) 2019-12-16T22:45:48.614 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.614 INFO:teuthology.orchestra.run.smithi177.stdout:1211 read 0x28f138c thru 0x28fa8f5 (0x956a bytes) 2019-12-16T22:45:48.614 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.614 INFO:teuthology.orchestra.run.smithi177.stdout:1215 punch from 0x947eec5 to 0x948308f, (0x41ca bytes) 2019-12-16T22:45:48.614 INFO:teuthology.orchestra.run.smithi177.stdout:1217 write 0x7a70d09 thru 0x7a7f298 (0xe590 bytes) 2019-12-16T22:45:48.625 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.625 INFO:teuthology.orchestra.run.smithi177.stdout:1465 write 0x4b61d8b thru 0x4b6297c (0xbf2 bytes) 2019-12-16T22:45:48.628 INFO:teuthology.orchestra.run.smithi177.stdout:2097 trunc from 0x593ce31 to 0x1760c2b 2019-12-16T22:45:48.633 INFO:teuthology.orchestra.run.smithi177.stdout:1218 read 0xc02bfe1 thru 0xc03ac9e (0xecbe bytes) 2019-12-16T22:45:48.633 INFO:teuthology.orchestra.run.smithi177.stdout:1219 punch from 0xc57721e to 0xc57aec0, (0x3ca2 bytes) 2019-12-16T22:45:48.634 INFO:teuthology.orchestra.run.smithi177.stdout:1221 write 0x4260853 thru 0x426da6e (0xd21c bytes) 2019-12-16T22:45:48.634 INFO:teuthology.orchestra.run.smithi177.stdout:1631 punch from 0x5ef802a to 0x5f046e0, (0xc6b6 bytes) 2019-12-16T22:45:48.634 INFO:teuthology.orchestra.run.smithi177.stdout:1633 write 0x1212b0f thru 0x1215e95 (0x3387 bytes) 2019-12-16T22:45:48.644 INFO:teuthology.orchestra.run.smithi177.stdout:1466 read 0x99ea29d thru 0x99f6bcb (0xc92f bytes) 2019-12-16T22:45:48.644 INFO:teuthology.orchestra.run.smithi177.stdout:1467 write 0xb29db90 thru 0xb2a29ab (0x4e1c bytes) 2019-12-16T22:45:48.665 INFO:teuthology.orchestra.run.smithi177.stdout:1222 write 0x1a8461e thru 0x1a8f0c0 (0xaaa3 bytes) 2019-12-16T22:45:48.669 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #13, image image_cluster1.client.mirror.0-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent14 2019-12-16T22:45:48.672 INFO:teuthology.orchestra.run.smithi177.stdout:1223 write 0x9a93ac6 thru 0x9a96830 (0x2d6b bytes) 2019-12-16T22:45:48.679 INFO:teuthology.orchestra.run.smithi177.stdout:1224 write 0xbd5cd71 thru 0xbd6b01f (0xe2af bytes) 2019-12-16T22:45:48.685 INFO:teuthology.orchestra.run.smithi177.stdout:1469 trunc from 0xc7e6f29 to 0x49b7d7b 2019-12-16T22:45:48.697 INFO:teuthology.orchestra.run.smithi177.stdout:1225 write 0x8b01fa5 thru 0x8b0952a (0x7586 bytes) 2019-12-16T22:45:48.702 INFO:teuthology.orchestra.run.smithi177.stdout:2098 trunc from 0x1760c2b to 0xe284cff 2019-12-16T22:45:48.736 INFO:teuthology.orchestra.run.smithi177.stdout:1227 trunc from 0xd8e815a to 0xd6864b4 2019-12-16T22:45:48.745 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.746 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.746 INFO:teuthology.orchestra.run.smithi177.stdout:1622 trunc from 0xd2a6df3 to 0xda2f74a 2019-12-16T22:45:48.752 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.750+0000 7f884a7b2700 -1 reset not still connected to 0x560112683380 2019-12-16T22:45:48.752 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.750+0000 7f884a7b2700 -1 reset not still connected to 0x560112685e90 2019-12-16T22:45:48.753 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.750+0000 7f884a7b2700 -1 reset not still connected to 0x5601137f8410 2019-12-16T22:45:48.753 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.750+0000 7f884a7b2700 -1 reset not still connected to 0x5601137fb260 2019-12-16T22:45:48.763 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.758+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9cd00 2019-12-16T22:45:48.764 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.762+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9e150 2019-12-16T22:45:48.766 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.762+0000 7f884a7b2700 -1 reset not still connected to 0x5601186cbd40 2019-12-16T22:45:48.767 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.766+0000 7f884a7b2700 -1 reset not still connected to 0x560118708820 2019-12-16T22:45:48.767 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.766+0000 7f884a7b2700 -1 reset not still connected to 0x5601192ca220 2019-12-16T22:45:48.775 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011af19ee0 2019-12-16T22:45:48.775 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1a150 2019-12-16T22:45:48.775 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1aa40 2019-12-16T22:45:48.776 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1aff0 2019-12-16T22:45:48.776 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:45:48.776 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011c57f8e0 2019-12-16T22:45:48.776 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011f79c8f0 2019-12-16T22:45:48.776 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011f79fcf0 2019-12-16T22:45:48.776 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x560112683380 2019-12-16T22:45:48.777 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x560112685e90 2019-12-16T22:45:48.777 INFO:teuthology.orchestra.run.smithi177.stdout:1634 write 0xe73d0da thru 0xe74bfcb (0xeef2 bytes) 2019-12-16T22:45:48.777 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x5601137f8410 2019-12-16T22:45:48.778 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x5601137fb260 2019-12-16T22:45:48.778 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9cd00 2019-12-16T22:45:48.778 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9e150 2019-12-16T22:45:48.778 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x5601186cbd40 2019-12-16T22:45:48.778 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x5601192ca220 2019-12-16T22:45:48.778 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1a150 2019-12-16T22:45:48.778 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1aa40 2019-12-16T22:45:48.779 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:45:48.779 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.774+0000 7f884a7b2700 -1 reset not still connected to 0x56011c57f8e0 2019-12-16T22:45:48.791 INFO:teuthology.orchestra.run.smithi177.stdout:2099 writesame 0xb4746a6 thru 0xb47ff66 data_size 0x1(0xb8c1 bytes) 2019-12-16T22:45:48.815 INFO:teuthology.orchestra.run.smithi177.stdout:1635 write 0x6510f46 thru 0x6515b25 (0x4be0 bytes) 2019-12-16T22:45:48.816 INFO:teuthology.orchestra.run.smithi177.stdout:1228 write 0xd1c59fd thru 0xd1d23dd (0xc9e1 bytes) 2019-12-16T22:45:48.833 INFO:teuthology.orchestra.run.smithi177.stdout:1470 punch from 0x2b3c8e1 to 0x2b4baa2, (0xf1c1 bytes) 2019-12-16T22:45:48.844 INFO:teuthology.orchestra.run.smithi177.stdout:1229 write 0x6b6156a thru 0x6b649c9 (0x3460 bytes) 2019-12-16T22:45:48.854 INFO:teuthology.orchestra.run.smithi177.stdout:2100 read 0xb16b7b6 thru 0xb16d6ca (0x1f15 bytes) 2019-12-16T22:45:48.854 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.855 INFO:teuthology.orchestra.run.smithi177.stdout:2102 read 0xac88d37 thru 0xac9212c (0x93f6 bytes) 2019-12-16T22:45:48.855 INFO:teuthology.orchestra.run.smithi177.stdout:2104 writesame 0x4d3f664 thru 0x4d49a5d data_size 0x2(0xa3fa bytes) 2019-12-16T22:45:48.857 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.857 INFO:teuthology.orchestra.run.smithi177.stdout:1638 read 0x21323f1 thru 0x2139631 (0x7241 bytes) 2019-12-16T22:45:48.857 INFO:teuthology.orchestra.run.smithi177.stdout:1639 writesame 0xa8453d1 thru 0xa84f9b4 data_size 0x6(0xa5e4 bytes) 2019-12-16T22:45:48.862 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.862 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.863 INFO:teuthology.orchestra.run.smithi177.stdout:1625 write 0x2ed82e1 thru 0x2ee7529 (0xf249 bytes) 2019-12-16T22:45:48.864 INFO:teuthology.orchestra.run.smithi177.stdout:1230 write 0xc46fd92 thru 0xc47a6ac (0xa91b bytes) 2019-12-16T22:45:48.892 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.874+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9cd00 2019-12-16T22:45:48.892 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.874+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9e150 2019-12-16T22:45:48.892 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.874+0000 7f884a7b2700 -1 reset not still connected to 0x5601186cbd40 2019-12-16T22:45:48.892 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.874+0000 7f884a7b2700 -1 reset not still connected to 0x560118708820 2019-12-16T22:45:48.892 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.878+0000 7f884a7b2700 -1 reset not still connected to 0x5601192ca220 2019-12-16T22:45:48.892 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011a55e5b0 2019-12-16T22:45:48.893 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011a55ea90 2019-12-16T22:45:48.893 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011aa47c20 2019-12-16T22:45:48.893 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1a150 2019-12-16T22:45:48.893 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1aa40 2019-12-16T22:45:48.893 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011af1aff0 2019-12-16T22:45:48.893 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:45:48.893 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011c57f8e0 2019-12-16T22:45:48.894 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011ce14dd0 2019-12-16T22:45:48.894 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:48.882+0000 7f884a7b2700 -1 reset not still connected to 0x56011f79c8f0 2019-12-16T22:45:48.894 INFO:teuthology.orchestra.run.smithi177.stdout:1640 punch from 0x3f071ba to 0x3f10869, (0x96af bytes) 2019-12-16T22:45:48.894 INFO:teuthology.orchestra.run.smithi177.stdout:1642 punch from 0x67c9a94 to 0x67d1975, (0x7ee1 bytes) 2019-12-16T22:45:48.894 INFO:teuthology.orchestra.run.smithi177.stdout:1645 writesame 0x1211e25 thru 0x121a7e8 data_size 0x6(0x89c4 bytes) 2019-12-16T22:45:48.894 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.894 INFO:teuthology.orchestra.run.smithi177.stdout:2106 read 0x1000b09 thru 0x1009e03 (0x92fb bytes) 2019-12-16T22:45:48.895 INFO:teuthology.orchestra.run.smithi177.stdout:2108 read 0x2dce536 thru 0x2dd23c1 (0x3e8c bytes) 2019-12-16T22:45:48.895 INFO:teuthology.orchestra.run.smithi177.stdout:2110 flatten 2019-12-16T22:45:48.896 INFO:teuthology.orchestra.run.smithi177.stdout:1471 write 0x52c3a53 thru 0x52cb2a3 (0x7851 bytes) 2019-12-16T22:45:48.908 INFO:teuthology.orchestra.run.smithi177.stdout:1231 write 0x29cc93d thru 0x29cd494 (0xb58 bytes) 2019-12-16T22:45:48.908 INFO:teuthology.orchestra.run.smithi177.stdout:1626 write 0xadef816 thru 0xadf0556 (0xd41 bytes) 2019-12-16T22:45:48.909 INFO:teuthology.orchestra.run.smithi177.stdout:1646 write 0x2533861 thru 0x2534fd7 (0x1777 bytes) 2019-12-16T22:45:48.915 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:48.910+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb19b0 2019-12-16T22:45:48.916 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:48.914+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb1cf0 2019-12-16T22:45:48.916 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:48.914+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb1e90 2019-12-16T22:45:48.917 INFO:teuthology.orchestra.run.smithi177.stdout:1647 writesame 0xd25afd1 thru 0xd25bc88 data_size 0xb(0xcb8 bytes) 2019-12-16T22:45:48.919 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:48.914+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a410 2019-12-16T22:45:48.919 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.919 INFO:teuthology.orchestra.run.smithi177.stdout:1475 write 0x8b993 thru 0x98e85 (0xd4f3 bytes) 2019-12-16T22:45:48.920 INFO:teuthology.orchestra.run.smithi177.stdout:1233 read 0x1ebcd36 thru 0x1ecb33d (0xe608 bytes) 2019-12-16T22:45:48.921 INFO:teuthology.orchestra.run.smithi177.stdout:1627 read 0xd9f2e5f thru 0xd9fd26e (0xa410 bytes) 2019-12-16T22:45:48.921 INFO:teuthology.orchestra.run.smithi177.stdout:1629 read 0x62a5361 thru 0x62adfbe (0x8c5e bytes) 2019-12-16T22:45:48.923 INFO:teuthology.orchestra.run.smithi177.stdout:1630 writesame 0x2720899 thru 0x272f91d data_size 0x1(0xf085 bytes) 2019-12-16T22:45:48.923 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.923 INFO:teuthology.orchestra.run.smithi177.stdout:1236 punch from 0x8a47e3b to 0x8a4fd8d, (0x7f52 bytes) 2019-12-16T22:45:48.923 INFO:teuthology.orchestra.run.smithi177.stdout:1237 writesame 0x1ea2131 thru 0x1eaf808 data_size 0x7d(0xd6d8 bytes) 2019-12-16T22:45:48.930 INFO:teuthology.orchestra.run.smithi177.stdout:1648 read 0x208ac2 thru 0x20b65a (0x2b99 bytes) 2019-12-16T22:45:48.934 INFO:teuthology.orchestra.run.smithi177.stdout:1649 trunc from 0xe74bfcc to 0xc7a4581 2019-12-16T22:45:48.934 INFO:teuthology.orchestra.run.smithi177.stdout:1238 writesame 0xa17851e thru 0xa18059a data_size 0x25(0x807d bytes) 2019-12-16T22:45:48.941 INFO:teuthology.orchestra.run.smithi177.stdout:1499 read 0x1456b9a thru 0x14629c5 (0xbe2c bytes) 2019-12-16T22:45:48.945 INFO:teuthology.orchestra.run.smithi177.stdout:1476 trunc from 0x52cb2a4 to 0xd03b59f 2019-12-16T22:45:48.956 INFO:teuthology.orchestra.run.smithi177.stdout:1239 punch from 0x1f879db to 0x1f9735d, (0xf982 bytes) 2019-12-16T22:45:48.957 INFO:teuthology.orchestra.run.smithi177.stdout:1240 write 0x4ace159 thru 0x4ad829f (0xa147 bytes) 2019-12-16T22:45:48.959 INFO:teuthology.orchestra.run.smithi177.stdout:2112 trunc from 0xe284cff to 0x284befc 2019-12-16T22:45:48.993 INFO:teuthology.orchestra.run.smithi177.stdout:1241 punch from 0x4faa025 to 0x4fb3e60, (0x9e3b bytes) 2019-12-16T22:45:48.993 INFO:teuthology.orchestra.run.smithi177.stdout:1242 read 0x95b282d thru 0x95b9a9a (0x726e bytes) 2019-12-16T22:45:48.994 INFO:teuthology.orchestra.run.smithi177.stdout:1243 read 0x3fdc634 thru 0x3fe1241 (0x4c0e bytes) 2019-12-16T22:45:48.994 INFO:teuthology.orchestra.run.smithi177.stdout:1248 read 0x91e77fe thru 0x91f6314 (0xeb17 bytes) 2019-12-16T22:45:48.994 INFO:teuthology.orchestra.run.smithi177.stdout:1249 read 0x2833276 thru 0x283551d (0x22a8 bytes) 2019-12-16T22:45:48.994 INFO:teuthology.orchestra.run.smithi177.stdout:1250 punch from 0xc29f600 to 0xc2a4fca, (0x59ca bytes) 2019-12-16T22:45:48.995 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.995 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:48.995 INFO:teuthology.orchestra.run.smithi177.stdout:1631 write 0x8b2cc72 thru 0x8b3698d (0x9d1c bytes) 2019-12-16T22:45:48.995 INFO:teuthology.orchestra.run.smithi177.stdout:1254 trunc from 0xd6864b4 to 0xe96fcc7 2019-12-16T22:45:49.004 INFO:teuthology.orchestra.run.smithi177.stdout:1501 read 0x31c9be1 thru 0x31d55d9 (0xb9f9 bytes) 2019-12-16T22:45:49.008 INFO:teuthology.orchestra.run.smithi177.stdout:1650 write 0x4bda4dc thru 0x4be3186 (0x8cab bytes) 2019-12-16T22:45:49.009 INFO:teuthology.orchestra.run.smithi177.stdout:1502 trunc from 0x69e6021 to 0x94a0078 2019-12-16T22:45:49.024 INFO:teuthology.orchestra.run.smithi177.stdout:1632 trunc from 0xda2f74a to 0x8037110 2019-12-16T22:45:49.032 INFO:teuthology.orchestra.run.smithi177.stdout:1477 write 0x9eb7ef thru 0x9f5c65 (0xa477 bytes) 2019-12-16T22:45:49.032 INFO:teuthology.orchestra.run.smithi177.stdout:1651 punch from 0x8718e9a to 0x8721a7d, (0x8be3 bytes) 2019-12-16T22:45:49.032 INFO:teuthology.orchestra.run.smithi177.stdout:1652 trunc from 0xc7a4581 to 0x8925cb8 2019-12-16T22:45:49.042 INFO:teuthology.orchestra.run.smithi177.stdout:2113 write 0x1d8d312 thru 0x1d91418 (0x4107 bytes) 2019-12-16T22:45:49.056 INFO:teuthology.orchestra.run.smithi177.stdout:2114 write 0x2cf951 thru 0x2db14f (0xb7ff bytes) 2019-12-16T22:45:49.056 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.056 INFO:teuthology.orchestra.run.smithi177.stdout:1256 writesame 0x9d9f8af thru 0x9da6e8d data_size 0x47(0x75df bytes) 2019-12-16T22:45:49.064 INFO:teuthology.orchestra.run.smithi177.stdout:1257 read 0x66c2592 thru 0x66cbe39 (0x98a8 bytes) 2019-12-16T22:45:49.064 INFO:teuthology.orchestra.run.smithi177.stdout:1259 read 0x29bb267 thru 0x29c9ee9 (0xec83 bytes) 2019-12-16T22:45:49.065 INFO:teuthology.orchestra.run.smithi177.stdout:1263 read 0xc9f2365 thru 0xc9f6ef9 (0x4b95 bytes) 2019-12-16T22:45:49.065 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.065 INFO:teuthology.orchestra.run.smithi177.stdout:1266 writesame 0x4385cf8 thru 0x438a633 data_size 0x4(0x493c bytes) 2019-12-16T22:45:49.066 INFO:teuthology.orchestra.run.smithi177.stdout:2115 read 0xfd46cc thru 0xfd7ef6 (0x382b bytes) 2019-12-16T22:45:49.067 INFO:teuthology.orchestra.run.smithi177.stdout:2117 punch from 0x629410 to 0x62ceff, (0x3aef bytes) 2019-12-16T22:45:49.068 INFO:teuthology.orchestra.run.smithi177.stdout:2118 read 0xa89e thru 0xdd78 (0x34db bytes) 2019-12-16T22:45:49.068 INFO:teuthology.orchestra.run.smithi177.stdout:1479 trunc from 0xd03b59f to 0xbd3a03e 2019-12-16T22:45:49.072 INFO:teuthology.orchestra.run.smithi177.stdout:1503 write 0x2275a08 thru 0x2277c2f (0x2228 bytes) 2019-12-16T22:45:49.080 INFO:teuthology.orchestra.run.smithi177.stdout:1653 read 0x4273688 thru 0x4279fa0 (0x6919 bytes) 2019-12-16T22:45:49.081 INFO:teuthology.orchestra.run.smithi177.stdout:1654 read 0x517c7a7 thru 0x5184408 (0x7c62 bytes) 2019-12-16T22:45:49.081 INFO:teuthology.orchestra.run.smithi177.stdout:1655 write 0x6fad14e thru 0x6fb60a0 (0x8f53 bytes) 2019-12-16T22:45:49.083 INFO:teuthology.orchestra.run.smithi177.stdout:1267 read 0x9e11a95 thru 0x9e16a99 (0x5005 bytes) 2019-12-16T22:45:49.084 INFO:teuthology.orchestra.run.smithi177.stdout:1269 trunc from 0xe96fcc7 to 0xe85fed4 2019-12-16T22:45:49.089 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.089 INFO:teuthology.orchestra.run.smithi177.stdout:1506 read 0x7e5c4a1 thru 0x7e5e4d9 (0x2039 bytes) 2019-12-16T22:45:49.092 INFO:teuthology.orchestra.run.smithi177.stdout:1656 write 0x40a753b thru 0x40ae8c6 (0x738c bytes) 2019-12-16T22:45:49.113 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.113 INFO:teuthology.orchestra.run.smithi177.stdout:1661 read 0x1bfb95c thru 0x1bfc572 (0xc17 bytes) 2019-12-16T22:45:49.129 INFO:teuthology.orchestra.run.smithi177.stdout:1633 clone 16 order 18 su 32768 sc 15 2019-12-16T22:45:49.131 INFO:teuthology.orchestra.run.smithi177.stdout:1272 writesame 0x529bf98 thru 0x52a6a69 data_size 0x5(0xaad2 bytes) 2019-12-16T22:45:49.135 INFO:teuthology.orchestra.run.smithi177.stdout:2121 write 0xcd1535c thru 0xcd16e19 (0x1abe bytes) 2019-12-16T22:45:49.138 INFO:teuthology.orchestra.run.smithi177.stdout:1507 write 0xb77a31d thru 0xb78501c (0xad00 bytes) 2019-12-16T22:45:49.146 INFO:teuthology.orchestra.run.smithi177.stdout:2122 write 0xa4a8af2 thru 0xa4ae6d3 (0x5be2 bytes) 2019-12-16T22:45:49.151 INFO:teuthology.orchestra.run.smithi177.stdout:1273 trunc from 0xe85fed4 to 0xa6a3286 2019-12-16T22:45:49.167 INFO:teuthology.orchestra.run.smithi177.stdout:1662 writesame 0xa743a67 thru 0xa745666 data_size 0x1c(0x1c00 bytes) 2019-12-16T22:45:49.167 INFO:teuthology.orchestra.run.smithi177.stdout:1482 write 0xddc1285 thru 0xddc33d7 (0x2153 bytes) 2019-12-16T22:45:49.185 INFO:teuthology.orchestra.run.smithi177.stdout:1485 writesame 0x487d54d thru 0x488405e data_size 0x5(0x6b12 bytes) 2019-12-16T22:45:49.195 INFO:teuthology.orchestra.run.smithi177.stdout:1663 trunc from 0xa745667 to 0x42dd8f9 2019-12-16T22:45:49.198 INFO:teuthology.orchestra.run.smithi177.stdout:1508 trunc from 0xb78501d to 0x3bf8237 2019-12-16T22:45:49.214 INFO:teuthology.orchestra.run.smithi177.stdout:2123 write 0xdf74f04 thru 0xdf7bec4 (0x6fc1 bytes) 2019-12-16T22:45:49.219 INFO:teuthology.orchestra.run.smithi177.stdout:1274 write 0x236462b thru 0x236a6cf (0x60a5 bytes) 2019-12-16T22:45:49.225 INFO:teuthology.orchestra.run.smithi177.stdout:2124 writesame 0x18c39f3 thru 0x18cc580 data_size 0x1(0x8b8e bytes) 2019-12-16T22:45:49.233 INFO:teuthology.orchestra.run.smithi177.stdout:1486 trunc from 0xddc33d8 to 0xa5de41 2019-12-16T22:45:49.244 INFO:teuthology.orchestra.run.smithi177.stdout:1276 trunc from 0xa6a3286 to 0x5a60864 2019-12-16T22:45:49.265 INFO:teuthology.orchestra.run.smithi177.stdout:2125 read 0xaa8d79d thru 0xaa96e38 (0x969c bytes) 2019-12-16T22:45:49.273 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.274 INFO:teuthology.orchestra.run.smithi177.stdout:1665 trunc from 0x42dd8f9 to 0x34738cf 2019-12-16T22:45:49.284 INFO:teuthology.orchestra.run.smithi177.stdout:2126 trunc from 0xdf7bec5 to 0x391427b 2019-12-16T22:45:49.285 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.314 INFO:teuthology.orchestra.run.smithi177.stdout:1511 write 0x7edd9bf thru 0x7edf4f0 (0x1b32 bytes) 2019-12-16T22:45:49.317 INFO:teuthology.orchestra.run.smithi177.stdout:1277 punch from 0x55c0cb9 to 0x55c251b, (0x1862 bytes) 2019-12-16T22:45:49.325 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.314+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb0d80 2019-12-16T22:45:49.329 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a680 2019-12-16T22:45:49.329 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a750 2019-12-16T22:45:49.329 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a820 2019-12-16T22:45:49.329 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84ab60 2019-12-16T22:45:49.330 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84aea0 2019-12-16T22:45:49.330 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84b040 2019-12-16T22:45:49.331 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84bba0 2019-12-16T22:45:49.331 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d9765b0 2019-12-16T22:45:49.331 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976750 2019-12-16T22:45:49.331 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976820 2019-12-16T22:45:49.332 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976b60 2019-12-16T22:45:49.333 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976dd0 2019-12-16T22:45:49.333 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d977d40 2019-12-16T22:45:49.334 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d978560 2019-12-16T22:45:49.335 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63d979670 2019-12-16T22:45:49.336 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbec30 2019-12-16T22:45:49.336 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbf6c0 2019-12-16T22:45:49.337 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc1c20 2019-12-16T22:45:49.338 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa7930 2019-12-16T22:45:49.338 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9260 2019-12-16T22:45:49.339 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9400 2019-12-16T22:45:49.340 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34a000 2019-12-16T22:45:49.341 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34a410 2019-12-16T22:45:49.341 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34aea0 2019-12-16T22:45:49.342 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34b790 2019-12-16T22:45:49.342 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.318+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34be10 2019-12-16T22:45:49.348 INFO:teuthology.orchestra.run.smithi177.stdout:2127 read 0x931b7 thru 0x979a8 (0x47f2 bytes) 2019-12-16T22:45:49.349 INFO:teuthology.orchestra.run.smithi177.stdout:1487 writesame 0x7214145 thru 0x721773c data_size 0x4(0x35f8 bytes) 2019-12-16T22:45:49.349 INFO:teuthology.orchestra.run.smithi177.stdout:1488 punch from 0x3a47f8e to 0x3a56533, (0xe5a5 bytes) 2019-12-16T22:45:49.349 INFO:teuthology.orchestra.run.smithi177.stdout:1490 read 0x2a10924 thru 0x2a1f1ca (0xe8a7 bytes) 2019-12-16T22:45:49.349 INFO:teuthology.orchestra.run.smithi177.stdout:1491 punch from 0x6e1b8 to 0x7277b, (0x45c3 bytes) 2019-12-16T22:45:49.350 INFO:teuthology.orchestra.run.smithi177.stdout:1666 write 0xa3c2333 thru 0xa3d08c4 (0xe592 bytes) 2019-12-16T22:45:49.350 INFO:teuthology.orchestra.run.smithi177.stdout:1668 read 0x2b91aa1 thru 0x2b92406 (0x966 bytes) 2019-12-16T22:45:49.350 INFO:teuthology.orchestra.run.smithi177.stdout:1669 writesame 0xb5f4ee thru 0xb6128f data_size 0x1(0x1da2 bytes) 2019-12-16T22:45:49.351 INFO:teuthology.orchestra.run.smithi177.stdout:1278 trunc from 0x5a60864 to 0xd2c078b 2019-12-16T22:45:49.354 INFO:teuthology.orchestra.run.smithi177.stdout:1280 writesame 0x96c8505 thru 0x96d2295 data_size 0xb(0x9d91 bytes) 2019-12-16T22:45:49.354 INFO:teuthology.orchestra.run.smithi177.stdout:1670 punch from 0x83ae176 to 0x83b7a49, (0x98d3 bytes) 2019-12-16T22:45:49.354 INFO:teuthology.orchestra.run.smithi177.stdout:1675 punch from 0x208b5dd to 0x208da8b, (0x24ae bytes) 2019-12-16T22:45:49.355 INFO:teuthology.orchestra.run.smithi177.stdout:1678 writesame 0x9929295 thru 0x9933831 data_size 0x1(0xa59d bytes) 2019-12-16T22:45:49.373 INFO:teuthology.orchestra.run.smithi177.stdout:1281 writesame 0x186d114 thru 0x186ea17 data_size 0x2(0x1904 bytes) 2019-12-16T22:45:49.373 INFO:teuthology.orchestra.run.smithi177.stdout:2128 writesame 0x7dfd649 thru 0x7e0a182 data_size 0x2e(0xcb3a bytes) 2019-12-16T22:45:49.384 INFO:teuthology.orchestra.run.smithi177.stdout:1283 read 0x85bcfac thru 0x85c3e4c (0x6ea1 bytes) 2019-12-16T22:45:49.385 INFO:teuthology.orchestra.run.smithi177.stdout:1284 punch from 0x24bb15c to 0x24bd7d9, (0x267d bytes) 2019-12-16T22:45:49.385 INFO:teuthology.orchestra.run.smithi177.stdout:1285 read 0x169b1f3 thru 0x16a3d97 (0x8ba5 bytes) 2019-12-16T22:45:49.387 INFO:teuthology.orchestra.run.smithi177.stdout:1287 trunc from 0xd2c078b to 0xe622b75 2019-12-16T22:45:49.387 INFO:teuthology.orchestra.run.smithi177.stdout:1493 write 0x9480fcd thru 0x9483a32 (0x2a66 bytes) 2019-12-16T22:45:49.396 INFO:teuthology.orchestra.run.smithi177.stdout:1512 writesame 0xd97ecc3 thru 0xd989585 data_size 0x1(0xa8c3 bytes) 2019-12-16T22:45:49.397 INFO:teuthology.orchestra.run.smithi177.stdout:2130 trunc from 0x7e0a183 to 0x2a1a1cc 2019-12-16T22:45:49.398 INFO:teuthology.orchestra.run.smithi177.stdout:1494 trunc from 0x9483a33 to 0x7dd95f9 2019-12-16T22:45:49.399 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.399 INFO:teuthology.orchestra.run.smithi177.stdout:1514 write 0xd46dd9f thru 0xd4714ae (0x3710 bytes) 2019-12-16T22:45:49.407 INFO:teuthology.orchestra.run.smithi177.stdout:1679 trunc from 0xa3d08c5 to 0x2d8558b 2019-12-16T22:45:49.421 INFO:teuthology.orchestra.run.smithi177.stdout:1288 read 0x528e5cd thru 0x529c8a2 (0xe2d6 bytes) 2019-12-16T22:45:49.421 INFO:teuthology.orchestra.run.smithi177.stdout:1289 writesame 0x36b52c3 thru 0x36b7efa data_size 0x14(0x2c38 bytes) 2019-12-16T22:45:49.421 INFO:teuthology.orchestra.run.smithi177.stdout:1517 write 0x827a01b thru 0x8286581 (0xc567 bytes) 2019-12-16T22:45:49.430 INFO:teuthology.orchestra.run.smithi177.stdout:1290 write 0x5f26a26 thru 0x5f35c8b (0xf266 bytes) 2019-12-16T22:45:49.431 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.426+0000 7fb660f13700 -1 reset not still connected to 0x55f63d979670 2019-12-16T22:45:49.431 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.426+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbec30 2019-12-16T22:45:49.436 INFO:teuthology.orchestra.run.smithi177.stdout:2133 read 0x21ff892 thru 0x2208b39 (0x92a8 bytes) 2019-12-16T22:45:49.437 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.430+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbf6c0 2019-12-16T22:45:49.438 INFO:teuthology.orchestra.run.smithi177.stdout:1518 read 0x7d39d12 thru 0x7d43e39 (0xa128 bytes) 2019-12-16T22:45:49.438 INFO:teuthology.orchestra.run.smithi177.stdout:1519 punch from 0x3836591 to 0x3841b4e, (0xb5bd bytes) 2019-12-16T22:45:49.438 INFO:teuthology.orchestra.run.smithi177.stdout:1520 writesame 0x69b4e1c thru 0x69bae05 data_size 0x1(0x5fea bytes) 2019-12-16T22:45:49.440 INFO:teuthology.orchestra.run.smithi177.stdout:2134 read 0x1160c25 thru 0x1170ac5 (0xfea1 bytes) 2019-12-16T22:45:49.440 INFO:teuthology.orchestra.run.smithi177.stdout:1291 read 0xb6ace5f thru 0xb6b83b9 (0xb55b bytes) 2019-12-16T22:45:49.440 INFO:teuthology.orchestra.run.smithi177.stdout:1292 punch from 0xe5eeda5 to 0xe5f23ec, (0x3647 bytes) 2019-12-16T22:45:49.441 INFO:teuthology.orchestra.run.smithi177.stdout:2135 read 0x178523 thru 0x1786f2 (0x1d0 bytes) 2019-12-16T22:45:49.441 INFO:teuthology.orchestra.run.smithi177.stdout:1495 punch from 0x5914e27 to 0x591dd35, (0x8f0e bytes) 2019-12-16T22:45:49.442 INFO:teuthology.orchestra.run.smithi177.stdout:1496 read 0x6fb1da1 thru 0x6fbf0d9 (0xd339 bytes) 2019-12-16T22:45:49.442 INFO:teuthology.orchestra.run.smithi177.stdout:1497 write 0x5019c87 thru 0x5026174 (0xc4ee bytes) 2019-12-16T22:45:49.445 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc1c20 2019-12-16T22:45:49.445 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa7930 2019-12-16T22:45:49.445 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9190 2019-12-16T22:45:49.445 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9260 2019-12-16T22:45:49.446 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9400 2019-12-16T22:45:49.446 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34aea0 2019-12-16T22:45:49.446 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34b450 2019-12-16T22:45:49.446 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34b790 2019-12-16T22:45:49.446 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34be10 2019-12-16T22:45:49.447 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34d260 2019-12-16T22:45:49.447 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e7204e0 2019-12-16T22:45:49.447 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e7227d0 2019-12-16T22:45:49.447 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e722cb0 2019-12-16T22:45:49.447 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:45:49.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63e723260 2019-12-16T22:45:49.454 INFO:teuthology.orchestra.run.smithi177.stdout:1293 trunc from 0xe622b75 to 0x8c903a4 2019-12-16T22:45:49.463 INFO:teuthology.orchestra.run.smithi177.stdout:1522 write 0xd48c338 thru 0xd48cd6e (0xa37 bytes) 2019-12-16T22:45:49.463 INFO:teuthology.orchestra.run.smithi177.stdout:1498 write 0x860a93 thru 0x86c7af (0xbd1d bytes) 2019-12-16T22:45:49.471 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.471 INFO:teuthology.orchestra.run.smithi177.stdout:1525 read 0x9ac5dc1 thru 0x9ad4348 (0xe588 bytes) 2019-12-16T22:45:49.472 INFO:teuthology.orchestra.run.smithi177.stdout:1526 read 0x4452f5c thru 0x445f160 (0xc205 bytes) 2019-12-16T22:45:49.472 INFO:teuthology.orchestra.run.smithi177.stdout:1527 punch from 0x7456630 to 0x745d39b, (0x6d6b bytes) 2019-12-16T22:45:49.472 INFO:teuthology.orchestra.run.smithi177.stdout:1528 punch from 0xbb993a to 0xbc6831, (0xcef7 bytes) 2019-12-16T22:45:49.472 INFO:teuthology.orchestra.run.smithi177.stdout:1529 write 0x62e7cab thru 0x62ee0ce (0x6424 bytes) 2019-12-16T22:45:49.474 INFO:teuthology.orchestra.run.smithi177.stdout:1499 write 0x76f5859 thru 0x7701d04 (0xc4ac bytes) 2019-12-16T22:45:49.480 INFO:teuthology.orchestra.run.smithi177.stdout:1680 write 0x464dcc5 thru 0x465328b (0x55c7 bytes) 2019-12-16T22:45:49.491 INFO:teuthology.orchestra.run.smithi177.stdout:2136 write 0x7a3cd14 thru 0x7a49b5b (0xce48 bytes) 2019-12-16T22:45:49.494 INFO:teuthology.orchestra.run.smithi177.stdout:1683 read 0xafa91c thru 0xb0a411 (0xfaf6 bytes) 2019-12-16T22:45:49.497 INFO:teuthology.orchestra.run.smithi177.stdout:1500 writesame 0x3956c01 thru 0x3965efc data_size 0x2(0xf2fc bytes) 2019-12-16T22:45:49.498 INFO:teuthology.orchestra.run.smithi177.stdout:1684 trunc from 0x465328c to 0x3c6352c 2019-12-16T22:45:49.498 INFO:teuthology.orchestra.run.smithi177.stdout:1530 punch from 0x7e8620 to 0x7f312b, (0xab0b bytes) 2019-12-16T22:45:49.499 INFO:teuthology.orchestra.run.smithi177.stdout:1535 trunc from 0xd989586 to 0xc583bcd 2019-12-16T22:45:49.501 INFO:teuthology.orchestra.run.smithi177.stdout:2138 write 0x3f9d10 thru 0x406dcd (0xd0be bytes) 2019-12-16T22:45:49.513 INFO:teuthology.orchestra.run.smithi177.stdout:1294 trunc from 0x8c903a4 to 0x52b17e1 2019-12-16T22:45:49.529 INFO:teuthology.orchestra.run.smithi177.stdout:1501 read 0x38ed13a thru 0x38f479b (0x7662 bytes) 2019-12-16T22:45:49.529 INFO:teuthology.orchestra.run.smithi177.stdout:1502 punch from 0x23e742 to 0x23f5eb, (0xea9 bytes) 2019-12-16T22:45:49.529 INFO:teuthology.orchestra.run.smithi177.stdout:1503 punch from 0x49ce3ea to 0x49d4c14, (0x682a bytes) 2019-12-16T22:45:49.540 INFO:teuthology.orchestra.run.smithi177.stdout:1685 read 0x1c43616 thru 0x1c45c9f (0x268a bytes) 2019-12-16T22:45:49.543 INFO:teuthology.orchestra.run.smithi177.stdout:2139 write 0xd98c2f4 thru 0xd998ff2 (0xccff bytes) 2019-12-16T22:45:49.548 INFO:teuthology.orchestra.run.smithi177.stdout:1537 write 0xc2bc8c thru 0xc2c671 (0x9e6 bytes) 2019-12-16T22:45:49.553 INFO:teuthology.orchestra.run.smithi177.stdout:1297 trunc from 0x52b17e1 to 0xc0598fa 2019-12-16T22:45:49.553 INFO:teuthology.orchestra.run.smithi177.stdout:2140 punch from 0x1b69cd2 to 0x1b759b8, (0xbce6 bytes) 2019-12-16T22:45:49.554 INFO:teuthology.orchestra.run.smithi177.stdout:2141 write 0x4b43402 thru 0x4b4475f (0x135e bytes) 2019-12-16T22:45:49.554 INFO:teuthology.orchestra.run.smithi177.stdout:1504 write 0x93cab78 thru 0x93d56cb (0xab54 bytes) 2019-12-16T22:45:49.565 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.565 INFO:teuthology.orchestra.run.smithi177.stdout:1541 writesame 0x6029cbb thru 0x6032bfb data_size 0x1f(0x8f41 bytes) 2019-12-16T22:45:49.566 INFO:teuthology.orchestra.run.smithi177.stdout:2142 trunc from 0xd998ff3 to 0x98d6b01 2019-12-16T22:45:49.568 INFO:teuthology.orchestra.run.smithi177.stdout:1506 read 0x101b160 thru 0x101fe1d (0x4cbe bytes) 2019-12-16T22:45:49.568 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.569 INFO:teuthology.orchestra.run.smithi177.stdout:1509 write 0x13a0f7f thru 0x13ae2e4 (0xd366 bytes) 2019-12-16T22:45:49.571 INFO:teuthology.orchestra.run.smithi177.stdout:1689 writesame 0x701798a thru 0x701b623 data_size 0x1(0x3c9a bytes) 2019-12-16T22:45:49.580 INFO:teuthology.orchestra.run.smithi177.stdout:1542 writesame 0x2204095 thru 0x22085d3 data_size 0x13(0x453f bytes) 2019-12-16T22:45:49.585 INFO:teuthology.orchestra.run.smithi177.stdout:1299 write 0x5f80bed thru 0x5f85224 (0x4638 bytes) 2019-12-16T22:45:49.588 INFO:teuthology.orchestra.run.smithi177.stdout:1691 trunc from 0x701b624 to 0x217f33a 2019-12-16T22:45:49.592 INFO:teuthology.orchestra.run.smithi177.stdout:1300 read 0x1c220a5 thru 0x1c27134 (0x5090 bytes) 2019-12-16T22:45:49.593 INFO:teuthology.orchestra.run.smithi177.stdout:1302 write 0x5892bcb thru 0x58a2bc5 (0xfffb bytes) 2019-12-16T22:45:49.598 INFO:teuthology.orchestra.run.smithi177.stdout:1543 read 0x321c085 thru 0x321f912 (0x388e bytes) 2019-12-16T22:45:49.600 INFO:teuthology.orchestra.run.smithi177.stdout:1547 punch from 0x6f8f3f1 to 0x6f9c60d, (0xd21c bytes) 2019-12-16T22:45:49.607 INFO:teuthology.orchestra.run.smithi177.stdout:2145 punch from 0xf388b to 0xf6a8c, (0x3201 bytes) 2019-12-16T22:45:49.607 INFO:teuthology.orchestra.run.smithi177.stdout:2146 write 0x5e6fa14 thru 0x5e76ef0 (0x74dd bytes) 2019-12-16T22:45:49.608 INFO:teuthology.orchestra.run.smithi177.stdout:1303 read 0x68e41ea thru 0x68eb967 (0x777e bytes) 2019-12-16T22:45:49.608 INFO:teuthology.orchestra.run.smithi177.stdout:1304 read 0x9a10be2 thru 0x9a1a095 (0x94b4 bytes) 2019-12-16T22:45:49.608 INFO:teuthology.orchestra.run.smithi177.stdout:1305 read 0x4d6ac9f thru 0x4d6ea3e (0x3da0 bytes) 2019-12-16T22:45:49.609 INFO:teuthology.orchestra.run.smithi177.stdout:1306 writesame 0x650193a thru 0x6509538 data_size 0x3(0x7bff bytes) 2019-12-16T22:45:49.612 INFO:teuthology.orchestra.run.smithi177.stdout:1510 write 0xaa275f6 thru 0xaa311d2 (0x9bdd bytes) 2019-12-16T22:45:49.614 INFO:teuthology.orchestra.run.smithi177.stdout:1549 trunc from 0xc583bcd to 0xe63102 2019-12-16T22:45:49.615 INFO:teuthology.orchestra.run.smithi177.stdout:2149 read 0x46e5c08 thru 0x46f585d (0xfc56 bytes) 2019-12-16T22:45:49.616 INFO:teuthology.orchestra.run.smithi177.stdout:2150 read 0x7bf3f07 thru 0x7bf4161 (0x25b bytes) 2019-12-16T22:45:49.626 INFO:teuthology.orchestra.run.smithi177.stdout:1511 write 0x42b98c thru 0x437d99 (0xc40e bytes) 2019-12-16T22:45:49.627 INFO:teuthology.orchestra.run.smithi177.stdout:1307 write 0x1fc9ecc thru 0x1fd7d3e (0xde73 bytes) 2019-12-16T22:45:49.644 INFO:teuthology.orchestra.run.smithi177.stdout:1512 write 0x280a4e1 thru 0x280e87e (0x439e bytes) 2019-12-16T22:45:49.650 INFO:teuthology.orchestra.run.smithi177.stdout:1308 write 0x5299a2c thru 0x52a80d3 (0xe6a8 bytes) 2019-12-16T22:45:49.662 INFO:teuthology.orchestra.run.smithi177.stdout:2152 write 0xaa799cf thru 0xaa7c503 (0x2b35 bytes) 2019-12-16T22:45:49.663 INFO:teuthology.orchestra.run.smithi177.stdout:1513 write 0x715b454 thru 0x715c797 (0x1344 bytes) 2019-12-16T22:45:49.667 INFO:teuthology.orchestra.run.smithi177.stdout:1309 write 0xe4cc55 thru 0xe56d02 (0xa0ae bytes) 2019-12-16T22:45:49.677 INFO:teuthology.orchestra.run.smithi177.stdout:2153 write 0x172e167 thru 0x1734509 (0x63a3 bytes) 2019-12-16T22:45:49.680 INFO:teuthology.orchestra.run.smithi177.stdout:1514 read 0x509cd38 thru 0x50a933c (0xc605 bytes) 2019-12-16T22:45:49.680 INFO:teuthology.orchestra.run.smithi177.stdout:1515 read 0x4834845 thru 0x4838330 (0x3aec bytes) 2019-12-16T22:45:49.680 INFO:teuthology.orchestra.run.smithi177.stdout:1518 write 0xa2a08d0 thru 0xa2b0601 (0xfd32 bytes) 2019-12-16T22:45:49.681 INFO:teuthology.orchestra.run.smithi177.stdout:1310 read 0x5ddb191 thru 0x5de59ff (0xa86f bytes) 2019-12-16T22:45:49.681 INFO:teuthology.orchestra.run.smithi177.stdout:1311 punch from 0x87cfc9e to 0x87d8242, (0x85a4 bytes) 2019-12-16T22:45:49.681 INFO:teuthology.orchestra.run.smithi177.stdout:1312 write 0x7e498 thru 0x82aef (0x4658 bytes) 2019-12-16T22:45:49.689 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.689 INFO:teuthology.orchestra.run.smithi177.stdout:1314 read 0x21d1d1e thru 0x21e1646 (0xf929 bytes) 2019-12-16T22:45:49.690 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.690 INFO:teuthology.orchestra.run.smithi177.stdout:1317 punch from 0xa65b451 to 0xa662378, (0x6f27 bytes) 2019-12-16T22:45:49.690 INFO:teuthology.orchestra.run.smithi177.stdout:1692 write 0x6b9122e thru 0x6b96147 (0x4f1a bytes) 2019-12-16T22:45:49.692 INFO:teuthology.orchestra.run.smithi177.stdout:1519 punch from 0x82def71 to 0x82e10ab, (0x213a bytes) 2019-12-16T22:45:49.692 INFO:teuthology.orchestra.run.smithi177.stdout:1520 read 0x58a13 thru 0x5fff3 (0x75e1 bytes) 2019-12-16T22:45:49.693 INFO:teuthology.orchestra.run.smithi177.stdout:1521 read 0x8e48412 thru 0x8e4a038 (0x1c27 bytes) 2019-12-16T22:45:49.696 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.697 INFO:teuthology.orchestra.run.smithi177.stdout:1693 read 0x13fd5a7 thru 0x1408497 (0xaef1 bytes) 2019-12-16T22:45:49.698 INFO:teuthology.orchestra.run.smithi177.stdout:1694 punch from 0x6b4a4d6 to 0x6b546b5, (0xa1df bytes) 2019-12-16T22:45:49.704 INFO:teuthology.orchestra.run.smithi177.stdout:1318 trunc from 0xc0598fa to 0x10d9100 2019-12-16T22:45:49.712 INFO:teuthology.orchestra.run.smithi177.stdout:2157 writesame 0xaaa77ea thru 0xaaae01c data_size 0x37(0x6833 bytes) 2019-12-16T22:45:49.715 INFO:teuthology.orchestra.run.smithi177.stdout:2159 writesame 0xa933f7f thru 0xa941470 data_size 0x2(0xd4f2 bytes) 2019-12-16T22:45:49.715 INFO:teuthology.orchestra.run.smithi177.stdout:1522 writesame 0xb4f0e15 thru 0xb4f5ed3 data_size 0x1(0x50bf bytes) 2019-12-16T22:45:49.724 INFO:teuthology.orchestra.run.smithi177.stdout:1524 write 0x10ec1cc thru 0x10ee57d (0x23b2 bytes) 2019-12-16T22:45:49.724 INFO:teuthology.orchestra.run.smithi177.stdout:1695 write 0x6d3353a thru 0x6d398fa (0x63c1 bytes) 2019-12-16T22:45:49.727 INFO:teuthology.orchestra.run.smithi177.stdout:1552 writesame 0x3be61cd thru 0x3bf09b3 data_size 0x1(0xa7e7 bytes) 2019-12-16T22:45:49.728 INFO:teuthology.orchestra.run.smithi177.stdout:1525 write 0x60c0591 thru 0x60caf69 (0xa9d9 bytes) 2019-12-16T22:45:49.731 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.731 INFO:teuthology.orchestra.run.smithi177.stdout:1553 punch from 0xb668bd to 0xb6a5fb, (0x3d3e bytes) 2019-12-16T22:45:49.744 INFO:teuthology.orchestra.run.smithi177.stdout:1526 trunc from 0xb4f5ed4 to 0xa41f31f 2019-12-16T22:45:49.753 INFO:teuthology.orchestra.run.smithi177.stdout:1319 read 0xc5bc9 thru 0xcc061 (0x6499 bytes) 2019-12-16T22:45:49.753 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.754 INFO:teuthology.orchestra.run.smithi177.stdout:1322 trunc from 0x10d9100 to 0xd783e4 2019-12-16T22:45:49.763 INFO:teuthology.orchestra.run.smithi177.stdout:1697 write 0xa428f0d thru 0xa42bea8 (0x2f9c bytes) 2019-12-16T22:45:49.773 INFO:teuthology.orchestra.run.smithi177.stdout:1699 read 0x1a5058f thru 0x1a5b17b (0xabed bytes) 2019-12-16T22:45:49.774 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.774 INFO:teuthology.orchestra.run.smithi177.stdout:1554 write 0xd562d63 thru 0xd56ca5b (0x9cf9 bytes) 2019-12-16T22:45:49.778 INFO:teuthology.orchestra.run.smithi177.stdout:2160 writesame 0xd906858 thru 0xd916016 data_size 0x57(0xf7bf bytes) 2019-12-16T22:45:49.783 INFO:teuthology.orchestra.run.smithi177.stdout:1527 read 0x87461b6 thru 0x8747cf7 (0x1b42 bytes) 2019-12-16T22:45:49.783 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.784 INFO:teuthology.orchestra.run.smithi177.stdout:1323 read 0x8de890 thru 0x8e7839 (0x8faa bytes) 2019-12-16T22:45:49.784 INFO:teuthology.orchestra.run.smithi177.stdout:2161 write 0x2c6a4da thru 0x2c700b3 (0x5bda bytes) 2019-12-16T22:45:49.791 INFO:teuthology.orchestra.run.smithi177.stdout:2163 punch from 0x5eee0ab to 0x5eeef81, (0xed6 bytes) 2019-12-16T22:45:49.791 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.791 INFO:teuthology.orchestra.run.smithi177.stdout:2167 writesame 0x6864a54 thru 0x686c1af data_size 0x2(0x775c bytes) 2019-12-16T22:45:49.793 INFO:teuthology.orchestra.run.smithi177.stdout:1555 writesame 0x12a33d5 thru 0x12b283b data_size 0x25(0xf467 bytes) 2019-12-16T22:45:49.809 INFO:teuthology.orchestra.run.smithi177.stdout:1325 writesame 0x11e28bc thru 0x11e816c data_size 0x13(0x58b1 bytes) 2019-12-16T22:45:49.810 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.810 INFO:teuthology.orchestra.run.smithi177.stdout:2170 punch from 0x2edcd8d to 0x2ee762c, (0xa89f bytes) 2019-12-16T22:45:49.810 INFO:teuthology.orchestra.run.smithi177.stdout:2171 write 0x4f8af33 thru 0x4f94d93 (0x9e61 bytes) 2019-12-16T22:45:49.814 INFO:teuthology.orchestra.run.smithi177.stdout:1529 write 0xe08d161 thru 0xe091054 (0x3ef4 bytes) 2019-12-16T22:45:49.814 INFO:teuthology.orchestra.run.smithi177.stdout:1702 write 0xd405455 thru 0xd40efb9 (0x9b65 bytes) 2019-12-16T22:45:49.819 INFO:teuthology.orchestra.run.smithi177.stdout:1556 write 0x9e2b5e thru 0x9e5523 (0x29c6 bytes) 2019-12-16T22:45:49.820 INFO:teuthology.orchestra.run.smithi177.stdout:2172 clone 11 order 19 su 131072 sc 10 2019-12-16T22:45:49.823 INFO:teuthology.orchestra.run.smithi177.stdout:1530 writesame 0x3d46e6c thru 0x3d49262 data_size 0x21(0x23f7 bytes) 2019-12-16T22:45:49.833 INFO:teuthology.orchestra.run.smithi177.stdout:1558 write 0x513bfb4 thru 0x5149dbf (0xde0c bytes) 2019-12-16T22:45:49.833 INFO:teuthology.orchestra.run.smithi177.stdout:1532 punch from 0xc5cf2b6 to 0xc5d915b, (0x9ea5 bytes) 2019-12-16T22:45:49.834 INFO:teuthology.orchestra.run.smithi177.stdout:1533 writesame 0xdd3acc3 thru 0xdd462e0 data_size 0x1(0xb61e bytes) 2019-12-16T22:45:49.842 INFO:teuthology.orchestra.run.smithi177.stdout:1703 trunc from 0xd40efba to 0x352157e 2019-12-16T22:45:49.858 INFO:teuthology.orchestra.run.smithi177.stdout:1326 write 0x4cf02f4 thru 0x4cfe709 (0xe416 bytes) 2019-12-16T22:45:49.871 INFO:teuthology.orchestra.run.smithi177.stdout:1327 read 0x26191fd thru 0x2623c33 (0xaa37 bytes) 2019-12-16T22:45:49.872 INFO:teuthology.orchestra.run.smithi177.stdout:1328 punch from 0x3db40d2 to 0x3db63da, (0x2308 bytes) 2019-12-16T22:45:49.872 INFO:teuthology.orchestra.run.smithi177.stdout:1329 punch from 0x3e5c151 to 0x3e66497, (0xa346 bytes) 2019-12-16T22:45:49.872 INFO:teuthology.orchestra.run.smithi177.stdout:1330 punch from 0x20e3d5e to 0x20f0be6, (0xce88 bytes) 2019-12-16T22:45:49.872 INFO:teuthology.orchestra.run.smithi177.stdout:1332 punch from 0x263c8c0 to 0x2646a8b, (0xa1cb bytes) 2019-12-16T22:45:49.873 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.875 INFO:teuthology.orchestra.run.smithi177.stdout:1534 punch from 0x271d5cc to 0x2720469, (0x2e9d bytes) 2019-12-16T22:45:49.875 INFO:teuthology.orchestra.run.smithi177.stdout:1535 read 0x843ea3c thru 0x84481a6 (0x976b bytes) 2019-12-16T22:45:49.875 INFO:teuthology.orchestra.run.smithi177.stdout:1559 read 0x7a63ad thru 0x7ad252 (0x6ea6 bytes) 2019-12-16T22:45:49.876 INFO:teuthology.orchestra.run.smithi177.stdout:1560 read 0xb237e82 thru 0xb238d59 (0xed8 bytes) 2019-12-16T22:45:49.876 INFO:teuthology.orchestra.run.smithi177.stdout:1564 read 0xa6a6262 thru 0xa6b2e20 (0xcbbf bytes) 2019-12-16T22:45:49.877 INFO:teuthology.orchestra.run.smithi177.stdout:1565 punch from 0x2156348 to 0x216098c, (0xa644 bytes) 2019-12-16T22:45:49.877 INFO:teuthology.orchestra.run.smithi177.stdout:1566 read 0x9b7bb82 thru 0x9b80304 (0x4783 bytes) 2019-12-16T22:45:49.877 INFO:teuthology.orchestra.run.smithi177.stdout:1567 write 0xca0c077 thru 0xca0d3b3 (0x133d bytes) 2019-12-16T22:45:49.883 INFO:teuthology.orchestra.run.smithi177.stdout:1568 punch from 0x9930217 to 0x9933e50, (0x3c39 bytes) 2019-12-16T22:45:49.884 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.884 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.884 INFO:teuthology.orchestra.run.smithi177.stdout:1571 punch from 0x7d86337 to 0x7d93516, (0xd1df bytes) 2019-12-16T22:45:49.884 INFO:teuthology.orchestra.run.smithi177.stdout:1572 writesame 0x308620c thru 0x308f0a1 data_size 0x1(0x8e96 bytes) 2019-12-16T22:45:49.904 INFO:teuthology.orchestra.run.smithi177.stdout:1536 trunc from 0xe091055 to 0x29a76d 2019-12-16T22:45:49.908 INFO:teuthology.orchestra.run.smithi177.stdout:1573 writesame 0x2710cf9 thru 0x271b3a5 data_size 0xb(0xa6ad bytes) 2019-12-16T22:45:49.913 INFO:teuthology.orchestra.run.smithi177.stdout:1704 punch from 0x258537e to 0x258edba, (0x9a3c bytes) 2019-12-16T22:45:49.913 INFO:teuthology.orchestra.run.smithi177.stdout:1705 read 0x1ee2f8d thru 0x1ef0e1c (0xde90 bytes) 2019-12-16T22:45:49.927 INFO:teuthology.orchestra.run.smithi177.stdout:1334 write 0xa9def07 thru 0xa9e1330 (0x242a bytes) 2019-12-16T22:45:49.929 INFO:teuthology.orchestra.run.smithi177.stdout:1575 punch from 0x3d5e8c4 to 0x3d5fbfb, (0x1337 bytes) 2019-12-16T22:45:49.943 INFO:teuthology.orchestra.run.smithi177.stdout:1335 trunc from 0xa9e1331 to 0xe36c0a1 2019-12-16T22:45:49.953 INFO:teuthology.orchestra.run.smithi177.stdout:1707 writesame 0xcf2f5ea thru 0xcf39b39 data_size 0x2e(0xa550 bytes) 2019-12-16T22:45:49.953 INFO:teuthology.orchestra.run.smithi177.stdout:1708 write 0x6a5ab3d thru 0x6a61765 (0x6c29 bytes) 2019-12-16T22:45:49.956 INFO:teuthology.orchestra.run.smithi177.stdout:1578 write 0xd94ec4a thru 0xd956811 (0x7bc8 bytes) 2019-12-16T22:45:49.957 INFO:teuthology.orchestra.run.smithi177.stdout:1709 writesame 0x4425266 thru 0x44338e6 data_size 0x1(0xe681 bytes) 2019-12-16T22:45:49.969 INFO:teuthology.orchestra.run.smithi177.stdout:1337 punch from 0x670a09b to 0x670a34b, (0x2b0 bytes) 2019-12-16T22:45:49.969 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.970 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.970 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:49.970 INFO:teuthology.orchestra.run.smithi177.stdout:1343 writesame 0x4d35a9c thru 0x4d3b88a data_size 0x1(0x5def bytes) 2019-12-16T22:45:49.998 INFO:teuthology.orchestra.run.smithi177.stdout:1579 trunc from 0xd956812 to 0x319fdba 2019-12-16T22:45:50.015 INFO:teuthology.orchestra.run.smithi177.stdout:1538 writesame 0x104a6ad thru 0x104d10b data_size 0x1(0x2a5f bytes) 2019-12-16T22:45:50.018 INFO:teuthology.orchestra.run.smithi177.stdout:1539 punch from 0xda3c7 to 0xe7282, (0xcebb bytes) 2019-12-16T22:45:50.019 INFO:teuthology.orchestra.run.smithi177.stdout:1344 trunc from 0xe36c0a1 to 0xbdcb483 2019-12-16T22:45:50.033 INFO:teuthology.orchestra.run.smithi177.stdout:1710 trunc from 0xcf39b3a to 0x12fa3c0 2019-12-16T22:45:50.043 INFO:teuthology.orchestra.run.smithi177.stdout:1541 trunc from 0x104d10c to 0xcf045d3 2019-12-16T22:45:50.071 INFO:teuthology.orchestra.run.smithi177.stdout:1345 writesame 0x37c49da thru 0x37c7504 data_size 0x1(0x2b2b bytes) 2019-12-16T22:45:50.086 INFO:teuthology.orchestra.run.smithi177.stdout:1542 write 0x7aea754 thru 0x7aedcc4 (0x3571 bytes) 2019-12-16T22:45:50.087 INFO:teuthology.orchestra.run.smithi177.stdout:1346 read 0x7b7128c thru 0x7b7bfab (0xad20 bytes) 2019-12-16T22:45:50.087 INFO:teuthology.orchestra.run.smithi177.stdout:1347 writesame 0x56ae921 thru 0x56bd97a data_size 0x69(0xf05a bytes) 2019-12-16T22:45:50.088 INFO:teuthology.orchestra.run.smithi177.stdout:1580 read 0x90535e thru 0x914a1c (0xf6bf bytes) 2019-12-16T22:45:50.096 INFO:teuthology.orchestra.run.smithi177.stdout:1543 write 0xbd9edc5 thru 0xbdac8e3 (0xdb1f bytes) 2019-12-16T22:45:50.102 INFO:teuthology.orchestra.run.smithi177.stdout:1348 write 0x1a0b19f thru 0x1a0e4e7 (0x3349 bytes) 2019-12-16T22:45:50.107 INFO:teuthology.orchestra.run.smithi177.stdout:1349 writesame 0xb397697 thru 0xb39b5d7 data_size 0x1(0x3f41 bytes) 2019-12-16T22:45:50.125 INFO:teuthology.orchestra.run.smithi177.stdout:1581 write 0xae9892b thru 0xae995ca (0xca0 bytes) 2019-12-16T22:45:50.129 INFO:teuthology.orchestra.run.smithi177.stdout:1545 trunc from 0xcf045d3 to 0x150d79b 2019-12-16T22:45:50.134 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.135 INFO:teuthology.orchestra.run.smithi177.stdout:1584 writesame 0xa9566dd thru 0xa959536 data_size 0x11(0x2e5a bytes) 2019-12-16T22:45:50.145 INFO:teuthology.orchestra.run.smithi177.stdout:1711 write 0xd0e5b48 thru 0xd0eca67 (0x6f20 bytes) 2019-12-16T22:45:50.148 INFO:teuthology.orchestra.run.smithi177.stdout:1585 read 0x8a80804 thru 0x8a86c51 (0x644e bytes) 2019-12-16T22:45:50.149 INFO:teuthology.orchestra.run.smithi177.stdout:1586 read 0x68bcfd4 thru 0x68cce31 (0xfe5e bytes) 2019-12-16T22:45:50.149 INFO:teuthology.orchestra.run.smithi177.stdout:1587 punch from 0x2a96de7 to 0x2aa5419, (0xe632 bytes) 2019-12-16T22:45:50.156 INFO:teuthology.orchestra.run.smithi177.stdout:1712 write 0xa6595c7 thru 0xa6642a4 (0xacde bytes) 2019-12-16T22:45:50.160 INFO:teuthology.orchestra.run.smithi177.stdout:1352 write 0xdb9d4be thru 0xdb9dcff (0x842 bytes) 2019-12-16T22:45:50.171 INFO:teuthology.orchestra.run.smithi177.stdout:1713 read 0xbd6c16b thru 0xbd7c13f (0xffd5 bytes) 2019-12-16T22:45:50.171 INFO:teuthology.orchestra.run.smithi177.stdout:1716 write 0xc23f34d thru 0xc244d9d (0x5a51 bytes) 2019-12-16T22:45:50.174 INFO:teuthology.orchestra.run.smithi177.stdout:1353 punch from 0x9a72d40 to 0x9a76c37, (0x3ef7 bytes) 2019-12-16T22:45:50.174 INFO:teuthology.orchestra.run.smithi177.stdout:1355 writesame 0xade5870 thru 0xaded1ae data_size 0x1(0x793f bytes) 2019-12-16T22:45:50.186 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.186 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.186 INFO:teuthology.orchestra.run.smithi177.stdout:1721 write 0x5c83a74 thru 0x5c9187d (0xde0a bytes) 2019-12-16T22:45:50.208 INFO:teuthology.orchestra.run.smithi177.stdout:1357 punch from 0x5f9765e to 0x5f97720, (0xc2 bytes) 2019-12-16T22:45:50.208 INFO:teuthology.orchestra.run.smithi177.stdout:1359 write 0x573704 thru 0x580ba7 (0xd4a4 bytes) 2019-12-16T22:45:50.208 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone15 from 0x8037110 (overlap 0x8037110) to 0x0 2019-12-16T22:45:50.212 INFO:teuthology.orchestra.run.smithi177.stdout:1588 writesame 0xd5423a1 thru 0xd54e43c data_size 0x2a(0xc09c bytes) 2019-12-16T22:45:50.216 INFO:teuthology.orchestra.run.smithi177.stdout:1589 trunc from 0xd54e43d to 0xe0f462c 2019-12-16T22:45:50.219 INFO:teuthology.orchestra.run.smithi177.stdout:1360 write 0x76c5e2f thru 0x76cb307 (0x54d9 bytes) 2019-12-16T22:45:50.227 INFO:teuthology.orchestra.run.smithi177.stdout:1546 writesame 0x9bc0aa2 thru 0x9bcb5cc data_size 0x1(0xab2b bytes) 2019-12-16T22:45:50.227 INFO:teuthology.orchestra.run.smithi177.stdout:1547 writesame 0x61c794c thru 0x61cde2f data_size 0x16(0x64e4 bytes) 2019-12-16T22:45:50.240 INFO:teuthology.orchestra.run.smithi177.stdout:1361 write 0x35c4c4c thru 0x35c75bd (0x2972 bytes) 2019-12-16T22:45:50.256 INFO:teuthology.orchestra.run.smithi177.stdout:1548 trunc from 0x9bcb5cd to 0xc58ddf4 2019-12-16T22:45:50.257 INFO:teuthology.orchestra.run.smithi177.stdout:1364 writesame 0x7340b25 thru 0x734595c data_size 0x4(0x4e38 bytes) 2019-12-16T22:45:50.263 INFO:teuthology.orchestra.run.smithi177.stdout:1590 read 0xab596b5 thru 0xab65928 (0xc274 bytes) 2019-12-16T22:45:50.263 INFO:teuthology.orchestra.run.smithi177.stdout:1591 writesame 0xdafb302 thru 0xdb07eb0 data_size 0x27(0xcbaf bytes) 2019-12-16T22:45:50.267 INFO:teuthology.orchestra.run.smithi177.stdout:1368 read 0x99b526d thru 0x99bd64d (0x83e1 bytes) 2019-12-16T22:45:50.267 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.268 INFO:teuthology.orchestra.run.smithi177.stdout:1370 read 0xb09ddf6 thru 0xb0acbc3 (0xedce bytes) 2019-12-16T22:45:50.268 INFO:teuthology.orchestra.run.smithi177.stdout:1371 read 0x4e7a13f thru 0x4e7f346 (0x5208 bytes) 2019-12-16T22:45:50.268 INFO:teuthology.orchestra.run.smithi177.stdout:1372 punch from 0xd72eee2 to 0xd72f92a, (0xa48 bytes) 2019-12-16T22:45:50.268 INFO:teuthology.orchestra.run.smithi177.stdout:1374 write 0x7705265 thru 0x77144f0 (0xf28c bytes) 2019-12-16T22:45:50.283 INFO:teuthology.orchestra.run.smithi177.stdout:1375 trunc from 0xdb9dd00 to 0xc22a8b5 2019-12-16T22:45:50.283 INFO:teuthology.orchestra.run.smithi177.stdout:1592 read 0xd7f551b thru 0xd8020ac (0xcb92 bytes) 2019-12-16T22:45:50.284 INFO:teuthology.orchestra.run.smithi177.stdout:1594 read 0x68163dd thru 0x681d848 (0x746c bytes) 2019-12-16T22:45:50.284 INFO:teuthology.orchestra.run.smithi177.stdout:1595 write 0x7e7d8f1 thru 0x7e89c8b (0xc39b bytes) 2019-12-16T22:45:50.288 INFO:teuthology.orchestra.run.smithi177.stdout:1549 trunc from 0xc58ddf4 to 0xd32c809 2019-12-16T22:45:50.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:50.294+0000 7f1b501e4700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x557462702100 handle_clone_image: failed to clone image mirror/10d720c9ce39 to image_cluster1.client.mirror.3-clone12 2019-12-16T22:45:50.314 INFO:teuthology.orchestra.run.smithi177.stdout:1552 read 0xa6f8268 thru 0xa6fe2d4 (0x606d bytes) 2019-12-16T22:45:50.315 INFO:teuthology.orchestra.run.smithi177.stdout:1553 read 0x58a94c7 thru 0x58ad0d7 (0x3c11 bytes) 2019-12-16T22:45:50.315 INFO:teuthology.orchestra.run.smithi177.stdout:1554 read 0xcda13e8 thru 0xcda4bf0 (0x3809 bytes) 2019-12-16T22:45:50.315 INFO:teuthology.orchestra.run.smithi177.stdout:1557 read 0xf1e4ac thru 0xf2474d (0x62a2 bytes) 2019-12-16T22:45:50.315 INFO:teuthology.orchestra.run.smithi177.stdout:1558 flatten 2019-12-16T22:45:50.316 INFO:teuthology.orchestra.run.smithi177.stdout:1377 writesame 0x512859 thru 0x51a821 data_size 0x1(0x7fc9 bytes) 2019-12-16T22:45:50.318 INFO:teuthology.orchestra.run.smithi177.stdout:1596 trunc from 0xe0f462c to 0x4701e4e 2019-12-16T22:45:50.344 INFO:teuthology.orchestra.run.smithi177.stdout:1559 punch from 0x1bbd167 to 0x1bc82ce, (0xb167 bytes) 2019-12-16T22:45:50.355 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.356 INFO:teuthology.orchestra.run.smithi177.stdout:1563 punch from 0x7cb76a8 to 0x7cbf266, (0x7bbe bytes) 2019-12-16T22:45:50.356 INFO:teuthology.orchestra.run.smithi177.stdout:1564 write 0x2f70cf2 thru 0x2f805c2 (0xf8d1 bytes) 2019-12-16T22:45:50.356 INFO:teuthology.orchestra.run.smithi177.stdout:1378 write 0xf96aac thru 0xfa1ed1 (0xb426 bytes) 2019-12-16T22:45:50.357 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #14, image image_cluster1.client.mirror.0-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent15 2019-12-16T22:45:50.360 INFO:teuthology.orchestra.run.smithi177.stdout:1565 write 0xbfc2dbe thru 0xbfcde3f (0xb082 bytes) 2019-12-16T22:45:50.364 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #9, image image_cluster1.client.mirror.1-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent10 2019-12-16T22:45:50.368 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.372 INFO:teuthology.orchestra.run.smithi177.stdout:1597 read 0x3c19b4 thru 0x3cc408 (0xaa55 bytes) 2019-12-16T22:45:50.372 INFO:teuthology.orchestra.run.smithi177.stdout:1379 write 0xc5793c8 thru 0xc57bd9f (0x29d8 bytes) 2019-12-16T22:45:50.372 INFO:teuthology.orchestra.run.smithi177.stdout:1598 read 0x397ed32 thru 0x398a44d (0xb71c bytes) 2019-12-16T22:45:50.373 INFO:teuthology.orchestra.run.smithi177.stdout:1600 writesame 0x32a5fb1 thru 0x32ae4b3 data_size 0x1(0x8503 bytes) 2019-12-16T22:45:50.386 INFO:teuthology.orchestra.run.smithi177.stdout:1380 write 0xaf7f2b8 thru 0xaf8b7cb (0xc514 bytes) 2019-12-16T22:45:50.389 INFO:teuthology.orchestra.run.smithi177.stdout:1601 read 0x47125c thru 0x47f88c (0xe631 bytes) 2019-12-16T22:45:50.398 INFO:teuthology.orchestra.run.smithi177.stdout:1381 punch from 0x7224061 to 0x7225b60, (0x1aff bytes) 2019-12-16T22:45:50.400 INFO:teuthology.orchestra.run.smithi177.stdout:1569 write 0xd6e7979 thru 0xd6f3551 (0xbbd9 bytes) 2019-12-16T22:45:50.409 INFO:teuthology.orchestra.run.smithi177.stdout:1382 trunc from 0xc57bda0 to 0x67b32b1 2019-12-16T22:45:50.411 INFO:teuthology.orchestra.run.smithi177.stdout:1570 punch from 0x1f928f6 to 0x1f94483, (0x1b8d bytes) 2019-12-16T22:45:50.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.411 INFO:teuthology.orchestra.run.smithi177.stdout:1576 punch from 0x230ae4e to 0x2310f15, (0x60c7 bytes) 2019-12-16T22:45:50.411 INFO:teuthology.orchestra.run.smithi177.stdout:1577 write 0x2565d1 thru 0x25830a (0x1d3a bytes) 2019-12-16T22:45:50.420 INFO:teuthology.orchestra.run.smithi177.stdout:1578 read 0x3aabed4 thru 0x3ab0382 (0x44af bytes) 2019-12-16T22:45:50.420 INFO:teuthology.orchestra.run.smithi177.stdout:1579 read 0xbbd5c64 thru 0xbbdf163 (0x9500 bytes) 2019-12-16T22:45:50.420 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.420 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.428 INFO:teuthology.orchestra.run.smithi177.stdout:1582 trunc from 0xd6f3552 to 0x9f37dde 2019-12-16T22:45:50.433 INFO:teuthology.orchestra.run.smithi177.stdout:1603 writesame 0xcf85a38 thru 0xcf8de8a data_size 0x19(0x8453 bytes) 2019-12-16T22:45:50.435 INFO:teuthology.orchestra.run.smithi177.stdout:1604 writesame 0x6ecb6f2 thru 0x6ece445 data_size 0x6(0x2d54 bytes) 2019-12-16T22:45:50.440 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.440 INFO:teuthology.orchestra.run.smithi177.stdout:1384 punch from 0x217ac1 to 0x221797, (0x9cd6 bytes) 2019-12-16T22:45:50.446 INFO:teuthology.orchestra.run.smithi177.stdout:1605 read 0x76d7ff3 thru 0x76e54b8 (0xd4c6 bytes) 2019-12-16T22:45:50.447 INFO:teuthology.orchestra.run.smithi177.stdout:1606 read 0x7741568 thru 0x77444a0 (0x2f39 bytes) 2019-12-16T22:45:50.447 INFO:teuthology.orchestra.run.smithi177.stdout:1607 writesame 0x4e6bdf6 thru 0x4e7a921 data_size 0x74(0xeb2c bytes) 2019-12-16T22:45:50.459 INFO:teuthology.orchestra.run.smithi177.stdout:1583 read 0x56d1c5b thru 0x56d7bd2 (0x5f78 bytes) 2019-12-16T22:45:50.459 INFO:teuthology.orchestra.run.smithi177.stdout:1584 read 0x94d41bf thru 0x94d7ac2 (0x3904 bytes) 2019-12-16T22:45:50.461 INFO:teuthology.orchestra.run.smithi177.stdout:1608 read 0x595a8cf thru 0x59617c6 (0x6ef8 bytes) 2019-12-16T22:45:50.461 INFO:teuthology.orchestra.run.smithi177.stdout:1609 read 0x73581a1 thru 0x735e025 (0x5e85 bytes) 2019-12-16T22:45:50.461 INFO:teuthology.orchestra.run.smithi177.stdout:1611 clone 13 order 18 su 32768 sc 10 2019-12-16T22:45:50.464 INFO:teuthology.orchestra.run.smithi177.stdout:1387 writesame 0x9144e3b thru 0x914fc9c data_size 0x65(0xae62 bytes) 2019-12-16T22:45:50.467 INFO:teuthology.orchestra.run.smithi177.stdout:1389 writesame 0x37bb767 thru 0x37bff49 data_size 0xb(0x47e3 bytes) 2019-12-16T22:45:50.477 INFO:teuthology.orchestra.run.smithi177.stdout:1390 read 0x3159523 thru 0x3160849 (0x7327 bytes) 2019-12-16T22:45:50.477 INFO:teuthology.orchestra.run.smithi177.stdout:1391 read 0x220d00b thru 0x2218f0e (0xbf04 bytes) 2019-12-16T22:45:50.478 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.479 INFO:teuthology.orchestra.run.smithi177.stdout:1586 write 0xbf96db6 thru 0xbf98bb5 (0x1e00 bytes) 2019-12-16T22:45:50.481 INFO:teuthology.orchestra.run.smithi177.stdout:1393 trunc from 0x914fc9d to 0xcbd29fa 2019-12-16T22:45:50.488 INFO:teuthology.orchestra.run.smithi177.stdout:1587 read 0xb770430 thru 0xb77afd1 (0xaba2 bytes) 2019-12-16T22:45:50.488 INFO:teuthology.orchestra.run.smithi177.stdout:1588 punch from 0x7d31985 to 0x7d31f81, (0x5fc bytes) 2019-12-16T22:45:50.489 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.489 INFO:teuthology.orchestra.run.smithi177.stdout:1591 writesame 0x4ca1a85 thru 0x4cad64d data_size 0x1(0xbbc9 bytes) 2019-12-16T22:45:50.507 INFO:teuthology.orchestra.run.smithi177.stdout:1394 punch from 0xbd86f9e to 0xbd95973, (0xe9d5 bytes) 2019-12-16T22:45:50.509 INFO:teuthology.orchestra.run.smithi177.stdout:1395 read 0x1933595 thru 0x193a13b (0x6ba7 bytes) 2019-12-16T22:45:50.509 INFO:teuthology.orchestra.run.smithi177.stdout:1396 punch from 0x37eb21a to 0x37eb324, (0x10a bytes) 2019-12-16T22:45:50.509 INFO:teuthology.orchestra.run.smithi177.stdout:1400 write 0x5dd0567 thru 0x5ddf1db (0xec75 bytes) 2019-12-16T22:45:50.526 INFO:teuthology.orchestra.run.smithi177.stdout:1401 punch from 0x8b39e8d to 0x8b43ac9, (0x9c3c bytes) 2019-12-16T22:45:50.527 INFO:teuthology.orchestra.run.smithi177.stdout:1402 writesame 0xc750f05 thru 0xc7598ee data_size 0x2(0x89ea bytes) 2019-12-16T22:45:50.527 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.527 INFO:teuthology.orchestra.run.smithi177.stdout:1593 read 0x32b6ef8 thru 0x32c4527 (0xd630 bytes) 2019-12-16T22:45:50.528 INFO:teuthology.orchestra.run.smithi177.stdout:1594 write 0x5e3f1a2 thru 0x5e46e18 (0x7c77 bytes) 2019-12-16T22:45:50.531 INFO:teuthology.orchestra.run.smithi177.stdout:1595 write 0x311e22a thru 0x3123f78 (0x5d4f bytes) 2019-12-16T22:45:50.542 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xed1437a 2019-12-16T22:45:50.547 INFO:teuthology.orchestra.run.smithi177.stdout:1405 trunc from 0xcbd29fa to 0xed1437a 2019-12-16T22:45:50.565 INFO:teuthology.orchestra.run.smithi177.stdout:1407 read 0xa76c4ea thru 0xa76eb91 (0x26a8 bytes) 2019-12-16T22:45:50.565 INFO:teuthology.orchestra.run.smithi177.stdout:1408 punch from 0x1178bb1 to 0x117fd88, (0x71d7 bytes) 2019-12-16T22:45:50.565 INFO:teuthology.orchestra.run.smithi177.stdout:1409 punch from 0x50a61eb to 0x50b3c4a, (0xda5f bytes) 2019-12-16T22:45:50.565 INFO:teuthology.orchestra.run.smithi177.stdout:1410 read 0xce3e930 thru 0xce44ceb (0x63bc bytes) 2019-12-16T22:45:50.565 INFO:teuthology.orchestra.run.smithi177.stdout:1411 read 0x48297c6 thru 0x482ca4b (0x3286 bytes) 2019-12-16T22:45:50.565 INFO:teuthology.orchestra.run.smithi177.stdout:1412 writesame 0x8d7806 thru 0x8d8344 data_size 0x1(0xb3f bytes) 2019-12-16T22:45:50.568 INFO:teuthology.orchestra.run.smithi177.stdout:1596 write 0xec9465e thru 0xeca1485 (0xce28 bytes) 2019-12-16T22:45:50.574 INFO:teuthology.orchestra.run.smithi177.stdout:1413 write 0x4ab9769 thru 0x4ac4e8b (0xb723 bytes) 2019-12-16T22:45:50.582 INFO:teuthology.orchestra.run.smithi177.stdout:1597 write 0x963d01b thru 0x9649a74 (0xca5a bytes) 2019-12-16T22:45:50.592 INFO:teuthology.orchestra.run.smithi177.stdout:1415 read 0x2951eca thru 0x295e516 (0xc64d bytes) 2019-12-16T22:45:50.592 INFO:teuthology.orchestra.run.smithi177.stdout:1417 read 0xa78298b thru 0xa7924fd (0xfb73 bytes) 2019-12-16T22:45:50.593 INFO:teuthology.orchestra.run.smithi177.stdout:1418 writesame 0x7134ac6 thru 0x7137681 data_size 0x6(0x2bbc bytes) 2019-12-16T22:45:50.595 INFO:teuthology.orchestra.run.smithi177.stdout:1598 read 0xb0ac6ab thru 0xb0b43e6 (0x7d3c bytes) 2019-12-16T22:45:50.595 INFO:teuthology.orchestra.run.smithi177.stdout:1600 read 0x3d869a0 thru 0x3d8ca7e (0x60df bytes) 2019-12-16T22:45:50.595 INFO:teuthology.orchestra.run.smithi177.stdout:1601 write 0xd5d865a thru 0xd5e36b8 (0xb05f bytes) 2019-12-16T22:45:50.602 INFO:teuthology.orchestra.run.smithi177.stdout:1419 read 0x2ea1ef3 thru 0x2eadc8f (0xbd9d bytes) 2019-12-16T22:45:50.603 INFO:teuthology.orchestra.run.smithi177.stdout:1420 read 0x3c4c670 thru 0x3c4d6ab (0x103c bytes) 2019-12-16T22:45:50.603 INFO:teuthology.orchestra.run.smithi177.stdout:1422 read 0xa520c80 thru 0xa52fd07 (0xf088 bytes) 2019-12-16T22:45:50.604 INFO:teuthology.orchestra.run.smithi177.stdout:1423 write 0xbebbefa thru 0xbebd43c (0x1543 bytes) 2019-12-16T22:45:50.606 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.606 INFO:teuthology.orchestra.run.smithi177.stdout:1603 writesame 0xe7939b7 thru 0xe797463 data_size 0x3(0x3aad bytes) 2019-12-16T22:45:50.610 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.610 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.610 INFO:teuthology.orchestra.run.smithi177.stdout:1426 read 0x85fcde3 thru 0x860b7bf (0xe9dd bytes) 2019-12-16T22:45:50.610 INFO:teuthology.orchestra.run.smithi177.stdout:1430 punch from 0x88358e5 to 0x8844f1d, (0xf638 bytes) 2019-12-16T22:45:50.616 INFO:teuthology.orchestra.run.smithi177.stdout:1431 trunc from 0xed1437a to 0xc339641 2019-12-16T22:45:50.616 INFO:teuthology.orchestra.run.smithi177.stdout:1604 read 0x79f2c5 thru 0x7a85e4 (0x9320 bytes) 2019-12-16T22:45:50.616 INFO:teuthology.orchestra.run.smithi177.stdout:1605 punch from 0x2eff149 to 0x2eff64c, (0x503 bytes) 2019-12-16T22:45:50.617 INFO:teuthology.orchestra.run.smithi177.stdout:1606 read 0x58adb25 thru 0x58ade6c (0x348 bytes) 2019-12-16T22:45:50.617 INFO:teuthology.orchestra.run.smithi177.stdout:1608 write 0xd6d5785 thru 0xd6e20c3 (0xc93f bytes) 2019-12-16T22:45:50.623 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.623 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.624 INFO:teuthology.orchestra.run.smithi177.stdout:1611 write 0xca2960f thru 0xca2f937 (0x6329 bytes) 2019-12-16T22:45:50.632 INFO:teuthology.orchestra.run.smithi177.stdout:1612 writesame 0x1ef12fa thru 0x1ef38b0 data_size 0x1(0x25b7 bytes) 2019-12-16T22:45:50.642 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.642 INFO:teuthology.orchestra.run.smithi177.stdout:1616 write 0xc33fe01 thru 0xc34aaac (0xacac bytes) 2019-12-16T22:45:50.643 INFO:teuthology.orchestra.run.smithi177.stdout:1434 trunc from 0xc339641 to 0x782d108 2019-12-16T22:45:50.647 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.664 INFO:teuthology.orchestra.run.smithi177.stdout:1435 punch from 0x6bb0de6 to 0x6bc058c, (0xf7a6 bytes) 2019-12-16T22:45:50.666 INFO:teuthology.orchestra.run.smithi177.stdout:1618 trunc from 0xeca1486 to 0x2f26c1e 2019-12-16T22:45:50.667 INFO:teuthology.orchestra.run.smithi177.stdout:1436 trunc from 0x782d108 to 0x9597c1f 2019-12-16T22:45:50.690 INFO:teuthology.orchestra.run.smithi177.stdout:1437 trunc from 0x9597c1f to 0x619a518 2019-12-16T22:45:50.696 INFO:teuthology.orchestra.run.smithi177.stdout:1619 read 0x13185fe thru 0x131e185 (0x5b88 bytes) 2019-12-16T22:45:50.697 INFO:teuthology.orchestra.run.smithi177.stdout:1621 read 0x162b4a9 thru 0x1630352 (0x4eaa bytes) 2019-12-16T22:45:50.697 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.713 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.713 INFO:teuthology.orchestra.run.smithi177.stdout:1635 read 0x988628 thru 0x9892f1 (0xcca bytes) 2019-12-16T22:45:50.714 INFO:teuthology.orchestra.run.smithi177.stdout:1623 writesame 0x5aa9777 thru 0x5aab280 data_size 0x1(0x1b0a bytes) 2019-12-16T22:45:50.717 INFO:teuthology.orchestra.run.smithi177.stdout:1624 read 0xe1a806 thru 0xe1e170 (0x396b bytes) 2019-12-16T22:45:50.725 INFO:teuthology.orchestra.run.smithi177.stdout:1636 read 0x6551263 thru 0x655ab67 (0x9905 bytes) 2019-12-16T22:45:50.725 INFO:teuthology.orchestra.run.smithi177.stdout:1638 write 0x3bd7d98 thru 0x3be7228 (0xf491 bytes) 2019-12-16T22:45:50.727 INFO:teuthology.orchestra.run.smithi177.stdout:1438 write 0x79b7504 thru 0x79c69aa (0xf4a7 bytes) 2019-12-16T22:45:50.747 INFO:teuthology.orchestra.run.smithi177.stdout:1439 writesame 0x278f851 thru 0x279b62d data_size 0x1(0xbddd bytes) 2019-12-16T22:45:50.749 INFO:teuthology.orchestra.run.smithi177.stdout:1625 write 0x940f6ce thru 0x941d612 (0xdf45 bytes) 2019-12-16T22:45:50.781 INFO:teuthology.orchestra.run.smithi177.stdout:2174 write 0x9cbe71 thru 0x9d0515 (0x46a5 bytes) 2019-12-16T22:45:50.784 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.793 INFO:teuthology.orchestra.run.smithi177.stdout:1628 trunc from 0x941d613 to 0x5844497 2019-12-16T22:45:50.794 INFO:teuthology.orchestra.run.smithi177.stdout:1443 read 0x3fc0414 thru 0x3fcb929 (0xb516 bytes) 2019-12-16T22:45:50.798 INFO:teuthology.orchestra.run.smithi177.stdout:1722 read 0x66f4c2d thru 0x66f7c25 (0x2ff9 bytes) 2019-12-16T22:45:50.798 INFO:teuthology.orchestra.run.smithi177.stdout:1723 write 0x425dfad thru 0x425ebff (0xc53 bytes) 2019-12-16T22:45:50.801 INFO:teuthology.orchestra.run.smithi177.stdout:1640 write 0xb5714fc thru 0xb5789e5 (0x74ea bytes) 2019-12-16T22:45:50.805 INFO:teuthology.orchestra.run.smithi177.stdout:1724 write 0x4f66e2c thru 0x4f74f92 (0xe167 bytes) 2019-12-16T22:45:50.806 INFO:teuthology.orchestra.run.smithi177.stdout:2176 writesame 0x368cc9c thru 0x3697b2c data_size 0x1d(0xae91 bytes) 2019-12-16T22:45:50.817 INFO:teuthology.orchestra.run.smithi177.stdout:1725 read 0x28ffd69 thru 0x290be4f (0xc0e7 bytes) 2019-12-16T22:45:50.817 INFO:teuthology.orchestra.run.smithi177.stdout:1727 punch from 0x99586b4 to 0x995f31f, (0x6c6b bytes) 2019-12-16T22:45:50.818 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.818 INFO:teuthology.orchestra.run.smithi177.stdout:1641 write 0x147c902 thru 0x1488120 (0xb81f bytes) 2019-12-16T22:45:50.820 INFO:teuthology.orchestra.run.smithi177.stdout:2177 writesame 0x8e9da3 thru 0x8ecffa data_size 0x24(0x3258 bytes) 2019-12-16T22:45:50.831 INFO:teuthology.orchestra.run.smithi177.stdout:1444 write 0xd4eb1e0 thru 0xd4f4e3f (0x9c60 bytes) 2019-12-16T22:45:50.832 INFO:teuthology.orchestra.run.smithi177.stdout:1730 trunc from 0xd0eca68 to 0x2ee2508 2019-12-16T22:45:50.838 INFO:teuthology.orchestra.run.smithi177.stdout:1643 write 0xc58e1b thru 0xc5b329 (0x250f bytes) 2019-12-16T22:45:50.839 INFO:teuthology.orchestra.run.smithi177.stdout:2178 read 0x5da16d thru 0x5e6f7d (0xce11 bytes) 2019-12-16T22:45:50.840 INFO:teuthology.orchestra.run.smithi177.stdout:2179 write 0x32819fe thru 0x32853da (0x39dd bytes) 2019-12-16T22:45:50.854 INFO:teuthology.orchestra.run.smithi177.stdout:1445 read 0x2a8ca71 thru 0x2a97a35 (0xafc5 bytes) 2019-12-16T22:45:50.854 INFO:teuthology.orchestra.run.smithi177.stdout:1446 writesame 0x7ccfd9b thru 0x7cd192c data_size 0x1(0x1b92 bytes) 2019-12-16T22:45:50.854 INFO:teuthology.orchestra.run.smithi177.stdout:1644 read 0x6e61257 thru 0x6e6ff46 (0xecf0 bytes) 2019-12-16T22:45:50.854 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.854 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.854 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.855 INFO:teuthology.orchestra.run.smithi177.stdout:1648 read 0x71669fd thru 0x716e58f (0x7b93 bytes) 2019-12-16T22:45:50.855 INFO:teuthology.orchestra.run.smithi177.stdout:1649 writesame 0x8c2761d thru 0x8c2934b data_size 0x1(0x1d2f bytes) 2019-12-16T22:45:50.860 INFO:teuthology.orchestra.run.smithi177.stdout:1447 read 0x2664a81 thru 0x266b0f8 (0x6678 bytes) 2019-12-16T22:45:50.860 INFO:teuthology.orchestra.run.smithi177.stdout:1448 read 0x20ad065 thru 0x20b044b (0x33e7 bytes) 2019-12-16T22:45:50.860 INFO:teuthology.orchestra.run.smithi177.stdout:1450 punch from 0x4bebad6 to 0x4bf5434, (0x995e bytes) 2019-12-16T22:45:50.860 INFO:teuthology.orchestra.run.smithi177.stdout:1451 read 0x577b24b thru 0x5782e82 (0x7c38 bytes) 2019-12-16T22:45:50.860 INFO:teuthology.orchestra.run.smithi177.stdout:1452 write 0x7f7fe3d thru 0x7f89576 (0x973a bytes) 2019-12-16T22:45:50.861 INFO:teuthology.orchestra.run.smithi177.stdout:2183 write 0x4c7152b thru 0x4c76665 (0x513b bytes) 2019-12-16T22:45:50.891 INFO:teuthology.orchestra.run.smithi177.stdout:1453 read 0x9526cca thru 0x952cd58 (0x608f bytes) 2019-12-16T22:45:50.892 INFO:teuthology.orchestra.run.smithi177.stdout:1454 read 0xb7c3704 thru 0xb7ce371 (0xac6e bytes) 2019-12-16T22:45:50.892 INFO:teuthology.orchestra.run.smithi177.stdout:1456 trunc from 0xd4f4e40 to 0xb9dca7a 2019-12-16T22:45:50.892 INFO:teuthology.orchestra.run.smithi177.stdout:1629 write 0xde409f6 thru 0xde41bed (0x11f8 bytes) 2019-12-16T22:45:50.892 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.892 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.893 INFO:teuthology.orchestra.run.smithi177.stdout:1651 writesame 0xcfbec23 thru 0xcfc670c data_size 0x1(0x7aea bytes) 2019-12-16T22:45:50.894 INFO:teuthology.orchestra.run.smithi177.stdout:2184 write 0xe518287 thru 0xe523dc3 (0xbb3d bytes) 2019-12-16T22:45:50.895 INFO:teuthology.orchestra.run.smithi177.stdout:1652 writesame 0xc7213a7 thru 0xc72ae4b data_size 0x3b(0x9aa5 bytes) 2019-12-16T22:45:50.904 INFO:teuthology.orchestra.run.smithi177.stdout:2187 read 0xc5c39c3 thru 0xc5d29cf (0xf00d bytes) 2019-12-16T22:45:50.904 INFO:teuthology.orchestra.run.smithi177.stdout:2188 read 0x789f7a7 thru 0x78acc56 (0xd4b0 bytes) 2019-12-16T22:45:50.906 INFO:teuthology.orchestra.run.smithi177.stdout:2189 punch from 0x5c857cb to 0x5c92a9f, (0xd2d4 bytes) 2019-12-16T22:45:50.906 INFO:teuthology.orchestra.run.smithi177.stdout:2190 write 0xaa02c6c thru 0xaa0c96a (0x9cff bytes) 2019-12-16T22:45:50.907 INFO:teuthology.orchestra.run.smithi177.stdout:1634 trunc from 0xde41bee to 0xf1bdc8 2019-12-16T22:45:50.909 INFO:teuthology.orchestra.run.smithi177.stdout:1653 read 0x38974fd thru 0x389fde4 (0x88e8 bytes) 2019-12-16T22:45:50.911 INFO:teuthology.orchestra.run.smithi177.stdout:1655 write 0x9459dc8 thru 0x94600d5 (0x630e bytes) 2019-12-16T22:45:50.918 INFO:teuthology.orchestra.run.smithi177.stdout:1734 write 0xca66adf thru 0xca70384 (0x98a6 bytes) 2019-12-16T22:45:50.919 INFO:teuthology.orchestra.run.smithi177.stdout:2191 write 0x71c962e thru 0x71d5d8f (0xc762 bytes) 2019-12-16T22:45:50.924 INFO:teuthology.orchestra.run.smithi177.stdout:1656 trunc from 0xcfc670d to 0xd744e4d 2019-12-16T22:45:50.927 INFO:teuthology.orchestra.run.smithi177.stdout:1737 write 0x5851e76 thru 0x585dcab (0xbe36 bytes) 2019-12-16T22:45:50.932 INFO:teuthology.orchestra.run.smithi177.stdout:2192 punch from 0x3d8e0e7 to 0x3d9a6b3, (0xc5cc bytes) 2019-12-16T22:45:50.932 INFO:teuthology.orchestra.run.smithi177.stdout:2193 read 0xb90aab4 thru 0xb91934f (0xe89c bytes) 2019-12-16T22:45:50.933 INFO:teuthology.orchestra.run.smithi177.stdout:2194 writesame 0xce893bf thru 0xce8ad91 data_size 0x1(0x19d3 bytes) 2019-12-16T22:45:50.938 INFO:teuthology.orchestra.run.smithi177.stdout:1457 write 0xc2672ba thru 0xc274135 (0xce7c bytes) 2019-12-16T22:45:50.943 INFO:teuthology.orchestra.run.smithi177.stdout:1738 punch from 0x3fea522 to 0x3ff3b99, (0x9677 bytes) 2019-12-16T22:45:50.943 INFO:teuthology.orchestra.run.smithi177.stdout:1739 read 0x3ce78dc thru 0x3cf4ae0 (0xd205 bytes) 2019-12-16T22:45:50.944 INFO:teuthology.orchestra.run.smithi177.stdout:1740 writesame 0x51214d thru 0x51cd59 data_size 0x17(0xac0d bytes) 2019-12-16T22:45:50.946 INFO:teuthology.orchestra.run.smithi177.stdout:2195 write 0x74c9f75 thru 0x74d50e6 (0xb172 bytes) 2019-12-16T22:45:50.955 INFO:teuthology.orchestra.run.smithi177.stdout:1657 write 0x8b49d0b thru 0x8b4aeb4 (0x11aa bytes) 2019-12-16T22:45:50.956 INFO:teuthology.orchestra.run.smithi177.stdout:1741 punch from 0x9990cd9 to 0x9990cdf, (0x6 bytes) 2019-12-16T22:45:50.956 INFO:teuthology.orchestra.run.smithi177.stdout:1742 write 0xb1d3288 thru 0xb1d3edb (0xc54 bytes) 2019-12-16T22:45:50.958 INFO:teuthology.orchestra.run.smithi177.stdout:1458 trunc from 0xc274136 to 0xabf250d 2019-12-16T22:45:50.959 INFO:teuthology.orchestra.run.smithi177.stdout:1635 read 0xaa7138 thru 0xaab4bb (0x4384 bytes) 2019-12-16T22:45:50.965 INFO:teuthology.orchestra.run.smithi177.stdout:2197 write 0x4f1de82 thru 0x4f255e0 (0x775f bytes) 2019-12-16T22:45:50.965 INFO:teuthology.orchestra.run.smithi177.stdout:1743 read 0x1cf61bf thru 0x1cf7c47 (0x1a89 bytes) 2019-12-16T22:45:50.965 INFO:teuthology.orchestra.run.smithi177.stdout:1744 write 0xac236d7 thru 0xac2c72d (0x9057 bytes) 2019-12-16T22:45:50.966 INFO:teuthology.orchestra.run.smithi177.stdout:1658 read 0x74544f thru 0x746f4e (0x1b00 bytes) 2019-12-16T22:45:50.966 INFO:teuthology.orchestra.run.smithi177.stdout:1660 punch from 0x5eea50 to 0x5f8852, (0x9e02 bytes) 2019-12-16T22:45:50.966 INFO:teuthology.orchestra.run.smithi177.stdout:1662 write 0x92b2a93 thru 0x92c1fdd (0xf54b bytes) 2019-12-16T22:45:50.971 INFO:teuthology.orchestra.run.smithi177.stdout:1636 trunc from 0xf1bdc8 to 0x77120a6 2019-12-16T22:45:50.971 INFO:teuthology.orchestra.run.smithi177.stdout:1745 write 0x67922 thru 0x69c55 (0x2334 bytes) 2019-12-16T22:45:50.982 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:50.982 INFO:teuthology.orchestra.run.smithi177.stdout:1748 writesame 0x70f2c20 thru 0x70ff285 data_size 0xf(0xc666 bytes) 2019-12-16T22:45:50.982 INFO:teuthology.orchestra.run.smithi177.stdout:1663 read 0xd0ea98 thru 0xd14f4b (0x64b4 bytes) 2019-12-16T22:45:50.983 INFO:teuthology.orchestra.run.smithi177.stdout:2198 punch from 0xcfe43ca to 0xcfe5fea, (0x1c20 bytes) 2019-12-16T22:45:50.984 INFO:teuthology.orchestra.run.smithi177.stdout:2199 punch from 0xcd074f to 0xcdd82a, (0xd0db bytes) 2019-12-16T22:45:50.984 INFO:teuthology.orchestra.run.smithi177.stdout:2200 read 0x8431197 thru 0x843662a (0x5494 bytes) 2019-12-16T22:45:50.995 INFO:teuthology.orchestra.run.smithi177.stdout:1460 writesame 0x2bb5c89 thru 0x2bc1193 data_size 0x7(0xb50b bytes) 2019-12-16T22:45:50.996 INFO:teuthology.orchestra.run.smithi177.stdout:1664 trunc from 0xd744e4d to 0x84ee593 2019-12-16T22:45:51.003 INFO:teuthology.orchestra.run.smithi177.stdout:2201 trunc from 0xe523dc4 to 0x6884362 2019-12-16T22:45:51.010 INFO:teuthology.orchestra.run.smithi177.stdout:1749 trunc from 0xca70385 to 0x2b66391 2019-12-16T22:45:51.011 INFO:teuthology.orchestra.run.smithi177.stdout:1461 write 0x2f3d9ba thru 0x2f4ba26 (0xe06d bytes) 2019-12-16T22:45:51.024 INFO:teuthology.orchestra.run.smithi177.stdout:1462 writesame 0xa6ce4b4 thru 0xa6d1643 data_size 0x3d(0x3190 bytes) 2019-12-16T22:45:51.041 INFO:teuthology.orchestra.run.smithi177.stdout:1463 write 0x13dfc34 thru 0x13ea85a (0xac27 bytes) 2019-12-16T22:45:51.055 INFO:teuthology.orchestra.run.smithi177.stdout:1666 punch from 0x1eebb2a to 0x1ef1f35, (0x640b bytes) 2019-12-16T22:45:51.055 INFO:teuthology.orchestra.run.smithi177.stdout:1669 read 0x3cc80ae thru 0x3cd7a36 (0xf989 bytes) 2019-12-16T22:45:51.055 INFO:teuthology.orchestra.run.smithi177.stdout:1638 writesame 0xa76708f thru 0xa76c3db data_size 0x5(0x534d bytes) 2019-12-16T22:45:51.058 INFO:teuthology.orchestra.run.smithi177.stdout:1639 write 0x7da30ba thru 0x7da737e (0x42c5 bytes) 2019-12-16T22:45:51.070 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.081 INFO:teuthology.orchestra.run.smithi177.stdout:2203 read 0x16d9f29 thru 0x16e6754 (0xc82c bytes) 2019-12-16T22:45:51.081 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.082 INFO:teuthology.orchestra.run.smithi177.stdout:1750 trunc from 0x2b66391 to 0x77b905f 2019-12-16T22:45:51.093 INFO:teuthology.orchestra.run.smithi177.stdout:1670 writesame 0xd11cc8e thru 0xd125e99 data_size 0xd(0x920c bytes) 2019-12-16T22:45:51.093 INFO:teuthology.orchestra.run.smithi177.stdout:1671 punch from 0x31f96b5 to 0x320839d, (0xece8 bytes) 2019-12-16T22:45:51.094 INFO:teuthology.orchestra.run.smithi177.stdout:1672 read 0x2118947 thru 0x211db2d (0x51e7 bytes) 2019-12-16T22:45:51.094 INFO:teuthology.orchestra.run.smithi177.stdout:1675 write 0x1733563 thru 0x173f809 (0xc2a7 bytes) 2019-12-16T22:45:51.098 INFO:teuthology.orchestra.run.smithi177.stdout:1465 write 0xdafb70a thru 0xdafc90a (0x1201 bytes) 2019-12-16T22:45:51.098 INFO:teuthology.orchestra.run.smithi177.stdout:1643 writesame 0xabc3f8c thru 0xabcb552 data_size 0x1(0x75c7 bytes) 2019-12-16T22:45:51.103 INFO:teuthology.orchestra.run.smithi177.stdout:1466 writesame 0x2437572 thru 0x2446d88 data_size 0x2b(0xf817 bytes) 2019-12-16T22:45:51.104 INFO:teuthology.orchestra.run.smithi177.stdout:1644 write 0x1ad70cf thru 0x1ada682 (0x35b4 bytes) 2019-12-16T22:45:51.107 INFO:teuthology.orchestra.run.smithi177.stdout:1751 write 0x5cf592b thru 0x5d0459d (0xec73 bytes) 2019-12-16T22:45:51.115 INFO:teuthology.orchestra.run.smithi177.stdout:2205 write 0xac0483d thru 0xac066ba (0x1e7e bytes) 2019-12-16T22:45:51.123 INFO:teuthology.orchestra.run.smithi177.stdout:1676 trunc from 0xd125e9a to 0xb6eea10 2019-12-16T22:45:51.124 INFO:teuthology.orchestra.run.smithi177.stdout:1467 read 0x65f11e1 thru 0x65f5581 (0x43a1 bytes) 2019-12-16T22:45:51.124 INFO:teuthology.orchestra.run.smithi177.stdout:1468 clone 11 order 24 su 262144 sc 4 2019-12-16T22:45:51.125 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.125 INFO:teuthology.orchestra.run.smithi177.stdout:1754 write 0xe52f14 thru 0xe5fe1e (0xcf0b bytes) 2019-12-16T22:45:51.131 INFO:teuthology.orchestra.run.smithi177.stdout:1645 trunc from 0xabcb553 to 0x58b04ad 2019-12-16T22:45:51.133 INFO:teuthology.orchestra.run.smithi177.stdout:2206 writesame 0xdbe3e3 thru 0xdbe601 data_size 0x3(0x21f bytes) 2019-12-16T22:45:51.135 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.135 INFO:teuthology.orchestra.run.smithi177.stdout:1756 read 0x6391d7a thru 0x639dd0c (0xbf93 bytes) 2019-12-16T22:45:51.137 INFO:teuthology.orchestra.run.smithi177.stdout:1758 read 0x652856e thru 0x6534ecf (0xc962 bytes) 2019-12-16T22:45:51.137 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.137 INFO:teuthology.orchestra.run.smithi177.stdout:1760 read 0x712c713 thru 0x7138fe5 (0xc8d3 bytes) 2019-12-16T22:45:51.138 INFO:teuthology.orchestra.run.smithi177.stdout:1764 punch from 0x3afa2ec to 0x3b09e1c, (0xfb30 bytes) 2019-12-16T22:45:51.139 INFO:teuthology.orchestra.run.smithi177.stdout:1765 read 0x2e0a775 thru 0x2e12c11 (0x849d bytes) 2019-12-16T22:45:51.139 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.139 INFO:teuthology.orchestra.run.smithi177.stdout:1767 write 0x2baaf5d thru 0x2bb2066 (0x710a bytes) 2019-12-16T22:45:51.143 INFO:teuthology.orchestra.run.smithi177.stdout:2207 write 0x7cbba99 thru 0x7cbd62c (0x1b94 bytes) 2019-12-16T22:45:51.146 INFO:teuthology.orchestra.run.smithi177.stdout:1769 punch from 0x42af20f to 0x42b120a, (0x1ffb bytes) 2019-12-16T22:45:51.146 INFO:teuthology.orchestra.run.smithi177.stdout:1770 punch from 0x69f9e34 to 0x6a02d4d, (0x8f19 bytes) 2019-12-16T22:45:51.149 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.149 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.149 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.150 INFO:teuthology.orchestra.run.smithi177.stdout:1683 read 0xb31156d thru 0xb31ebe1 (0xd675 bytes) 2019-12-16T22:45:51.150 INFO:teuthology.orchestra.run.smithi177.stdout:1684 writesame 0x47f3b93 thru 0x47fff0d data_size 0x7(0xc37b bytes) 2019-12-16T22:45:51.155 INFO:teuthology.orchestra.run.smithi177.stdout:2208 trunc from 0xac066bb to 0xccf6948 2019-12-16T22:45:51.162 INFO:teuthology.orchestra.run.smithi177.stdout:1685 read 0x57efef2 thru 0x57f3599 (0x36a8 bytes) 2019-12-16T22:45:51.162 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.163 INFO:teuthology.orchestra.run.smithi177.stdout:1689 write 0x2f86ac5 thru 0x2f93f67 (0xd4a3 bytes) 2019-12-16T22:45:51.167 INFO:teuthology.orchestra.run.smithi177.stdout:1646 write 0x3a42815 thru 0x3a4e43f (0xbc2b bytes) 2019-12-16T22:45:51.175 INFO:teuthology.orchestra.run.smithi177.stdout:1772 write 0x7da0779 thru 0x7da41d3 (0x3a5b bytes) 2019-12-16T22:45:51.177 INFO:teuthology.orchestra.run.smithi177.stdout:1647 write 0x57d4c1e thru 0x57dabc5 (0x5fa8 bytes) 2019-12-16T22:45:51.188 INFO:teuthology.orchestra.run.smithi177.stdout:1773 read 0x151ae79 thru 0x15288da (0xda62 bytes) 2019-12-16T22:45:51.192 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.3-clone12 intact 2019-12-16T22:45:51.194 INFO:teuthology.orchestra.run.smithi177.stdout:1775 trunc from 0x7da41d4 to 0xa294a1c 2019-12-16T22:45:51.197 INFO:teuthology.orchestra.run.smithi177.stdout:1690 trunc from 0xb6eea10 to 0x7362416 2019-12-16T22:45:51.203 INFO:teuthology.orchestra.run.smithi177.stdout:2209 write 0xdd7850b thru 0xdd7a5a2 (0x2098 bytes) 2019-12-16T22:45:51.207 INFO:teuthology.orchestra.run.smithi177.stdout:1648 trunc from 0x58b04ad to 0xe2be594 2019-12-16T22:45:51.213 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.213 INFO:teuthology.orchestra.run.smithi177.stdout:2211 punch from 0xc9b0e2b to 0xc9ba32c, (0x9501 bytes) 2019-12-16T22:45:51.234 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.235 INFO:teuthology.orchestra.run.smithi177.stdout:1650 write 0x276f9f9 thru 0x2774ba3 (0x51ab bytes) 2019-12-16T22:45:51.235 INFO:teuthology.orchestra.run.smithi177.stdout:1776 trunc from 0xa294a1c to 0x2a0b1d7 2019-12-16T22:45:51.238 INFO:teuthology.orchestra.run.smithi177.stdout:2214 trunc from 0xdd7a5a3 to 0x24fff7a 2019-12-16T22:45:51.281 INFO:teuthology.orchestra.run.smithi177.stdout:1651 write 0xe7153c3 thru 0xe7155e6 (0x224 bytes) 2019-12-16T22:45:51.289 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.289 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.297 INFO:teuthology.orchestra.run.smithi177.stdout:1777 writesame 0x4157953 thru 0x4159169 data_size 0x1(0x1817 bytes) 2019-12-16T22:45:51.302 INFO:teuthology.orchestra.run.smithi177.stdout:1778 read 0x3a79688 thru 0x3a800af (0x6a28 bytes) 2019-12-16T22:45:51.304 INFO:teuthology.orchestra.run.smithi177.stdout:1692 write 0xd8fec6d thru 0xd90ac5d (0xbff1 bytes) 2019-12-16T22:45:51.306 INFO:teuthology.orchestra.run.smithi177.stdout:1779 trunc from 0x415916a to 0x5438e48 2019-12-16T22:45:51.313 INFO:teuthology.orchestra.run.smithi177.stdout:1656 writesame 0xec2303e thru 0xec31dc4 data_size 0x1(0xed87 bytes) 2019-12-16T22:45:51.318 INFO:teuthology.orchestra.run.smithi177.stdout:1657 punch from 0x835871d to 0x8366f32, (0xe815 bytes) 2019-12-16T22:45:51.318 INFO:teuthology.orchestra.run.smithi177.stdout:1658 write 0x2f3a6cd thru 0x2f44e06 (0xa73a bytes) 2019-12-16T22:45:51.331 INFO:teuthology.orchestra.run.smithi177.stdout:1693 write 0x5cf25c9 thru 0x5cf5e9f (0x38d7 bytes) 2019-12-16T22:45:51.332 INFO:teuthology.orchestra.run.smithi177.stdout:1660 write 0xa75c023 thru 0xa75f6fd (0x36db bytes) 2019-12-16T22:45:51.340 INFO:teuthology.orchestra.run.smithi177.stdout:2215 write 0x43a41f3 thru 0x43b2183 (0xdf91 bytes) 2019-12-16T22:45:51.341 INFO:teuthology.orchestra.run.smithi177.stdout:1694 write 0x3539de2 thru 0x353bd3c (0x1f5b bytes) 2019-12-16T22:45:51.342 INFO:teuthology.orchestra.run.smithi177.stdout:1661 read 0x81ddf3b thru 0x81e80a5 (0xa16b bytes) 2019-12-16T22:45:51.343 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.343 INFO:teuthology.orchestra.run.smithi177.stdout:1664 write 0x66d424c thru 0x66dd578 (0x932d bytes) 2019-12-16T22:45:51.345 INFO:teuthology.orchestra.run.smithi177.stdout:1780 punch from 0x13d189d to 0x13d5963, (0x40c6 bytes) 2019-12-16T22:45:51.355 INFO:teuthology.orchestra.run.smithi177.stdout:1665 writesame 0x4766954 thru 0x476ed37 data_size 0x2e(0x83e4 bytes) 2019-12-16T22:45:51.361 INFO:teuthology.orchestra.run.smithi177.stdout:1667 read 0x7860e41 thru 0x786576c (0x492c bytes) 2019-12-16T22:45:51.361 INFO:teuthology.orchestra.run.smithi177.stdout:1669 writesame 0x126adb7 thru 0x1274aaa data_size 0x29(0x9cf4 bytes) 2019-12-16T22:45:51.365 INFO:teuthology.orchestra.run.smithi177.stdout:2216 trunc from 0x43b2184 to 0x91f97f0 2019-12-16T22:45:51.370 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.370 INFO:teuthology.orchestra.run.smithi177.stdout:1671 write 0x27c5207 thru 0x27caa8f (0x5889 bytes) 2019-12-16T22:45:51.370 INFO:teuthology.orchestra.run.smithi177.stdout:1695 trunc from 0xd90ac5e to 0x452aa6e 2019-12-16T22:45:51.379 INFO:teuthology.orchestra.run.smithi177.stdout:1672 writesame 0xc532933 thru 0xc533a41 data_size 0x1(0x110f bytes) 2019-12-16T22:45:51.379 INFO:teuthology.orchestra.run.smithi177.stdout:1781 write 0xb43393e thru 0xb43fcd7 (0xc39a bytes) 2019-12-16T22:45:51.395 INFO:teuthology.orchestra.run.smithi177.stdout:1673 read 0x5bab63a thru 0x5bb379b (0x8162 bytes) 2019-12-16T22:45:51.395 INFO:teuthology.orchestra.run.smithi177.stdout:1674 punch from 0x6dba8fc to 0x6dc822a, (0xd92e bytes) 2019-12-16T22:45:51.395 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.395 INFO:teuthology.orchestra.run.smithi177.stdout:1676 punch from 0xc99abcb to 0xc9a21a0, (0x75d5 bytes) 2019-12-16T22:45:51.395 INFO:teuthology.orchestra.run.smithi177.stdout:1677 punch from 0x7c44ea8 to 0x7c48a8d, (0x3be5 bytes) 2019-12-16T22:45:51.396 INFO:teuthology.orchestra.run.smithi177.stdout:2217 punch from 0x9955ba to 0x9a10ec, (0xbb32 bytes) 2019-12-16T22:45:51.397 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.397 INFO:teuthology.orchestra.run.smithi177.stdout:1783 writesame 0x1e81085 thru 0x1e836ca data_size 0x6(0x2646 bytes) 2019-12-16T22:45:51.405 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.405 INFO:teuthology.orchestra.run.smithi177.stdout:1786 read 0x41be8c1 thru 0x41c6966 (0x80a6 bytes) 2019-12-16T22:45:51.405 INFO:teuthology.orchestra.run.smithi177.stdout:1787 read 0x14bcf26 thru 0x14c2c69 (0x5d44 bytes) 2019-12-16T22:45:51.405 INFO:teuthology.orchestra.run.smithi177.stdout:1788 read 0x9b61055 thru 0x9b620a3 (0x104f bytes) 2019-12-16T22:45:51.405 INFO:teuthology.orchestra.run.smithi177.stdout:1790 punch from 0x2fc6cef to 0x2fc8860, (0x1b71 bytes) 2019-12-16T22:45:51.419 INFO:teuthology.orchestra.run.smithi177.stdout:2218 write 0xa26aadb thru 0xa2778e6 (0xce0c bytes) 2019-12-16T22:45:51.420 INFO:teuthology.orchestra.run.smithi177.stdout:1678 trunc from 0xec31dc5 to 0x18b7869 2019-12-16T22:45:51.420 INFO:teuthology.orchestra.run.smithi177.stdout:1791 trunc from 0xb43fcd8 to 0x3861189 2019-12-16T22:45:51.433 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #11, image image_cluster1.client.mirror.3-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent12 2019-12-16T22:45:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.470 INFO:teuthology.orchestra.run.smithi177.stdout:1681 read 0x5b1c75 thru 0x5bc829 (0xabb5 bytes) 2019-12-16T22:45:51.472 INFO:teuthology.orchestra.run.smithi177.stdout:2219 write 0xc4a5724 thru 0xc4b0dc0 (0xb69d bytes) 2019-12-16T22:45:51.473 INFO:teuthology.orchestra.run.smithi177.stdout:1794 write 0xd2366f thru 0xd23ab0 (0x442 bytes) 2019-12-16T22:45:51.481 INFO:teuthology.orchestra.run.smithi177.stdout:1795 read 0x9657b3 thru 0x96e480 (0x8cce bytes) 2019-12-16T22:45:51.482 INFO:teuthology.orchestra.run.smithi177.stdout:1796 trunc from 0x3861189 to 0x380ac49 2019-12-16T22:45:51.484 INFO:teuthology.orchestra.run.smithi177.stdout:1613 write 0x7488da2 thru 0x74896b4 (0x913 bytes) 2019-12-16T22:45:51.485 INFO:teuthology.orchestra.run.smithi177.stdout:2220 writesame 0x1549b4e thru 0x1550f6c data_size 0x1b(0x741f bytes) 2019-12-16T22:45:51.496 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.496 INFO:teuthology.orchestra.run.smithi177.stdout:2222 writesame 0x15b3682 thru 0x15bb495 data_size 0x2(0x7e14 bytes) 2019-12-16T22:45:51.497 INFO:teuthology.orchestra.run.smithi177.stdout:1682 writesame 0x2827765 thru 0x282ca50 data_size 0x74(0x52ec bytes) 2019-12-16T22:45:51.498 INFO:teuthology.orchestra.run.smithi177.stdout:1696 write 0x4ddaf3b thru 0x4ddbe83 (0xf49 bytes) 2019-12-16T22:45:51.506 INFO:teuthology.orchestra.run.smithi177.stdout:1697 punch from 0x139ee5a to 0x13a60f7, (0x729d bytes) 2019-12-16T22:45:51.527 INFO:teuthology.orchestra.run.smithi177.stdout:1614 trunc from 0xcf8de8b to 0x89af913 2019-12-16T22:45:51.570 INFO:teuthology.orchestra.run.smithi177.stdout:1698 trunc from 0x4ddbe84 to 0xc2e24cc 2019-12-16T22:45:51.570 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.570 INFO:teuthology.orchestra.run.smithi177.stdout:1700 write 0xdb5570 thru 0xdb76f7 (0x2188 bytes) 2019-12-16T22:45:51.570 INFO:teuthology.orchestra.run.smithi177.stdout:1702 trunc from 0xc2e24cc to 0xb43afd2 2019-12-16T22:45:51.570 INFO:teuthology.orchestra.run.smithi177.stdout:2223 trunc from 0xc4b0dc1 to 0x750e934 2019-12-16T22:45:51.571 INFO:teuthology.orchestra.run.smithi177.stdout:2226 writesame 0x50db482 thru 0x50e23ec data_size 0x1(0x6f6b bytes) 2019-12-16T22:45:51.571 INFO:teuthology.orchestra.run.smithi177.stdout:1683 write 0x44bb298 thru 0x44be73a (0x34a3 bytes) 2019-12-16T22:45:51.571 INFO:teuthology.orchestra.run.smithi177.stdout:1684 trunc from 0x44be73b to 0xbf776af 2019-12-16T22:45:51.571 INFO:teuthology.orchestra.run.smithi177.stdout:1797 writesame 0xd917105 thru 0xd918f08 data_size 0x22(0x1e04 bytes) 2019-12-16T22:45:51.571 INFO:teuthology.orchestra.run.smithi177.stdout:1798 read 0xd1dec8f thru 0xd1e0c5b (0x1fcd bytes) 2019-12-16T22:45:51.571 INFO:teuthology.orchestra.run.smithi177.stdout:1799 punch from 0x583c855 to 0x583f6a7, (0x2e52 bytes) 2019-12-16T22:45:51.572 INFO:teuthology.orchestra.run.smithi177.stdout:1800 write 0x2401b05 thru 0x240fc04 (0xe100 bytes) 2019-12-16T22:45:51.572 INFO:teuthology.orchestra.run.smithi177.stdout:1801 punch from 0x7246ce5 to 0x7254343, (0xd65e bytes) 2019-12-16T22:45:51.572 INFO:teuthology.orchestra.run.smithi177.stdout:1802 punch from 0xc71c5a5 to 0xc727313, (0xad6e bytes) 2019-12-16T22:45:51.572 INFO:teuthology.orchestra.run.smithi177.stdout:1803 write 0x8d98825 thru 0x8d9a533 (0x1d0f bytes) 2019-12-16T22:45:51.572 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.572 INFO:teuthology.orchestra.run.smithi177.stdout:1616 write 0x349ef17 thru 0x34a038b (0x1475 bytes) 2019-12-16T22:45:51.573 INFO:teuthology.orchestra.run.smithi177.stdout:1804 write 0x1e2c507 thru 0x1e30b0f (0x4609 bytes) 2019-12-16T22:45:51.587 INFO:teuthology.orchestra.run.smithi177.stdout:2228 punch from 0x116eb1d to 0x117e8ee, (0xfdd1 bytes) 2019-12-16T22:45:51.588 INFO:teuthology.orchestra.run.smithi177.stdout:2231 write 0x4f69657 thru 0x4f78ba1 (0xf54b bytes) 2019-12-16T22:45:51.589 INFO:teuthology.orchestra.run.smithi177.stdout:1617 punch from 0x59051c2 to 0x5914072, (0xeeb0 bytes) 2019-12-16T22:45:51.590 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.590 INFO:teuthology.orchestra.run.smithi177.stdout:1621 read 0x58071ae thru 0x5809558 (0x23ab bytes) 2019-12-16T22:45:51.590 INFO:teuthology.orchestra.run.smithi177.stdout:1622 read 0x657938c thru 0x657b3d0 (0x2045 bytes) 2019-12-16T22:45:51.591 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.592 INFO:teuthology.orchestra.run.smithi177.stdout:1806 punch from 0xc7b78a1 to 0xc7c5dd4, (0xe533 bytes) 2019-12-16T22:45:51.592 INFO:teuthology.orchestra.run.smithi177.stdout:1808 read 0x8940d0c thru 0x8945d33 (0x5028 bytes) 2019-12-16T22:45:51.592 INFO:teuthology.orchestra.run.smithi177.stdout:1809 read 0xbedd7d3 thru 0xbee1a5e (0x428c bytes) 2019-12-16T22:45:51.592 INFO:teuthology.orchestra.run.smithi177.stdout:1810 punch from 0xd747d00 to 0xd756fcb, (0xf2cb bytes) 2019-12-16T22:45:51.592 INFO:teuthology.orchestra.run.smithi177.stdout:1811 read 0xd455840 thru 0xd45aa98 (0x5259 bytes) 2019-12-16T22:45:51.592 INFO:teuthology.orchestra.run.smithi177.stdout:1812 punch from 0x547d351 to 0x548b7c3, (0xe472 bytes) 2019-12-16T22:45:51.593 INFO:teuthology.orchestra.run.smithi177.stdout:1813 punch from 0x3afb736 to 0x3b0a90d, (0xf1d7 bytes) 2019-12-16T22:45:51.593 INFO:teuthology.orchestra.run.smithi177.stdout:1816 write 0x5a1156d thru 0x5a152a2 (0x3d36 bytes) 2019-12-16T22:45:51.604 INFO:teuthology.orchestra.run.smithi177.stdout:1624 trunc from 0x89af913 to 0x2251332 2019-12-16T22:45:51.606 INFO:teuthology.orchestra.run.smithi177.stdout:1817 trunc from 0xd918f09 to 0xb4abc22 2019-12-16T22:45:51.610 INFO:teuthology.orchestra.run.smithi177.stdout:1703 read 0x2f1fc62 thru 0x2f27ec9 (0x8268 bytes) 2019-12-16T22:45:51.611 INFO:teuthology.orchestra.run.smithi177.stdout:1704 write 0x9b08920 thru 0x9b12929 (0xa00a bytes) 2019-12-16T22:45:51.630 INFO:teuthology.orchestra.run.smithi177.stdout:1685 trunc from 0xbf776af to 0x2354aba 2019-12-16T22:45:51.630 INFO:teuthology.orchestra.run.smithi177.stdout:1705 writesame 0x89410a4 thru 0x894c3af data_size 0xe(0xb30c bytes) 2019-12-16T22:45:51.645 INFO:teuthology.orchestra.run.smithi177.stdout:1706 read 0x31d244c thru 0x31d5dfa (0x39af bytes) 2019-12-16T22:45:51.646 INFO:teuthology.orchestra.run.smithi177.stdout:1707 write 0x8fcc2bd thru 0x8fce429 (0x216d bytes) 2019-12-16T22:45:51.650 INFO:teuthology.orchestra.run.smithi177.stdout:1818 trunc from 0xb4abc22 to 0x47cbeeb 2019-12-16T22:45:51.654 INFO:teuthology.orchestra.run.smithi177.stdout:2232 writesame 0xdf981e4 thru 0xdfa7f73 data_size 0x8(0xfd90 bytes) 2019-12-16T22:45:51.655 INFO:teuthology.orchestra.run.smithi177.stdout:1708 read 0x6110460 thru 0x611bf92 (0xbb33 bytes) 2019-12-16T22:45:51.657 INFO:teuthology.orchestra.run.smithi177.stdout:2233 read 0x1705a0a thru 0x170bc4d (0x6244 bytes) 2019-12-16T22:45:51.658 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.658 INFO:teuthology.orchestra.run.smithi177.stdout:2237 write 0x72b471d thru 0x72c04ea (0xbdce bytes) 2019-12-16T22:45:51.669 INFO:teuthology.orchestra.run.smithi177.stdout:1711 trunc from 0xb43afd2 to 0x3d16630 2019-12-16T22:45:51.701 INFO:teuthology.orchestra.run.smithi177.stdout:2238 trunc from 0xdfa7f74 to 0x1752bb3 2019-12-16T22:45:51.707 INFO:teuthology.orchestra.run.smithi177.stdout:1626 trunc from 0x2251332 to 0xe669a60 2019-12-16T22:45:51.709 INFO:teuthology.orchestra.run.smithi177.stdout:1819 writesame 0x51a8a3c thru 0x51b7487 data_size 0xa(0xea4c bytes) 2019-12-16T22:45:51.713 INFO:teuthology.orchestra.run.smithi177.stdout:1820 write 0x4b1b6c9 thru 0x4b1d2c3 (0x1bfb bytes) 2019-12-16T22:45:51.721 INFO:teuthology.orchestra.run.smithi177.stdout:1821 read 0x484bf5e thru 0x484fac0 (0x3b63 bytes) 2019-12-16T22:45:51.721 INFO:teuthology.orchestra.run.smithi177.stdout:1822 read 0xe45721 thru 0xe47dbc (0x269c bytes) 2019-12-16T22:45:51.731 INFO:teuthology.orchestra.run.smithi177.stdout:1686 write 0xea67f6d thru 0xea6eb98 (0x6c2c bytes) 2019-12-16T22:45:51.738 INFO:teuthology.orchestra.run.smithi177.stdout:1627 write 0xde99b33 thru 0xdea3fec (0xa4ba bytes) 2019-12-16T22:45:51.746 INFO:teuthology.orchestra.run.smithi177.stdout:1687 write 0xd645f91 thru 0xd64b0ab (0x511b bytes) 2019-12-16T22:45:51.753 INFO:teuthology.orchestra.run.smithi177.stdout:1628 write 0xc2c6514 thru 0xc2d11c3 (0xacb0 bytes) 2019-12-16T22:45:51.759 INFO:teuthology.orchestra.run.smithi177.stdout:1688 read 0x54cdd9e thru 0x54dd787 (0xf9ea bytes) 2019-12-16T22:45:51.759 INFO:teuthology.orchestra.run.smithi177.stdout:1689 write 0x16df792 thru 0x16edcd8 (0xe547 bytes) 2019-12-16T22:45:51.774 INFO:teuthology.orchestra.run.smithi177.stdout:1690 read 0xa026f82 thru 0xa02a7ad (0x382c bytes) 2019-12-16T22:45:51.774 INFO:teuthology.orchestra.run.smithi177.stdout:1691 read 0x6d0ee1c thru 0x6d15d71 (0x6f56 bytes) 2019-12-16T22:45:51.774 INFO:teuthology.orchestra.run.smithi177.stdout:1692 punch from 0x9109830 to 0x9114f11, (0xb6e1 bytes) 2019-12-16T22:45:51.775 INFO:teuthology.orchestra.run.smithi177.stdout:1693 write 0x41c0b47 thru 0x41c966f (0x8b29 bytes) 2019-12-16T22:45:51.775 INFO:teuthology.orchestra.run.smithi177.stdout:1712 read 0x438862 thru 0x43b95a (0x30f9 bytes) 2019-12-16T22:45:51.775 INFO:teuthology.orchestra.run.smithi177.stdout:1823 writesame 0xe1b5863 thru 0xe1b8d89 data_size 0x1(0x3527 bytes) 2019-12-16T22:45:51.776 INFO:teuthology.orchestra.run.smithi177.stdout:1713 write 0x13c24b1 thru 0x13c515f (0x2caf bytes) 2019-12-16T22:45:51.776 INFO:teuthology.orchestra.run.smithi177.stdout:1630 write 0x837bbe8 thru 0x837f6c2 (0x3adb bytes) 2019-12-16T22:45:51.778 INFO:teuthology.orchestra.run.smithi177.stdout:1824 write 0x730c484 thru 0x7312d5b (0x68d8 bytes) 2019-12-16T22:45:51.784 INFO:teuthology.orchestra.run.smithi177.stdout:2240 read 0x148ea11 thru 0x14998f9 (0xaee9 bytes) 2019-12-16T22:45:51.784 INFO:teuthology.orchestra.run.smithi177.stdout:1695 read 0x60c176a thru 0x60c297b (0x1212 bytes) 2019-12-16T22:45:51.785 INFO:teuthology.orchestra.run.smithi177.stdout:2241 read 0x31570f thru 0x3249b3 (0xf2a5 bytes) 2019-12-16T22:45:51.786 INFO:teuthology.orchestra.run.smithi177.stdout:2242 read 0x1674455 thru 0x167f3ce (0xaf7a bytes) 2019-12-16T22:45:51.787 INFO:teuthology.orchestra.run.smithi177.stdout:1631 read 0x43ef553 thru 0x43f562c (0x60da bytes) 2019-12-16T22:45:51.787 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.787 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.787 INFO:teuthology.orchestra.run.smithi177.stdout:1634 punch from 0x63095f2 to 0x6316718, (0xd126 bytes) 2019-12-16T22:45:51.788 INFO:teuthology.orchestra.run.smithi177.stdout:1636 write 0xbea2974 thru 0xbeaa45d (0x7aea bytes) 2019-12-16T22:45:51.788 INFO:teuthology.orchestra.run.smithi177.stdout:1714 read 0x1def4ad thru 0x1df5b0a (0x665e bytes) 2019-12-16T22:45:51.789 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.790 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.790 INFO:teuthology.orchestra.run.smithi177.stdout:1717 read 0x990029 thru 0x9907e5 (0x7bd bytes) 2019-12-16T22:45:51.797 INFO:teuthology.orchestra.run.smithi177.stdout:1637 write 0x695c718 thru 0x696a414 (0xdcfd bytes) 2019-12-16T22:45:51.815 INFO:teuthology.orchestra.run.smithi177.stdout:1697 trunc from 0xea6eb99 to 0x179289b 2019-12-16T22:45:51.815 INFO:teuthology.orchestra.run.smithi177.stdout:1639 punch from 0x6dcbb12 to 0x6dd7024, (0xb512 bytes) 2019-12-16T22:45:51.815 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.821 INFO:teuthology.orchestra.run.smithi177.stdout:1641 trunc from 0xe669a60 to 0xc7a4c41 2019-12-16T22:45:51.824 INFO:teuthology.orchestra.run.smithi177.stdout:1826 write 0xeb2e070 thru 0xeb3c890 (0xe821 bytes) 2019-12-16T22:45:51.828 INFO:teuthology.orchestra.run.smithi177.stdout:1718 write 0x7ee155d thru 0x7eef2be (0xdd62 bytes) 2019-12-16T22:45:51.842 INFO:teuthology.orchestra.run.smithi177.stdout:2243 write 0xe9ef12e thru 0xe9f107e (0x1f51 bytes) 2019-12-16T22:45:51.843 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.843 INFO:teuthology.orchestra.run.smithi177.stdout:1830 read 0x70f0022 thru 0x70f1e0d (0x1dec bytes) 2019-12-16T22:45:51.843 INFO:teuthology.orchestra.run.smithi177.stdout:1831 read 0xc1f4db6 thru 0xc1fa3dc (0x5627 bytes) 2019-12-16T22:45:51.843 INFO:teuthology.orchestra.run.smithi177.stdout:1832 trunc from 0xeb3c891 to 0xd8ecfe7 2019-12-16T22:45:51.844 INFO:teuthology.orchestra.run.smithi177.stdout:1720 read 0x3c75fca thru 0x3c7d560 (0x7597 bytes) 2019-12-16T22:45:51.847 INFO:teuthology.orchestra.run.smithi177.stdout:2245 read 0x464ab92 thru 0x465a351 (0xf7c0 bytes) 2019-12-16T22:45:51.848 INFO:teuthology.orchestra.run.smithi177.stdout:1642 writesame 0x45abbb9 thru 0x45afd6c data_size 0x3a(0x41b4 bytes) 2019-12-16T22:45:51.856 INFO:teuthology.orchestra.run.smithi177.stdout:1645 write 0x6658212 thru 0x665dc3e (0x5a2d bytes) 2019-12-16T22:45:51.857 INFO:teuthology.orchestra.run.smithi177.stdout:1722 trunc from 0x7eef2bf to 0xe70e74d 2019-12-16T22:45:51.865 INFO:teuthology.orchestra.run.smithi177.stdout:1649 read 0x4d8e108 thru 0x4d9006a (0x1f63 bytes) 2019-12-16T22:45:51.865 INFO:teuthology.orchestra.run.smithi177.stdout:1650 read 0xb1cb2c4 thru 0xb1d8601 (0xd33e bytes) 2019-12-16T22:45:51.866 INFO:teuthology.orchestra.run.smithi177.stdout:1652 clone 14 order 20 su 32768 sc 4 2019-12-16T22:45:51.876 INFO:teuthology.orchestra.run.smithi177.stdout:1834 punch from 0x8e6a01f to 0x8e75003, (0xafe4 bytes) 2019-12-16T22:45:51.876 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.876 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:51.876 INFO:teuthology.orchestra.run.smithi177.stdout:1837 punch from 0x96ebaae to 0x96f3d36, (0x8288 bytes) 2019-12-16T22:45:51.877 INFO:teuthology.orchestra.run.smithi177.stdout:1698 write 0x1c2a71e thru 0x1c34578 (0x9e5b bytes) 2019-12-16T22:45:51.877 INFO:teuthology.orchestra.run.smithi177.stdout:2246 trunc from 0xe9f107f to 0x21a1858 2019-12-16T22:45:51.881 INFO:teuthology.orchestra.run.smithi177.stdout:1700 write 0x99798 thru 0xa51e6 (0xba4f bytes) 2019-12-16T22:45:51.888 INFO:teuthology.orchestra.run.smithi177.stdout:1701 read 0x74758a thru 0x753777 (0xc1ee bytes) 2019-12-16T22:45:51.889 INFO:teuthology.orchestra.run.smithi177.stdout:1704 read 0x9b72ff thru 0x9bd786 (0x6488 bytes) 2019-12-16T22:45:51.900 INFO:teuthology.orchestra.run.smithi177.stdout:1705 clone 13 order 25 su 4194304 sc 14 2019-12-16T22:45:51.900 INFO:teuthology.orchestra.run.smithi177.stdout:1840 trunc from 0xd8ecfe7 to 0x3261cad 2019-12-16T22:45:51.904 INFO:teuthology.orchestra.run.smithi177.stdout:1723 trunc from 0xe70e74d to 0x8bcf98 2019-12-16T22:45:51.924 INFO:teuthology.orchestra.run.smithi177.stdout:1842 clone 12 order 21 su 131072 sc 7 2019-12-16T22:45:51.937 INFO:teuthology.orchestra.run.smithi177.stdout:2247 write 0x78e0e6c thru 0x78ea9ce (0x9b63 bytes) 2019-12-16T22:45:51.956 INFO:teuthology.orchestra.run.smithi177.stdout:2248 clone 12 order 19 su 4096 sc 3 2019-12-16T22:45:51.988 INFO:teuthology.orchestra.run.smithi177.stdout:1724 clone 17 order 19 su 16384 sc 7 2019-12-16T22:45:52.213 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone11 from 0x78ea9cf (overlap 0x1752bb3) to 0x12a895c 2019-12-16T22:45:52.216 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone10 from 0xdafc90b (overlap 0xd783e4) to 0x2b1a60 2019-12-16T22:45:52.287 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone16 from 0x8bcf98 (overlap 0x8bcf98) to 0xdfb28 2019-12-16T22:45:52.289 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone13 from 0xc7a4c41 (overlap 0x2251332) to 0x0 2019-12-16T22:45:52.332 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #11, image image_cluster1.client.mirror.4-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent12 2019-12-16T22:45:52.364 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #10, image image_cluster1.client.mirror.5-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent11 2019-12-16T22:45:52.427 INFO:teuthology.orchestra.run.smithi177.stdout:1706 read 0x13a3c89 thru 0x13b1ecb (0xe243 bytes) 2019-12-16T22:45:52.472 INFO:teuthology.orchestra.run.smithi177.stdout:1707 read 0x14a2a97 thru 0x14a82e8 (0x5852 bytes) 2019-12-16T22:45:52.487 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #10, image image_cluster1.client.mirror.1-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent11 2019-12-16T22:45:52.524 INFO:teuthology.orchestra.run.smithi177.stdout:1708 write 0xb8f0ea5 thru 0xb8f5abc (0x4c18 bytes) 2019-12-16T22:45:52.543 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #9, image image_cluster1.client.mirror.2-clone9 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent10 2019-12-16T22:45:52.551 INFO:teuthology.orchestra.run.smithi177.stdout:1709 read 0x873fb1a thru 0x874c39c (0xc883 bytes) 2019-12-16T22:45:52.551 INFO:teuthology.orchestra.run.smithi177.stdout:1711 write 0x20e65e9 thru 0x20e8ccf (0x26e7 bytes) 2019-12-16T22:45:52.568 INFO:teuthology.orchestra.run.smithi177.stdout:1712 write 0x324e941 thru 0x3259386 (0xaa46 bytes) 2019-12-16T22:45:52.585 INFO:teuthology.orchestra.run.smithi177.stdout:1843 write 0x9fd9d69 thru 0x9fe5762 (0xb9fa bytes) 2019-12-16T22:45:52.591 INFO:teuthology.orchestra.run.smithi177.stdout:1713 writesame 0x9978a67 thru 0x997d456 data_size 0x68(0x49f0 bytes) 2019-12-16T22:45:52.623 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.623 INFO:teuthology.orchestra.run.smithi177.stdout:1848 read 0x8f580f1 thru 0x8f5b900 (0x3810 bytes) 2019-12-16T22:45:52.624 INFO:teuthology.orchestra.run.smithi177.stdout:1714 write 0x3db756 thru 0x3dc654 (0xeff bytes) 2019-12-16T22:45:52.624 INFO:teuthology.orchestra.run.smithi177.stdout:1715 read 0x38e2d1b thru 0x38e30f7 (0x3dd bytes) 2019-12-16T22:45:52.624 INFO:teuthology.orchestra.run.smithi177.stdout:1716 read 0xb3ab9d5 thru 0xb3afbec (0x4218 bytes) 2019-12-16T22:45:52.624 INFO:teuthology.orchestra.run.smithi177.stdout:1717 punch from 0x5189140 to 0x518d300, (0x41c0 bytes) 2019-12-16T22:45:52.624 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.624 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.625 INFO:teuthology.orchestra.run.smithi177.stdout:1720 trunc from 0xb8f5abd to 0x7eec87b 2019-12-16T22:45:52.632 INFO:teuthology.orchestra.run.smithi177.stdout:1849 write 0xed56e51 thru 0xed6453d (0xd6ed bytes) 2019-12-16T22:45:52.645 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #15, image image_cluster1.client.mirror.0-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent16 2019-12-16T22:45:52.646 INFO:teuthology.orchestra.run.smithi177.stdout:1850 write 0xd1d01b6 thru 0xd1d29ed (0x2838 bytes) 2019-12-16T22:45:52.656 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.656 INFO:teuthology.orchestra.run.smithi177.stdout:1852 write 0xe4fcef thru 0xe55f6f (0x6281 bytes) 2019-12-16T22:45:52.669 INFO:teuthology.orchestra.run.smithi177.stdout:1721 read 0x4024c42 thru 0x402c741 (0x7b00 bytes) 2019-12-16T22:45:52.670 INFO:teuthology.orchestra.run.smithi177.stdout:1722 read 0x4550fa2 thru 0x455e07e (0xd0dd bytes) 2019-12-16T22:45:52.671 INFO:teuthology.orchestra.run.smithi177.stdout:1725 punch from 0x525566 to 0x530c55, (0xb6ef bytes) 2019-12-16T22:45:52.686 INFO:teuthology.orchestra.run.smithi177.stdout:1723 write 0x7efc349 thru 0x7f025a7 (0x625f bytes) 2019-12-16T22:45:52.686 INFO:teuthology.orchestra.run.smithi177.stdout:1854 trunc from 0xed6453e to 0x52ec198 2019-12-16T22:45:52.714 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.714 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.715 INFO:teuthology.orchestra.run.smithi177.stdout:1857 read 0x14215a5 thru 0x14300b3 (0xeb0f bytes) 2019-12-16T22:45:52.715 INFO:teuthology.orchestra.run.smithi177.stdout:1858 punch from 0x14b50a8 to 0x14b88ab, (0x3803 bytes) 2019-12-16T22:45:52.715 INFO:teuthology.orchestra.run.smithi177.stdout:1860 read 0x2a70120 thru 0x2a7f127 (0xf008 bytes) 2019-12-16T22:45:52.717 INFO:teuthology.orchestra.run.smithi177.stdout:1724 write 0xb48b6cd thru 0xb490002 (0x4936 bytes) 2019-12-16T22:45:52.724 INFO:teuthology.orchestra.run.smithi177.stdout:1727 writesame 0xb1e6ed8 thru 0xb1e7846 data_size 0x17(0x96f bytes) 2019-12-16T22:45:52.725 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.725 INFO:teuthology.orchestra.run.smithi177.stdout:1727 write 0x6110072 thru 0x611dd8d (0xdd1c bytes) 2019-12-16T22:45:52.725 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #12, image image_cluster1.client.mirror.3-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent13 2019-12-16T22:45:52.728 INFO:teuthology.orchestra.run.smithi177.stdout:1728 punch from 0xa59591a to 0xa59f4e5, (0x9bcb bytes) 2019-12-16T22:45:52.728 INFO:teuthology.orchestra.run.smithi177.stdout:1729 punch from 0x9e63b23 to 0x9e63f7a, (0x457 bytes) 2019-12-16T22:45:52.728 INFO:teuthology.orchestra.run.smithi177.stdout:1730 writesame 0xa92b23f thru 0xa93a4da data_size 0x2(0xf29c bytes) 2019-12-16T22:45:52.739 INFO:teuthology.orchestra.run.smithi177.stdout:1861 write 0x5ccfc5c thru 0x5cd42e2 (0x4687 bytes) 2019-12-16T22:45:52.757 INFO:teuthology.orchestra.run.smithi177.stdout:1731 punch from 0x1919078 to 0x191b198, (0x2120 bytes) 2019-12-16T22:45:52.759 INFO:teuthology.orchestra.run.smithi177.stdout:1732 write 0x41d2267 thru 0x41d54c4 (0x325e bytes) 2019-12-16T22:45:52.765 INFO:teuthology.orchestra.run.smithi177.stdout:1728 writesame 0xe1f84d0 thru 0xe201f10 data_size 0x1(0x9a41 bytes) 2019-12-16T22:45:52.765 INFO:teuthology.orchestra.run.smithi177.stdout:1733 write 0x1f3d415 thru 0x1f47188 (0x9d74 bytes) 2019-12-16T22:45:52.766 INFO:teuthology.orchestra.run.smithi177.stdout:1730 punch from 0x48679db to 0x4871ba2, (0xa1c7 bytes) 2019-12-16T22:45:52.766 INFO:teuthology.orchestra.run.smithi177.stdout:1731 write 0x9ccab8d thru 0x9cd820f (0xd683 bytes) 2019-12-16T22:45:52.781 INFO:teuthology.orchestra.run.smithi177.stdout:1732 punch from 0x86eb02b to 0x86f34bd, (0x8492 bytes) 2019-12-16T22:45:52.782 INFO:teuthology.orchestra.run.smithi177.stdout:1734 write 0x3b27a56 thru 0x3b28d25 (0x12d0 bytes) 2019-12-16T22:45:52.789 INFO:teuthology.orchestra.run.smithi177.stdout:1863 write 0xb4b0a12 thru 0xb4bca9c (0xc08b bytes) 2019-12-16T22:45:52.796 INFO:teuthology.orchestra.run.smithi177.stdout:1864 writesame 0x6c94d6d thru 0x6c9cb47 data_size 0x1d(0x7ddb bytes) 2019-12-16T22:45:52.810 INFO:teuthology.orchestra.run.smithi177.stdout:1733 trunc from 0xe201f11 to 0x216ba60 2019-12-16T22:45:52.827 INFO:teuthology.orchestra.run.smithi177.stdout:1469 punch from 0x89cb355 to 0x89d6a29, (0xb6d4 bytes) 2019-12-16T22:45:52.829 INFO:teuthology.orchestra.run.smithi177.stdout:1735 write 0xe92f1a6 thru 0xe9376e8 (0x8543 bytes) 2019-12-16T22:45:52.834 INFO:teuthology.orchestra.run.smithi177.stdout:1865 writesame 0xec045e8 thru 0xec0c7b8 data_size 0x1(0x81d1 bytes) 2019-12-16T22:45:52.838 INFO:teuthology.orchestra.run.smithi177.stdout:1866 write 0xa29e71f thru 0xa2a8629 (0x9f0b bytes) 2019-12-16T22:45:52.847 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.847 INFO:teuthology.orchestra.run.smithi177.stdout:1737 write 0x3f2824 thru 0x3fa3fa (0x7bd7 bytes) 2019-12-16T22:45:52.848 INFO:teuthology.orchestra.run.smithi177.stdout:1470 read 0x1429254 thru 0x142b97b (0x2728 bytes) 2019-12-16T22:45:52.851 INFO:teuthology.orchestra.run.smithi177.stdout:1471 writesame 0x2e2d115 thru 0x2e3c875 data_size 0x53(0xf761 bytes) 2019-12-16T22:45:52.856 INFO:teuthology.orchestra.run.smithi177.stdout:1868 read 0xac7efbe thru 0xac8beb3 (0xcef6 bytes) 2019-12-16T22:45:52.856 INFO:teuthology.orchestra.run.smithi177.stdout:1869 punch from 0x6f68666 to 0x6f6ea83, (0x641d bytes) 2019-12-16T22:45:52.856 INFO:teuthology.orchestra.run.smithi177.stdout:1871 read 0x6dd9fe5 thru 0x6dddbcf (0x3beb bytes) 2019-12-16T22:45:52.856 INFO:teuthology.orchestra.run.smithi177.stdout:1872 read 0xdb0f18 thru 0xdb7560 (0x6649 bytes) 2019-12-16T22:45:52.857 INFO:teuthology.orchestra.run.smithi177.stdout:1873 read 0x7bf6d63 thru 0x7c019cb (0xac69 bytes) 2019-12-16T22:45:52.857 INFO:teuthology.orchestra.run.smithi177.stdout:1874 punch from 0x5283baf to 0x5292e4f, (0xf2a0 bytes) 2019-12-16T22:45:52.857 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.857 INFO:teuthology.orchestra.run.smithi177.stdout:1876 read 0x6225d5e thru 0x62319af (0xbc52 bytes) 2019-12-16T22:45:52.857 INFO:teuthology.orchestra.run.smithi177.stdout:1877 writesame 0xd6eac20 thru 0xd6ec7c2 data_size 0x5(0x1ba3 bytes) 2019-12-16T22:45:52.858 INFO:teuthology.orchestra.run.smithi177.stdout:1734 punch from 0xa1b836 to 0xa1d701, (0x1ecb bytes) 2019-12-16T22:45:52.871 INFO:teuthology.orchestra.run.smithi177.stdout:1474 read 0xcbef86b thru 0xcbf9ff0 (0xa786 bytes) 2019-12-16T22:45:52.885 INFO:teuthology.orchestra.run.smithi177.stdout:1880 read 0x94b223d thru 0x94ba30b (0x80cf bytes) 2019-12-16T22:45:52.886 INFO:teuthology.orchestra.run.smithi177.stdout:1881 read 0x754715e thru 0x7548aa8 (0x194b bytes) 2019-12-16T22:45:52.886 INFO:teuthology.orchestra.run.smithi177.stdout:1882 read 0xaa7cf53 thru 0xaa8b277 (0xe325 bytes) 2019-12-16T22:45:52.890 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.890 INFO:teuthology.orchestra.run.smithi177.stdout:1740 write 0x3a06763 thru 0x3a11068 (0xa906 bytes) 2019-12-16T22:45:52.899 INFO:teuthology.orchestra.run.smithi177.stdout:1475 trunc from 0xdafc90b to 0x15ebcad 2019-12-16T22:45:52.904 INFO:teuthology.orchestra.run.smithi177.stdout:1736 write 0xe11c05a thru 0xe11c4e8 (0x48f bytes) 2019-12-16T22:45:52.910 INFO:teuthology.orchestra.run.smithi177.stdout:1741 read 0x4ddfdb5 thru 0x4de18a3 (0x1aef bytes) 2019-12-16T22:45:52.910 INFO:teuthology.orchestra.run.smithi177.stdout:1742 read 0x2b38318 thru 0x2b443e5 (0xc0ce bytes) 2019-12-16T22:45:52.910 INFO:teuthology.orchestra.run.smithi177.stdout:1745 read 0x52817c8 thru 0x528f24e (0xda87 bytes) 2019-12-16T22:45:52.910 INFO:teuthology.orchestra.run.smithi177.stdout:1746 read 0xe250b8b thru 0xe258e25 (0x829b bytes) 2019-12-16T22:45:52.910 INFO:teuthology.orchestra.run.smithi177.stdout:1747 write 0x1030876 thru 0x1036f32 (0x66bd bytes) 2019-12-16T22:45:52.911 INFO:teuthology.orchestra.run.smithi177.stdout:1883 trunc from 0xec0c7b9 to 0x1a03b28 2019-12-16T22:45:52.911 INFO:teuthology.orchestra.run.smithi177.stdout:1737 read 0x3a690c6 thru 0x3a78c0e (0xfb49 bytes) 2019-12-16T22:45:52.911 INFO:teuthology.orchestra.run.smithi177.stdout:1738 read 0xd8b2f44 thru 0xd8c0244 (0xd301 bytes) 2019-12-16T22:45:52.911 INFO:teuthology.orchestra.run.smithi177.stdout:1739 punch from 0x2288602 to 0x2292cbb, (0xa6b9 bytes) 2019-12-16T22:45:52.922 INFO:teuthology.orchestra.run.smithi177.stdout:1743 trunc from 0xe11c4e9 to 0xa346823 2019-12-16T22:45:52.940 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.940 INFO:teuthology.orchestra.run.smithi177.stdout:1749 punch from 0x88c1c09 to 0x88c89ba, (0x6db1 bytes) 2019-12-16T22:45:52.941 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.941 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:52.941 INFO:teuthology.orchestra.run.smithi177.stdout:1752 write 0xb95fee4 thru 0xb96c869 (0xc986 bytes) 2019-12-16T22:45:52.975 INFO:teuthology.orchestra.run.smithi177.stdout:1744 punch from 0x99a5dfa to 0x99afb11, (0x9d17 bytes) 2019-12-16T22:45:52.976 INFO:teuthology.orchestra.run.smithi177.stdout:1745 writesame 0x4dd051e thru 0x4de00e0 data_size 0x1(0xfbc3 bytes) 2019-12-16T22:45:52.976 INFO:teuthology.orchestra.run.smithi177.stdout:1476 read 0xa65ac2 thru 0xa6a3ce (0x490d bytes) 2019-12-16T22:45:53.061 INFO:teuthology.orchestra.run.smithi177.stdout:1478 write 0xd729ebe thru 0xd72fe3d (0x5f80 bytes) 2019-12-16T22:45:53.063 INFO:teuthology.orchestra.run.smithi177.stdout:1756 trunc from 0xe9376e9 to 0xac46935 2019-12-16T22:45:53.075 INFO:teuthology.orchestra.run.smithi177.stdout:1746 read 0x10701b7 thru 0x107c21e (0xc068 bytes) 2019-12-16T22:45:53.077 INFO:teuthology.orchestra.run.smithi177.stdout:1747 read 0x48d11b8 thru 0x48d79fc (0x6845 bytes) 2019-12-16T22:45:53.079 INFO:teuthology.orchestra.run.smithi177.stdout:1748 write 0x1403b6d thru 0x140b13c (0x75d0 bytes) 2019-12-16T22:45:53.086 INFO:teuthology.orchestra.run.smithi177.stdout:1479 writesame 0x8134f6d thru 0x8140a73 data_size 0x1d(0xbb07 bytes) 2019-12-16T22:45:53.096 INFO:teuthology.orchestra.run.smithi177.stdout:1751 write 0x6db03e7 thru 0x6dbc2e1 (0xbefb bytes) 2019-12-16T22:45:53.129 INFO:teuthology.orchestra.run.smithi177.stdout:1752 punch from 0x96f5514 to 0x96f7d3a, (0x2826 bytes) 2019-12-16T22:45:53.130 INFO:teuthology.orchestra.run.smithi177.stdout:1754 read 0x39627b1 thru 0x39680c2 (0x5912 bytes) 2019-12-16T22:45:53.130 INFO:teuthology.orchestra.run.smithi177.stdout:1755 read 0x1605fb3 thru 0x160f589 (0x95d7 bytes) 2019-12-16T22:45:53.130 INFO:teuthology.orchestra.run.smithi177.stdout:1758 read 0x4a09ae5 thru 0x4a11007 (0x7523 bytes) 2019-12-16T22:45:53.130 INFO:teuthology.orchestra.run.smithi177.stdout:1759 clone 14 order 24 su 1048576 sc 4 2019-12-16T22:45:53.130 INFO:teuthology.orchestra.run.smithi177.stdout:1885 read 0x17edc26 thru 0x17f59ab (0x7d86 bytes) 2019-12-16T22:45:53.131 INFO:teuthology.orchestra.run.smithi177.stdout:1886 punch from 0xc52a0 to 0xc6283, (0xfe3 bytes) 2019-12-16T22:45:53.131 INFO:teuthology.orchestra.run.smithi177.stdout:2249 read 0x53790e5 thru 0x537f3c8 (0x62e4 bytes) 2019-12-16T22:45:53.145 INFO:teuthology.orchestra.run.smithi177.stdout:1480 trunc from 0xd72fe3e to 0x629ad52 2019-12-16T22:45:53.154 INFO:teuthology.orchestra.run.smithi177.stdout:2250 trunc from 0x78ea9cf to 0x1e15808 2019-12-16T22:45:53.170 INFO:teuthology.orchestra.run.smithi177.stdout:1481 clone 12 order 22 su 2097152 sc 10 2019-12-16T22:45:53.170 INFO:teuthology.orchestra.run.smithi177.stdout:1887 write 0xce06f01 thru 0xce14b9c (0xdc9c bytes) 2019-12-16T22:45:53.173 INFO:teuthology.orchestra.run.smithi177.stdout:1757 write 0xdb5887b thru 0xdb5e4c5 (0x5c4b bytes) 2019-12-16T22:45:53.183 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.183 INFO:teuthology.orchestra.run.smithi177.stdout:1890 write 0x2989a0d thru 0x29947b6 (0xadaa bytes) 2019-12-16T22:45:53.185 INFO:teuthology.orchestra.run.smithi177.stdout:1758 read 0x4f361b9 thru 0x4f45e4f (0xfc97 bytes) 2019-12-16T22:45:53.185 INFO:teuthology.orchestra.run.smithi177.stdout:1759 punch from 0xa51c0af to 0xa528659, (0xc5aa bytes) 2019-12-16T22:45:53.185 INFO:teuthology.orchestra.run.smithi177.stdout:1761 writesame 0x1fe5ec5 thru 0x1ff229e data_size 0x56(0xc3da bytes) 2019-12-16T22:45:53.190 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.191 INFO:teuthology.orchestra.run.smithi177.stdout:2252 read 0x1b7ec2e thru 0x1b89864 (0xac37 bytes) 2019-12-16T22:45:53.191 INFO:teuthology.orchestra.run.smithi177.stdout:2253 punch from 0x1556c22 to 0x155eb7a, (0x7f58 bytes) 2019-12-16T22:45:53.195 INFO:teuthology.orchestra.run.smithi177.stdout:1891 writesame 0x168bd3a thru 0x1699231 data_size 0x5e(0xd4f8 bytes) 2019-12-16T22:45:53.199 INFO:teuthology.orchestra.run.smithi177.stdout:1653 punch from 0x590bd44 to 0x5910d95, (0x5051 bytes) 2019-12-16T22:45:53.201 INFO:teuthology.orchestra.run.smithi177.stdout:1893 read 0x9fe879e thru 0x9feae6b (0x26ce bytes) 2019-12-16T22:45:53.201 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.202 INFO:teuthology.orchestra.run.smithi177.stdout:1895 read 0x5c4f69f thru 0x5c58352 (0x8cb4 bytes) 2019-12-16T22:45:53.204 INFO:teuthology.orchestra.run.smithi177.stdout:1763 read 0x91c5be6 thru 0x91ce1e0 (0x85fb bytes) 2019-12-16T22:45:53.204 INFO:teuthology.orchestra.run.smithi177.stdout:1764 read 0x3cd7aa8 thru 0x3ce2f32 (0xb48b bytes) 2019-12-16T22:45:53.204 INFO:teuthology.orchestra.run.smithi177.stdout:1765 write 0x7266681 thru 0x72716ad (0xb02d bytes) 2019-12-16T22:45:53.217 INFO:teuthology.orchestra.run.smithi177.stdout:1654 read 0x22b4752 thru 0x22ba9f1 (0x62a0 bytes) 2019-12-16T22:45:53.217 INFO:teuthology.orchestra.run.smithi177.stdout:1655 writesame 0x539d373 thru 0x539ec31 data_size 0x7(0x18bf bytes) 2019-12-16T22:45:53.220 INFO:teuthology.orchestra.run.smithi177.stdout:1896 trunc from 0xce14b9d to 0x1473f90 2019-12-16T22:45:53.223 INFO:teuthology.orchestra.run.smithi177.stdout:1766 writesame 0x18b29ff thru 0x18c0658 data_size 0x5(0xdc5a bytes) 2019-12-16T22:45:53.223 INFO:teuthology.orchestra.run.smithi177.stdout:2255 write 0x944b9f0 thru 0x9451151 (0x5762 bytes) 2019-12-16T22:45:53.227 INFO:teuthology.orchestra.run.smithi177.stdout:1656 write 0xbd606aa thru 0xbd63310 (0x2c67 bytes) 2019-12-16T22:45:53.245 INFO:teuthology.orchestra.run.smithi177.stdout:2256 trunc from 0x9451152 to 0x6847300 2019-12-16T22:45:53.247 INFO:teuthology.orchestra.run.smithi177.stdout:1657 read 0x9e88a6f thru 0x9e90013 (0x75a5 bytes) 2019-12-16T22:45:53.248 INFO:teuthology.orchestra.run.smithi177.stdout:1658 read 0x161cb41 thru 0x162bdad (0xf26d bytes) 2019-12-16T22:45:53.248 INFO:teuthology.orchestra.run.smithi177.stdout:1660 write 0x4e2b3fb thru 0x4e2e9fb (0x3601 bytes) 2019-12-16T22:45:53.250 INFO:teuthology.orchestra.run.smithi177.stdout:1767 read 0xa9106f thru 0xa99db7 (0x8d49 bytes) 2019-12-16T22:45:53.250 INFO:teuthology.orchestra.run.smithi177.stdout:1768 write 0x955b350 thru 0x955f970 (0x4621 bytes) 2019-12-16T22:45:53.257 INFO:teuthology.orchestra.run.smithi177.stdout:1661 read 0x7f98266 thru 0x7fa30d8 (0xae73 bytes) 2019-12-16T22:45:53.258 INFO:teuthology.orchestra.run.smithi177.stdout:1662 write 0x937d185 thru 0x937df2a (0xda6 bytes) 2019-12-16T22:45:53.264 INFO:teuthology.orchestra.run.smithi177.stdout:1769 read 0x2f1a50a thru 0x2f237ed (0x92e4 bytes) 2019-12-16T22:45:53.264 INFO:teuthology.orchestra.run.smithi177.stdout:1772 write 0x7e068c7 thru 0x7e11d81 (0xb4bb bytes) 2019-12-16T22:45:53.268 INFO:teuthology.orchestra.run.smithi177.stdout:1900 read 0x6fe57e thru 0x70aaca (0xc54d bytes) 2019-12-16T22:45:53.268 INFO:teuthology.orchestra.run.smithi177.stdout:1902 read 0x360e7f thru 0x36b420 (0xa5a2 bytes) 2019-12-16T22:45:53.269 INFO:teuthology.orchestra.run.smithi177.stdout:1663 writesame 0x88cfa3b thru 0x88d2ab9 data_size 0xd(0x307f bytes) 2019-12-16T22:45:53.269 INFO:teuthology.orchestra.run.smithi177.stdout:1904 read 0xbb7cb2 thru 0xbbcf6f (0x52be bytes) 2019-12-16T22:45:53.279 INFO:teuthology.orchestra.run.smithi177.stdout:1773 write 0xd171475 thru 0xd179358 (0x7ee4 bytes) 2019-12-16T22:45:53.282 INFO:teuthology.orchestra.run.smithi177.stdout:1664 write 0x93fae7b thru 0x9400e02 (0x5f88 bytes) 2019-12-16T22:45:53.286 INFO:teuthology.orchestra.run.smithi177.stdout:2257 read 0x2a9eae3 thru 0x2aa4a7c (0x5f9a bytes) 2019-12-16T22:45:53.286 INFO:teuthology.orchestra.run.smithi177.stdout:2258 punch from 0x41ab446 to 0x41bac1e, (0xf7d8 bytes) 2019-12-16T22:45:53.286 INFO:teuthology.orchestra.run.smithi177.stdout:2260 writesame 0x4f1e9c2 thru 0x4f28fbd data_size 0x6(0xa5fc bytes) 2019-12-16T22:45:53.295 INFO:teuthology.orchestra.run.smithi177.stdout:1775 writesame 0xb3df157 thru 0xb3ee4db data_size 0x1(0xf385 bytes) 2019-12-16T22:45:53.300 INFO:teuthology.orchestra.run.smithi177.stdout:2261 punch from 0x20efabc to 0x20f1983, (0x1ec7 bytes) 2019-12-16T22:45:53.300 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.301 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.301 INFO:teuthology.orchestra.run.smithi177.stdout:2265 punch from 0x10d7e47 to 0x10e007b, (0x8234 bytes) 2019-12-16T22:45:53.301 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.301 INFO:teuthology.orchestra.run.smithi177.stdout:2269 read 0x64b133b thru 0x64bf72c (0xe3f2 bytes) 2019-12-16T22:45:53.311 INFO:teuthology.orchestra.run.smithi177.stdout:1905 write 0xe4958b3 thru 0xe4a47c6 (0xef14 bytes) 2019-12-16T22:45:53.324 INFO:teuthology.orchestra.run.smithi177.stdout:1665 write 0xe54ca32 thru 0xe5549e1 (0x7fb0 bytes) 2019-12-16T22:45:53.339 INFO:teuthology.orchestra.run.smithi177.stdout:1776 write 0x1373573 thru 0x137f70d (0xc19b bytes) 2019-12-16T22:45:53.343 INFO:teuthology.orchestra.run.smithi177.stdout:1666 writesame 0x7492b thru 0x7d04e data_size 0x1(0x8724 bytes) 2019-12-16T22:45:53.344 INFO:teuthology.orchestra.run.smithi177.stdout:2270 write 0x88765b9 thru 0x88814e7 (0xaf2f bytes) 2019-12-16T22:45:53.349 INFO:teuthology.orchestra.run.smithi177.stdout:1906 trunc from 0xe4a47c7 to 0xaad09d4 2019-12-16T22:45:53.368 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.368 INFO:teuthology.orchestra.run.smithi177.stdout:1778 writesame 0x1e7c699 thru 0x1e87392 data_size 0x7(0xacfa bytes) 2019-12-16T22:45:53.382 INFO:teuthology.orchestra.run.smithi177.stdout:2271 trunc from 0x88814e8 to 0xaae241e 2019-12-16T22:45:53.388 INFO:teuthology.orchestra.run.smithi177.stdout:1779 write 0x1f57933 thru 0x1f66de1 (0xf4af bytes) 2019-12-16T22:45:53.392 INFO:teuthology.orchestra.run.smithi177.stdout:1667 write 0x61e0400 thru 0x61eafff (0xac00 bytes) 2019-12-16T22:45:53.407 INFO:teuthology.orchestra.run.smithi177.stdout:1907 write 0x76b5243 thru 0x76c04a9 (0xb267 bytes) 2019-12-16T22:45:53.416 INFO:teuthology.orchestra.run.smithi177.stdout:1780 write 0x74e7d7d thru 0x74f1186 (0x940a bytes) 2019-12-16T22:45:53.421 INFO:teuthology.orchestra.run.smithi177.stdout:1668 read 0xcce87f3 thru 0xccec0ba (0x38c8 bytes) 2019-12-16T22:45:53.421 INFO:teuthology.orchestra.run.smithi177.stdout:1671 write 0xce99048 thru 0xce99f5e (0xf17 bytes) 2019-12-16T22:45:53.438 INFO:teuthology.orchestra.run.smithi177.stdout:1781 read 0x5f094ad thru 0x5f1510f (0xbc63 bytes) 2019-12-16T22:45:53.438 INFO:teuthology.orchestra.run.smithi177.stdout:1783 punch from 0x1071173 to 0x10737f7, (0x2684 bytes) 2019-12-16T22:45:53.438 INFO:teuthology.orchestra.run.smithi177.stdout:1785 writesame 0x4bf7ab8 thru 0x4c06a68 data_size 0x1(0xefb1 bytes) 2019-12-16T22:45:53.439 INFO:teuthology.orchestra.run.smithi177.stdout:1672 write 0x5ab4d00 thru 0x5abc0e0 (0x73e1 bytes) 2019-12-16T22:45:53.439 INFO:teuthology.orchestra.run.smithi177.stdout:2274 write 0x517849e thru 0x5184317 (0xbe7a bytes) 2019-12-16T22:45:53.450 INFO:teuthology.orchestra.run.smithi177.stdout:1673 read 0xd033024 thru 0xd03b255 (0x8232 bytes) 2019-12-16T22:45:53.450 INFO:teuthology.orchestra.run.smithi177.stdout:1674 punch from 0x4d2e65f to 0x4d330ca, (0x4a6b bytes) 2019-12-16T22:45:53.450 INFO:teuthology.orchestra.run.smithi177.stdout:1675 read 0x1bc0e52 thru 0x1bc9bde (0x8d8d bytes) 2019-12-16T22:45:53.450 INFO:teuthology.orchestra.run.smithi177.stdout:1676 writesame 0x24c6fd0 thru 0x24d5fa5 data_size 0x36(0xefd6 bytes) 2019-12-16T22:45:53.473 INFO:teuthology.orchestra.run.smithi177.stdout:2275 punch from 0x49ebcfb to 0x49f9c4e, (0xdf53 bytes) 2019-12-16T22:45:53.473 INFO:teuthology.orchestra.run.smithi177.stdout:2276 read 0xe36225 thru 0xe37ae5 (0x18c1 bytes) 2019-12-16T22:45:53.474 INFO:teuthology.orchestra.run.smithi177.stdout:2277 read 0x8d5abe thru 0x8d7ff5 (0x2538 bytes) 2019-12-16T22:45:53.477 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.478 INFO:teuthology.orchestra.run.smithi177.stdout:2280 read 0x31e822c thru 0x31eb7ee (0x35c3 bytes) 2019-12-16T22:45:53.478 INFO:teuthology.orchestra.run.smithi177.stdout:2282 write 0x3ab2ac0 thru 0x3abc16c (0x96ad bytes) 2019-12-16T22:45:53.478 INFO:teuthology.orchestra.run.smithi177.stdout:1908 write 0xde65650 thru 0xde6b3c1 (0x5d72 bytes) 2019-12-16T22:45:53.478 INFO:teuthology.orchestra.run.smithi177.stdout:1677 writesame 0x12ddaf6 thru 0x12dfe18 data_size 0x7(0x2323 bytes) 2019-12-16T22:45:53.480 INFO:teuthology.orchestra.run.smithi177.stdout:1786 trunc from 0xdb5e4c6 to 0x7410ae5 2019-12-16T22:45:53.489 INFO:teuthology.orchestra.run.smithi177.stdout:1909 write 0x1083ca2 thru 0x108fb3a (0xbe99 bytes) 2019-12-16T22:45:53.498 INFO:teuthology.orchestra.run.smithi177.stdout:2283 write 0x82673e1 thru 0x826a3be (0x2fde bytes) 2019-12-16T22:45:53.504 INFO:teuthology.orchestra.run.smithi177.stdout:1910 read 0x3e85236 thru 0x3e8794c (0x2717 bytes) 2019-12-16T22:45:53.504 INFO:teuthology.orchestra.run.smithi177.stdout:1911 write 0x340d191 thru 0x341a3c9 (0xd239 bytes) 2019-12-16T22:45:53.512 INFO:teuthology.orchestra.run.smithi177.stdout:1678 trunc from 0xe5549e2 to 0x547a104 2019-12-16T22:45:53.519 INFO:teuthology.orchestra.run.smithi177.stdout:1913 write 0xc1ac3a8 thru 0xc1aeac1 (0x271a bytes) 2019-12-16T22:45:53.521 INFO:teuthology.orchestra.run.smithi177.stdout:2284 punch from 0x17a8f8d to 0x17b2823, (0x9896 bytes) 2019-12-16T22:45:53.521 INFO:teuthology.orchestra.run.smithi177.stdout:2285 read 0x8c593fc thru 0x8c5b7d0 (0x23d5 bytes) 2019-12-16T22:45:53.537 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.537 INFO:teuthology.orchestra.run.smithi177.stdout:1789 read 0x4519215 thru 0x451ef95 (0x5d81 bytes) 2019-12-16T22:45:53.544 INFO:teuthology.orchestra.run.smithi177.stdout:1790 trunc from 0x7410ae5 to 0x5a3d372 2019-12-16T22:45:53.547 INFO:teuthology.orchestra.run.smithi177.stdout:2286 write 0xc30a2ae thru 0xc30f44e (0x51a1 bytes) 2019-12-16T22:45:53.556 INFO:teuthology.orchestra.run.smithi177.stdout:1679 writesame 0x39c4888 thru 0x39c9e92 data_size 0x1(0x560b bytes) 2019-12-16T22:45:53.560 INFO:teuthology.orchestra.run.smithi177.stdout:1914 trunc from 0xde6b3c2 to 0xbef10d 2019-12-16T22:45:53.560 INFO:teuthology.orchestra.run.smithi177.stdout:2287 write 0x14ec723 thru 0x14f1291 (0x4b6f bytes) 2019-12-16T22:45:53.594 INFO:teuthology.orchestra.run.smithi177.stdout:1792 write 0x5581515 thru 0x5583ef9 (0x29e5 bytes) 2019-12-16T22:45:53.626 INFO:teuthology.orchestra.run.smithi177.stdout:1793 trunc from 0x5a3d372 to 0xe531fb7 2019-12-16T22:45:53.627 INFO:teuthology.orchestra.run.smithi177.stdout:2289 clone 13 order 22 su 1048576 sc 9 2019-12-16T22:45:53.633 INFO:teuthology.orchestra.run.smithi177.stdout:1681 writesame 0x9f65552 thru 0x9f68b9b data_size 0x1(0x364a bytes) 2019-12-16T22:45:53.636 INFO:teuthology.orchestra.run.smithi177.stdout:1682 writesame 0x58bb488 thru 0x58cb214 data_size 0x1(0xfd8d bytes) 2019-12-16T22:45:53.657 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.658 INFO:teuthology.orchestra.run.smithi177.stdout:1797 writesame 0x93b06c thru 0x947314 data_size 0x71(0xc2a9 bytes) 2019-12-16T22:45:53.679 INFO:teuthology.orchestra.run.smithi177.stdout:1801 write 0x646b716 thru 0x647144b (0x5d36 bytes) 2019-12-16T22:45:53.693 INFO:teuthology.orchestra.run.smithi177.stdout:1915 trunc from 0xbef10d to 0xbff721b 2019-12-16T22:45:53.694 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.694 INFO:teuthology.orchestra.run.smithi177.stdout:1803 write 0x64e96fb thru 0x64f88a1 (0xf1a7 bytes) 2019-12-16T22:45:53.710 INFO:teuthology.orchestra.run.smithi177.stdout:1683 write 0xd57f83a thru 0xd589745 (0x9f0c bytes) 2019-12-16T22:45:53.715 INFO:teuthology.orchestra.run.smithi177.stdout:1804 read 0x8e29753 thru 0x8e2c970 (0x321e bytes) 2019-12-16T22:45:53.715 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.717 INFO:teuthology.orchestra.run.smithi177.stdout:1916 read 0x8bf3876 thru 0x8bfb7b0 (0x7f3b bytes) 2019-12-16T22:45:53.717 INFO:teuthology.orchestra.run.smithi177.stdout:1918 write 0x9da8ec9 thru 0x9da9dd5 (0xf0d bytes) 2019-12-16T22:45:53.739 INFO:teuthology.orchestra.run.smithi177.stdout:1684 writesame 0x6076864 thru 0x607adc6 data_size 0x1f(0x4563 bytes) 2019-12-16T22:45:53.740 INFO:teuthology.orchestra.run.smithi177.stdout:1685 write 0x349f540 thru 0x34a02dc (0xd9d bytes) 2019-12-16T22:45:53.740 INFO:teuthology.orchestra.run.smithi177.stdout:1919 read 0x3d6f8bd thru 0x3d7dbb8 (0xe2fc bytes) 2019-12-16T22:45:53.740 INFO:teuthology.orchestra.run.smithi177.stdout:1920 write 0x3c9b3c0 thru 0x3ca35c3 (0x8204 bytes) 2019-12-16T22:45:53.740 INFO:teuthology.orchestra.run.smithi177.stdout:1806 trunc from 0xe531fb7 to 0x5b7a4d7 2019-12-16T22:45:53.742 INFO:teuthology.orchestra.run.smithi177.stdout:1922 trunc from 0xbff721b to 0x9a42dd7 2019-12-16T22:45:53.756 INFO:teuthology.orchestra.run.smithi177.stdout:1686 trunc from 0xd589746 to 0x88effb1 2019-12-16T22:45:53.760 INFO:teuthology.orchestra.run.smithi177.stdout:1807 write 0x6b0915 thru 0x6b46e1 (0x3dcd bytes) 2019-12-16T22:45:53.767 INFO:teuthology.orchestra.run.smithi177.stdout:1808 read 0x3422e55 thru 0x3423dca (0xf76 bytes) 2019-12-16T22:45:53.767 INFO:teuthology.orchestra.run.smithi177.stdout:1809 write 0x32e18cd thru 0x32ea2ef (0x8a23 bytes) 2019-12-16T22:45:53.789 INFO:teuthology.orchestra.run.smithi177.stdout:1687 read 0x41a31af thru 0x41b1719 (0xe56b bytes) 2019-12-16T22:45:53.799 INFO:teuthology.orchestra.run.smithi177.stdout:1688 trunc from 0x88effb1 to 0x771d284 2019-12-16T22:45:53.799 INFO:teuthology.orchestra.run.smithi177.stdout:1924 writesame 0xe67bcf5 thru 0xe67d56a data_size 0x2(0x1876 bytes) 2019-12-16T22:45:53.799 INFO:teuthology.orchestra.run.smithi177.stdout:1925 write 0xb875c04 thru 0xb882b1f (0xcf1c bytes) 2019-12-16T22:45:53.800 INFO:teuthology.orchestra.run.smithi177.stdout:1811 trunc from 0x5b7a4d7 to 0x227f7da 2019-12-16T22:45:53.809 INFO:teuthology.orchestra.run.smithi177.stdout:1928 punch from 0xcc584fb to 0xcc6284e, (0xa353 bytes) 2019-12-16T22:45:53.809 INFO:teuthology.orchestra.run.smithi177.stdout:1930 read 0x657ef95 thru 0x658ed9c (0xfe08 bytes) 2019-12-16T22:45:53.809 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.810 INFO:teuthology.orchestra.run.smithi177.stdout:1932 write 0x3c5ad73 thru 0x3c69b15 (0xeda3 bytes) 2019-12-16T22:45:53.814 INFO:teuthology.orchestra.run.smithi177.stdout:1689 write 0x9004c0 thru 0x90abba (0xa6fb bytes) 2019-12-16T22:45:53.825 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.826 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.826 INFO:teuthology.orchestra.run.smithi177.stdout:1935 write 0x4e71dee thru 0x4e7853b (0x674e bytes) 2019-12-16T22:45:53.845 INFO:teuthology.orchestra.run.smithi177.stdout:1690 read 0x4f2a5ac thru 0x4f336e3 (0x9138 bytes) 2019-12-16T22:45:53.845 INFO:teuthology.orchestra.run.smithi177.stdout:1691 punch from 0x41d76c3 to 0x41df290, (0x7bcd bytes) 2019-12-16T22:45:53.846 INFO:teuthology.orchestra.run.smithi177.stdout:1692 trunc from 0x771d284 to 0x88e8c0c 2019-12-16T22:45:53.849 INFO:teuthology.orchestra.run.smithi177.stdout:1936 trunc from 0xe67d56b to 0x5f201b3 2019-12-16T22:45:53.874 INFO:teuthology.orchestra.run.smithi177.stdout:1812 write 0xd19c685 thru 0xd1ac453 (0xfdcf bytes) 2019-12-16T22:45:53.891 INFO:teuthology.orchestra.run.smithi177.stdout:1693 write 0xc63002e thru 0xc637674 (0x7647 bytes) 2019-12-16T22:45:53.897 INFO:teuthology.orchestra.run.smithi177.stdout:1937 write 0x7202067 thru 0x720ee97 (0xce31 bytes) 2019-12-16T22:45:53.903 INFO:teuthology.orchestra.run.smithi177.stdout:1813 write 0x3a298f1 thru 0x3a332fe (0x9a0e bytes) 2019-12-16T22:45:53.904 INFO:teuthology.orchestra.run.smithi177.stdout:1695 punch from 0x5531d33 to 0x5533b48, (0x1e15 bytes) 2019-12-16T22:45:53.911 INFO:teuthology.orchestra.run.smithi177.stdout:1696 trunc from 0xc637675 to 0x92c8bb0 2019-12-16T22:45:53.913 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.913 INFO:teuthology.orchestra.run.smithi177.stdout:1940 read 0x33fa5ae thru 0x3400475 (0x5ec8 bytes) 2019-12-16T22:45:53.913 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:53.913 INFO:teuthology.orchestra.run.smithi177.stdout:1942 read 0x1fe1ec7 thru 0x1fe5c1e (0x3d58 bytes) 2019-12-16T22:45:53.916 INFO:teuthology.orchestra.run.smithi177.stdout:1943 trunc from 0x720ee98 to 0x5ebdaf5 2019-12-16T22:45:53.917 INFO:teuthology.orchestra.run.smithi177.stdout:1815 clone 18 order 22 su 131072 sc 6 2019-12-16T22:45:53.941 INFO:teuthology.orchestra.run.smithi177.stdout:1697 writesame 0x1e63a87 thru 0x1e64737 data_size 0x13(0xcb1 bytes) 2019-12-16T22:45:53.943 INFO:teuthology.orchestra.run.smithi177.stdout:1946 read 0x27a21e8 thru 0x27acb4f (0xa968 bytes) 2019-12-16T22:45:53.955 INFO:teuthology.orchestra.run.smithi177.stdout:1947 trunc from 0x5ebdaf5 to 0xd9780f 2019-12-16T22:45:53.964 INFO:teuthology.orchestra.run.smithi177.stdout:1698 trunc from 0x92c8bb0 to 0x52e53d1 2019-12-16T22:45:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:1948 read 0x89377b thru 0x89ba5b (0x82e1 bytes) 2019-12-16T22:45:53.995 INFO:teuthology.orchestra.run.smithi177.stdout:1949 read 0x58decf thru 0x59946c (0xb59e bytes) 2019-12-16T22:45:54.004 INFO:teuthology.orchestra.run.smithi177.stdout:1950 clone 13 order 19 su 8192 sc 14 2019-12-16T22:45:54.064 INFO:teuthology.orchestra.run.smithi177.stdout:1701 writesame 0x64f4d34 thru 0x6501f6d data_size 0x2(0xd23a bytes) 2019-12-16T22:45:54.078 INFO:teuthology.orchestra.run.smithi177.stdout:1702 trunc from 0x6501f6e to 0xc27f275 2019-12-16T22:45:54.100 INFO:teuthology.orchestra.run.smithi177.stdout:1703 write 0x9798bc8 thru 0x97a361d (0xaa56 bytes) 2019-12-16T22:45:54.111 INFO:teuthology.orchestra.run.smithi177.stdout:1704 read 0xa11360b thru 0xa1173f6 (0x3dec bytes) 2019-12-16T22:45:54.111 INFO:teuthology.orchestra.run.smithi177.stdout:1705 read 0x3c23cda thru 0x3c33b6f (0xfe96 bytes) 2019-12-16T22:45:54.134 INFO:teuthology.orchestra.run.smithi177.stdout:1706 writesame 0xc387598 thru 0xc38b722 data_size 0x15(0x418b bytes) 2019-12-16T22:45:54.139 INFO:teuthology.orchestra.run.smithi177.stdout:1707 write 0xc1fd892 thru 0xc20550f (0x7c7e bytes) 2019-12-16T22:45:54.167 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone13 from 0xa346823 (overlap 0x1c34579) to 0x1690460 2019-12-16T22:45:54.170 INFO:teuthology.orchestra.run.smithi177.stdout:1709 trunc from 0xc38b723 to 0x43d2a60 2019-12-16T22:45:54.176 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.1-clone12 2019-12-16T22:45:54.205 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone17 from 0xd1ac454 (overlap 0x8bcf98) to 0x53e2f4 2019-12-16T22:45:54.206 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.2-clone11 2019-12-16T22:45:54.275 INFO:teuthology.orchestra.run.smithi177.stdout:1710 read 0xd5912d thru 0xd5fa41 (0x6915 bytes) 2019-12-16T22:45:54.394 INFO:teuthology.orchestra.run.smithi177.stdout:1711 writesame 0xe7d605d thru 0xe7d6dd9 data_size 0x1(0xd7d bytes) 2019-12-16T22:45:54.410 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.410 INFO:teuthology.orchestra.run.smithi177.stdout:1714 read 0x3ab8803 thru 0x3abf286 (0x6a84 bytes) 2019-12-16T22:45:54.410 INFO:teuthology.orchestra.run.smithi177.stdout:1715 read 0x35380d7 thru 0x353875d (0x687 bytes) 2019-12-16T22:45:54.411 INFO:teuthology.orchestra.run.smithi177.stdout:1716 write 0x1636cdf thru 0x163d35a (0x667c bytes) 2019-12-16T22:45:54.459 INFO:teuthology.orchestra.run.smithi177.stdout:1717 write 0x438d32a thru 0x439a99e (0xd675 bytes) 2019-12-16T22:45:54.460 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #12, image image_cluster1.client.mirror.4-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent13 2019-12-16T22:45:54.502 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.502 INFO:teuthology.orchestra.run.smithi177.stdout:1721 punch from 0xc61442e to 0xc6206d1, (0xc2a3 bytes) 2019-12-16T22:45:54.502 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.502 INFO:teuthology.orchestra.run.smithi177.stdout:1723 write 0x4c19144 thru 0x4c1bb9a (0x2a57 bytes) 2019-12-16T22:45:54.526 INFO:teuthology.orchestra.run.smithi177.stdout:1724 read 0x69b7965 thru 0x69c21ac (0xa848 bytes) 2019-12-16T22:45:54.526 INFO:teuthology.orchestra.run.smithi177.stdout:1727 write 0x479b35 thru 0x47fddc (0x62a8 bytes) 2019-12-16T22:45:54.547 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #10, image image_cluster1.client.mirror.2-clone10 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent11 2019-12-16T22:45:54.560 INFO:teuthology.orchestra.run.smithi177.stdout:1728 read 0x3e03236 thru 0x3e0a15f (0x6f2a bytes) 2019-12-16T22:45:54.560 INFO:teuthology.orchestra.run.smithi177.stdout:1729 write 0x12e306c thru 0x12f14c5 (0xe45a bytes) 2019-12-16T22:45:54.622 INFO:teuthology.orchestra.run.smithi177.stdout:1482 read 0x597089 thru 0x5a6875 (0xf7ed bytes) 2019-12-16T22:45:54.635 INFO:teuthology.orchestra.run.smithi177.stdout:1730 trunc from 0xe7d6dda to 0x809f82a 2019-12-16T22:45:54.641 INFO:teuthology.orchestra.run.smithi177.stdout:1483 punch from 0x1b577a6 to 0x1b60790, (0x8fea bytes) 2019-12-16T22:45:54.641 INFO:teuthology.orchestra.run.smithi177.stdout:1484 writesame 0x64f49a thru 0x650968 data_size 0x1(0x14cf bytes) 2019-12-16T22:45:54.704 INFO:teuthology.orchestra.run.smithi177.stdout:1731 read 0x7469682 thru 0x7475926 (0xc2a5 bytes) 2019-12-16T22:45:54.704 INFO:teuthology.orchestra.run.smithi177.stdout:1732 punch from 0x5c9fc71 to 0x5cafc34, (0xffc3 bytes) 2019-12-16T22:45:54.704 INFO:teuthology.orchestra.run.smithi177.stdout:1733 write 0x374c69f thru 0x375bc3c (0xf59e bytes) 2019-12-16T22:45:54.704 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #16, image image_cluster1.client.mirror.0-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent17 2019-12-16T22:45:54.736 INFO:teuthology.orchestra.run.smithi177.stdout:1734 punch from 0x10a746a to 0x10aab55, (0x36eb bytes) 2019-12-16T22:45:54.762 INFO:teuthology.orchestra.run.smithi177.stdout:1485 writesame 0xc00e308 thru 0xc010bb4 data_size 0xd(0x28ad bytes) 2019-12-16T22:45:54.769 INFO:teuthology.orchestra.run.smithi177.stdout:1816 writesame 0x3af3d7e thru 0x3af850a data_size 0x1(0x478d bytes) 2019-12-16T22:45:54.771 INFO:teuthology.orchestra.run.smithi177.stdout:1735 write 0xec43dff thru 0xec4e644 (0xa846 bytes) 2019-12-16T22:45:54.775 INFO:teuthology.orchestra.run.smithi177.stdout:1762 writesame 0xdeccc3f thru 0xdecf3fd data_size 0x25(0x27bf bytes) 2019-12-16T22:45:54.788 INFO:teuthology.orchestra.run.smithi177.stdout:1738 read 0xb2cf987 thru 0xb2d783a (0x7eb4 bytes) 2019-12-16T22:45:54.789 INFO:teuthology.orchestra.run.smithi177.stdout:1739 read 0x44f892e thru 0x44fe904 (0x5fd7 bytes) 2019-12-16T22:45:54.789 INFO:teuthology.orchestra.run.smithi177.stdout:1740 clone 15 order 22 su 262144 sc 10 2019-12-16T22:45:54.789 INFO:teuthology.orchestra.run.smithi177.stdout:1763 trunc from 0xdecf3fe to 0xa80c502 2019-12-16T22:45:54.801 INFO:teuthology.orchestra.run.smithi177.stdout:1486 writesame 0xeb2d258 thru 0xeb36745 data_size 0xb(0x94ee bytes) 2019-12-16T22:45:54.804 INFO:teuthology.orchestra.run.smithi177.stdout:1488 read 0x29fd300 thru 0x2a01525 (0x4226 bytes) 2019-12-16T22:45:54.806 INFO:teuthology.orchestra.run.smithi177.stdout:1489 write 0xddc9e93 thru 0xddd54b4 (0xb622 bytes) 2019-12-16T22:45:54.824 INFO:teuthology.orchestra.run.smithi177.stdout:1490 trunc from 0xeb36746 to 0xc2e9eaf 2019-12-16T22:45:54.830 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.831 INFO:teuthology.orchestra.run.smithi177.stdout:1766 writesame 0x91a8ef3 thru 0x91abc30 data_size 0x1(0x2d3e bytes) 2019-12-16T22:45:54.839 INFO:teuthology.orchestra.run.smithi177.stdout:1818 writesame 0xd52d567 thru 0xd53586a data_size 0x56(0x8304 bytes) 2019-12-16T22:45:54.840 INFO:teuthology.orchestra.run.smithi177.stdout:1767 punch from 0x79ad074 to 0x79bc00c, (0xef98 bytes) 2019-12-16T22:45:54.841 INFO:teuthology.orchestra.run.smithi177.stdout:1768 write 0x3617194 thru 0x362619a (0xf007 bytes) 2019-12-16T22:45:54.853 INFO:teuthology.orchestra.run.smithi177.stdout:1819 read 0x6a47b87 thru 0x6a5053a (0x89b4 bytes) 2019-12-16T22:45:54.853 INFO:teuthology.orchestra.run.smithi177.stdout:1820 write 0x41b7044 thru 0x41bafaf (0x3f6c bytes) 2019-12-16T22:45:54.855 INFO:teuthology.orchestra.run.smithi177.stdout:1769 write 0x663c99d thru 0x6643f82 (0x75e6 bytes) 2019-12-16T22:45:54.859 INFO:teuthology.orchestra.run.smithi177.stdout:1821 read 0xa5bafa3 thru 0xa5bb82e (0x88c bytes) 2019-12-16T22:45:54.859 INFO:teuthology.orchestra.run.smithi177.stdout:1822 punch from 0x85a48ed to 0x85ad68a, (0x8d9d bytes) 2019-12-16T22:45:54.860 INFO:teuthology.orchestra.run.smithi177.stdout:1823 write 0xc2da88f thru 0xc2e12c8 (0x6a3a bytes) 2019-12-16T22:45:54.872 INFO:teuthology.orchestra.run.smithi177.stdout:1824 trunc from 0xd53586b to 0xd305cd0 2019-12-16T22:45:54.875 INFO:teuthology.orchestra.run.smithi177.stdout:1491 write 0xd879c14 thru 0xd88570a (0xbaf7 bytes) 2019-12-16T22:45:54.892 INFO:teuthology.orchestra.run.smithi177.stdout:1493 punch from 0x23f119d to 0x23f597a, (0x47dd bytes) 2019-12-16T22:45:54.892 INFO:teuthology.orchestra.run.smithi177.stdout:1494 read 0x8cdec69 thru 0x8ce0bc0 (0x1f58 bytes) 2019-12-16T22:45:54.892 INFO:teuthology.orchestra.run.smithi177.stdout:1495 writesame 0x6605f3e thru 0x660893f data_size 0x13(0x2a02 bytes) 2019-12-16T22:45:54.894 INFO:teuthology.orchestra.run.smithi177.stdout:1770 write 0xa94fa80 thru 0xa95e609 (0xeb8a bytes) 2019-12-16T22:45:54.905 INFO:teuthology.orchestra.run.smithi177.stdout:1771 read 0x8baa2e thru 0x8c5480 (0xaa53 bytes) 2019-12-16T22:45:54.906 INFO:teuthology.orchestra.run.smithi177.stdout:1772 punch from 0x2370c36 to 0x237c38f, (0xb759 bytes) 2019-12-16T22:45:54.906 INFO:teuthology.orchestra.run.smithi177.stdout:1773 write 0x1dccfbf thru 0x1dd0c2f (0x3c71 bytes) 2019-12-16T22:45:54.915 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.915 INFO:teuthology.orchestra.run.smithi177.stdout:1826 write 0xbe5f641 thru 0xbe6dce2 (0xe6a2 bytes) 2019-12-16T22:45:54.915 INFO:teuthology.orchestra.run.smithi177.stdout:1496 trunc from 0xd88570b to 0x852d345 2019-12-16T22:45:54.922 INFO:teuthology.orchestra.run.smithi177.stdout:1776 trunc from 0xa95e60a to 0xed9cb91 2019-12-16T22:45:54.935 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.935 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.935 INFO:teuthology.orchestra.run.smithi177.stdout:1830 punch from 0xb61dcaf to 0xb61fd3b, (0x208c bytes) 2019-12-16T22:45:54.935 INFO:teuthology.orchestra.run.smithi177.stdout:1831 read 0xaef5e87 thru 0xaeff581 (0x96fb bytes) 2019-12-16T22:45:54.935 INFO:teuthology.orchestra.run.smithi177.stdout:1832 read 0xbfcc10a thru 0xbfd098e (0x4885 bytes) 2019-12-16T22:45:54.935 INFO:teuthology.orchestra.run.smithi177.stdout:1834 write 0x3c1719a thru 0x3c1a396 (0x31fd bytes) 2019-12-16T22:45:54.944 INFO:teuthology.orchestra.run.smithi177.stdout:1835 write 0x502ad64 thru 0x502e9c1 (0x3c5e bytes) 2019-12-16T22:45:54.945 INFO:teuthology.orchestra.run.smithi177.stdout:1777 read 0x86ffd89 thru 0x870b5f8 (0xb870 bytes) 2019-12-16T22:45:54.946 INFO:teuthology.orchestra.run.smithi177.stdout:1778 write 0xc256861 thru 0xc25b530 (0x4cd0 bytes) 2019-12-16T22:45:54.956 INFO:teuthology.orchestra.run.smithi177.stdout:1836 write 0xa3942d6 thru 0xa39c852 (0x857d bytes) 2019-12-16T22:45:54.958 INFO:teuthology.orchestra.run.smithi177.stdout:1779 write 0xc6c5a63 thru 0xc6ca7fb (0x4d99 bytes) 2019-12-16T22:45:54.967 INFO:teuthology.orchestra.run.smithi177.stdout:1780 write 0x8228dd thru 0x829566 (0x6c8a bytes) 2019-12-16T22:45:54.972 INFO:teuthology.orchestra.run.smithi177.stdout:1837 writesame 0xa4d138f thru 0xa4d3481 data_size 0x7(0x20f3 bytes) 2019-12-16T22:45:54.977 INFO:teuthology.orchestra.run.smithi177.stdout:1781 write 0x79e493c thru 0x79ef854 (0xaf19 bytes) 2019-12-16T22:45:54.979 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #11, image image_cluster1.client.mirror.1-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent12 2019-12-16T22:45:54.983 INFO:teuthology.orchestra.run.smithi177.stdout:1497 write 0xe7bbd52 thru 0xe7bd7e3 (0x1a92 bytes) 2019-12-16T22:45:54.984 INFO:teuthology.orchestra.run.smithi177.stdout:1842 read 0x67a7383 thru 0x67acd19 (0x5997 bytes) 2019-12-16T22:45:54.984 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:54.984 INFO:teuthology.orchestra.run.smithi177.stdout:1845 write 0x1cf512c thru 0x1cf5be3 (0xab8 bytes) 2019-12-16T22:45:54.991 INFO:teuthology.orchestra.run.smithi177.stdout:1782 read 0xc191340 thru 0xc1934e4 (0x21a5 bytes) 2019-12-16T22:45:54.991 INFO:teuthology.orchestra.run.smithi177.stdout:1783 punch from 0x4a62607 to 0x4a6df7e, (0xb977 bytes) 2019-12-16T22:45:54.991 INFO:teuthology.orchestra.run.smithi177.stdout:1784 read 0x38e9460 thru 0x38ed1f7 (0x3d98 bytes) 2019-12-16T22:45:54.995 INFO:teuthology.orchestra.run.smithi177.stdout:1499 read 0x5995f7a thru 0x599a04d (0x40d4 bytes) 2019-12-16T22:45:54.995 INFO:teuthology.orchestra.run.smithi177.stdout:1500 punch from 0xdba3ca5 to 0xdbb1a87, (0xdde2 bytes) 2019-12-16T22:45:54.995 INFO:teuthology.orchestra.run.smithi177.stdout:1501 read 0x87ffcaf thru 0x8807ab8 (0x7e0a bytes) 2019-12-16T22:45:54.995 INFO:teuthology.orchestra.run.smithi177.stdout:1504 punch from 0x24b9d8a to 0x24bff0a, (0x6180 bytes) 2019-12-16T22:45:54.995 INFO:teuthology.orchestra.run.smithi177.stdout:1506 read 0xcd696de thru 0xcd6c573 (0x2e96 bytes) 2019-12-16T22:45:54.996 INFO:teuthology.orchestra.run.smithi177.stdout:1510 write 0x4b92054 thru 0x4b96565 (0x4512 bytes) 2019-12-16T22:45:54.996 INFO:teuthology.orchestra.run.smithi177.stdout:1785 writesame 0xc272236 thru 0xc28193e data_size 0x1(0xf709 bytes) 2019-12-16T22:45:55.000 INFO:teuthology.orchestra.run.smithi177.stdout:1846 punch from 0x593437d to 0x593f7d4, (0xb457 bytes) 2019-12-16T22:45:55.049 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.049 INFO:teuthology.orchestra.run.smithi177.stdout:1788 writesame 0x55454dd thru 0x55511dd data_size 0x1(0xbd01 bytes) 2019-12-16T22:45:55.051 INFO:teuthology.orchestra.run.smithi177.stdout:1512 punch from 0x9c01f05 to 0x9c04a01, (0x2afc bytes) 2019-12-16T22:45:55.052 INFO:teuthology.orchestra.run.smithi177.stdout:1513 read 0x660ef69 thru 0x66129fe (0x3a96 bytes) 2019-12-16T22:45:55.054 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.055 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.055 INFO:teuthology.orchestra.run.smithi177.stdout:1519 write 0x773d0f thru 0x781303 (0xd5f5 bytes) 2019-12-16T22:45:55.073 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.074 INFO:teuthology.orchestra.run.smithi177.stdout:1521 punch from 0x398a998 to 0x3990814, (0x5e7c bytes) 2019-12-16T22:45:55.074 INFO:teuthology.orchestra.run.smithi177.stdout:1522 write 0xbb90543 thru 0xbb925b5 (0x2073 bytes) 2019-12-16T22:45:55.084 INFO:teuthology.orchestra.run.smithi177.stdout:1523 write 0x6f3bd71 thru 0x6f42ee0 (0x7170 bytes) 2019-12-16T22:45:55.093 INFO:teuthology.orchestra.run.smithi177.stdout:1790 read 0x3c31de1 thru 0x3c3d5e8 (0xb808 bytes) 2019-12-16T22:45:55.094 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.094 INFO:teuthology.orchestra.run.smithi177.stdout:1793 read 0xea2e628 thru 0xea3408a (0x5a63 bytes) 2019-12-16T22:45:55.094 INFO:teuthology.orchestra.run.smithi177.stdout:1794 read 0x45ddb7f thru 0x45e2be7 (0x5069 bytes) 2019-12-16T22:45:55.094 INFO:teuthology.orchestra.run.smithi177.stdout:1795 read 0xb598e07 thru 0xb59a86c (0x1a66 bytes) 2019-12-16T22:45:55.095 INFO:teuthology.orchestra.run.smithi177.stdout:1796 write 0x1bc547a thru 0x1bd3c05 (0xe78c bytes) 2019-12-16T22:45:55.101 INFO:teuthology.orchestra.run.smithi177.stdout:1847 write 0xe330197 thru 0xe33a6d3 (0xa53d bytes) 2019-12-16T22:45:55.102 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.102 INFO:teuthology.orchestra.run.smithi177.stdout:1526 clone 13 order 21 su 65536 sc 14 2019-12-16T22:45:55.109 INFO:teuthology.orchestra.run.smithi177.stdout:1848 write 0xa661c4f thru 0xa670fd0 (0xf382 bytes) 2019-12-16T22:45:55.112 INFO:teuthology.orchestra.run.smithi177.stdout:1797 punch from 0x8ccf021 to 0x8cd70e5, (0x80c4 bytes) 2019-12-16T22:45:55.112 INFO:teuthology.orchestra.run.smithi177.stdout:1798 read 0xde6f7ee thru 0xde7838c (0x8b9f bytes) 2019-12-16T22:45:55.112 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.112 INFO:teuthology.orchestra.run.smithi177.stdout:1801 read 0x44e0352 thru 0x44eed8d (0xea3c bytes) 2019-12-16T22:45:55.113 INFO:teuthology.orchestra.run.smithi177.stdout:1802 punch from 0x3cb06ae to 0x3cb84c0, (0x7e12 bytes) 2019-12-16T22:45:55.113 INFO:teuthology.orchestra.run.smithi177.stdout:1804 read 0x2f7c692 thru 0x2f7ed78 (0x26e7 bytes) 2019-12-16T22:45:55.113 INFO:teuthology.orchestra.run.smithi177.stdout:1806 read 0x23ed9c4 thru 0x23fb450 (0xda8d bytes) 2019-12-16T22:45:55.114 INFO:teuthology.orchestra.run.smithi177.stdout:1807 read 0x880e594 thru 0x8810482 (0x1eef bytes) 2019-12-16T22:45:55.115 INFO:teuthology.orchestra.run.smithi177.stdout:1808 read 0x676ea86 thru 0x6774a2e (0x5fa9 bytes) 2019-12-16T22:45:55.115 INFO:teuthology.orchestra.run.smithi177.stdout:1810 read 0x7801580 thru 0x7808206 (0x6c87 bytes) 2019-12-16T22:45:55.115 INFO:teuthology.orchestra.run.smithi177.stdout:1811 write 0x1c4b29c thru 0x1c57555 (0xc2ba bytes) 2019-12-16T22:45:55.124 INFO:teuthology.orchestra.run.smithi177.stdout:1812 write 0x5216e52 thru 0x5221a14 (0xabc3 bytes) 2019-12-16T22:45:55.124 INFO:teuthology.orchestra.run.smithi177.stdout:1850 punch from 0x6e831a9 to 0x6e91df7, (0xec4e bytes) 2019-12-16T22:45:55.124 INFO:teuthology.orchestra.run.smithi177.stdout:1851 punch from 0x5f0a33f to 0x5f136ea, (0x93ab bytes) 2019-12-16T22:45:55.124 INFO:teuthology.orchestra.run.smithi177.stdout:1852 write 0xb8c4edc thru 0xb8d09ea (0xbb0f bytes) 2019-12-16T22:45:55.130 INFO:teuthology.orchestra.run.smithi177.stdout:1813 punch from 0xd78e900 to 0xd7964b5, (0x7bb5 bytes) 2019-12-16T22:45:55.131 INFO:teuthology.orchestra.run.smithi177.stdout:1814 trunc from 0xed9cb91 to 0xed422aa 2019-12-16T22:45:55.155 INFO:teuthology.orchestra.run.smithi177.stdout:1854 trunc from 0xe33a6d4 to 0x90eb42a 2019-12-16T22:45:55.156 INFO:teuthology.orchestra.run.smithi177.stdout:1815 read 0xe2cfd64 thru 0xe2d45b8 (0x4855 bytes) 2019-12-16T22:45:55.156 INFO:teuthology.orchestra.run.smithi177.stdout:1816 read 0x2294d0e thru 0x229e829 (0x9b1c bytes) 2019-12-16T22:45:55.156 INFO:teuthology.orchestra.run.smithi177.stdout:1817 writesame 0x27ef1b6 thru 0x27f664d data_size 0x38(0x7498 bytes) 2019-12-16T22:45:55.164 INFO:teuthology.orchestra.run.smithi177.stdout:1819 write 0x1e55221 thru 0x1e63f9c (0xed7c bytes) 2019-12-16T22:45:55.172 INFO:teuthology.orchestra.run.smithi177.stdout:1820 writesame 0x8ba8f40 thru 0x8ba9652 data_size 0x1(0x713 bytes) 2019-12-16T22:45:55.177 INFO:teuthology.orchestra.run.smithi177.stdout:2290 write 0xdffd156 thru 0xe001681 (0x452c bytes) 2019-12-16T22:45:55.183 INFO:teuthology.orchestra.run.smithi177.stdout:1822 punch from 0x57cc94c to 0x57db78f, (0xee43 bytes) 2019-12-16T22:45:55.183 INFO:teuthology.orchestra.run.smithi177.stdout:1823 read 0xc8b0ff thru 0xc97919 (0xc81b bytes) 2019-12-16T22:45:55.184 INFO:teuthology.orchestra.run.smithi177.stdout:1824 punch from 0x8d721f1 to 0x8d7f1cf, (0xcfde bytes) 2019-12-16T22:45:55.184 INFO:teuthology.orchestra.run.smithi177.stdout:1825 punch from 0x23748a2 to 0x2377b5a, (0x32b8 bytes) 2019-12-16T22:45:55.184 INFO:teuthology.orchestra.run.smithi177.stdout:1827 punch from 0x62a5a1f to 0x62b3cdd, (0xe2be bytes) 2019-12-16T22:45:55.185 INFO:teuthology.orchestra.run.smithi177.stdout:1828 write 0xe5cc31f thru 0xe5cc818 (0x4fa bytes) 2019-12-16T22:45:55.185 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone12 from 0xd9780f (overlap 0xbef10d) to 0xabd8f2 2019-12-16T22:45:55.194 INFO:teuthology.orchestra.run.smithi177.stdout:2291 read 0x5e7852 thru 0x5f292e (0xb0dd bytes) 2019-12-16T22:45:55.195 INFO:teuthology.orchestra.run.smithi177.stdout:2293 read 0x6198abe thru 0x6199337 (0x87a bytes) 2019-12-16T22:45:55.196 INFO:teuthology.orchestra.run.smithi177.stdout:2294 write 0x7ecc242 thru 0x7ece309 (0x20c8 bytes) 2019-12-16T22:45:55.197 INFO:teuthology.orchestra.run.smithi177.stdout:1829 punch from 0x8c75c52 to 0x8c82324, (0xc6d2 bytes) 2019-12-16T22:45:55.197 INFO:teuthology.orchestra.run.smithi177.stdout:1830 write 0x2345a6f thru 0x234d95d (0x7eef bytes) 2019-12-16T22:45:55.210 INFO:teuthology.orchestra.run.smithi177.stdout:1831 writesame 0xc8984e9 thru 0xc898ab2 data_size 0x1a(0x5ca bytes) 2019-12-16T22:45:55.212 INFO:teuthology.orchestra.run.smithi177.stdout:2295 read 0x3294f10 thru 0x3299119 (0x420a bytes) 2019-12-16T22:45:55.213 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.213 INFO:teuthology.orchestra.run.smithi177.stdout:2297 write 0x93dd662 thru 0x93e5532 (0x7ed1 bytes) 2019-12-16T22:45:55.224 INFO:teuthology.orchestra.run.smithi177.stdout:1832 trunc from 0xed422aa to 0xe05ec15 2019-12-16T22:45:55.227 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.228 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.228 INFO:teuthology.orchestra.run.smithi177.stdout:2302 read 0xcddcaf3 thru 0xcde32f5 (0x6803 bytes) 2019-12-16T22:45:55.228 INFO:teuthology.orchestra.run.smithi177.stdout:2303 punch from 0xc6d7a15 to 0xc6debcd, (0x71b8 bytes) 2019-12-16T22:45:55.238 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone14 from 0xec4e645 (overlap 0x43d2a60) to 0x36421e6 2019-12-16T22:45:55.241 INFO:teuthology.orchestra.run.smithi177.stdout:2304 trunc from 0xe001682 to 0x5d0b794 2019-12-16T22:45:55.246 INFO:teuthology.orchestra.run.smithi177.stdout:1855 write 0xc3064e8 thru 0xc30d3dd (0x6ef6 bytes) 2019-12-16T22:45:55.264 INFO:teuthology.orchestra.run.smithi177.stdout:1833 read 0x7015c37 thru 0x7017d1e (0x20e8 bytes) 2019-12-16T22:45:55.265 INFO:teuthology.orchestra.run.smithi177.stdout:1834 read 0x9fd8adf thru 0x9fdd002 (0x4524 bytes) 2019-12-16T22:45:55.265 INFO:teuthology.orchestra.run.smithi177.stdout:1835 read 0x3251c9b thru 0x325d0c5 (0xb42b bytes) 2019-12-16T22:45:55.266 INFO:teuthology.orchestra.run.smithi177.stdout:1836 read 0xdd5a248 thru 0xdd647a1 (0xa55a bytes) 2019-12-16T22:45:55.267 INFO:teuthology.orchestra.run.smithi177.stdout:1837 write 0x7f4945a thru 0x7f562c8 (0xce6f bytes) 2019-12-16T22:45:55.280 INFO:teuthology.orchestra.run.smithi177.stdout:1856 trunc from 0xc30d3de to 0x70f6191 2019-12-16T22:45:55.283 INFO:teuthology.orchestra.run.smithi177.stdout:1838 write 0x6482aeb thru 0x6486298 (0x37ae bytes) 2019-12-16T22:45:55.318 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.318 INFO:teuthology.orchestra.run.smithi177.stdout:2306 read 0x5b986b thru 0x5c5fe3 (0xc779 bytes) 2019-12-16T22:45:55.324 INFO:teuthology.orchestra.run.smithi177.stdout:1839 trunc from 0xe05ec15 to 0x34fae6f 2019-12-16T22:45:55.325 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #11, image image_cluster1.client.mirror.5-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent12 2019-12-16T22:45:55.346 INFO:teuthology.orchestra.run.smithi177.stdout:2307 write 0x96d3391 thru 0x96e0e0a (0xda7a bytes) 2019-12-16T22:45:55.352 INFO:teuthology.orchestra.run.smithi177.stdout:1857 write 0x3aa74f7 thru 0x3ab586e (0xe378 bytes) 2019-12-16T22:45:55.364 INFO:teuthology.orchestra.run.smithi177.stdout:2308 writesame 0x4ab1d8d thru 0x4ab9b73 data_size 0x1(0x7de7 bytes) 2019-12-16T22:45:55.369 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.370 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.370 INFO:teuthology.orchestra.run.smithi177.stdout:1860 write 0x23889ff thru 0x2389ed6 (0x14d8 bytes) 2019-12-16T22:45:55.373 INFO:teuthology.orchestra.run.smithi177.stdout:1843 trunc from 0x34fae6f to 0x558fef0 2019-12-16T22:45:55.396 INFO:teuthology.orchestra.run.smithi177.stdout:2309 read 0x598a8b0 thru 0x59988c4 (0xe015 bytes) 2019-12-16T22:45:55.396 INFO:teuthology.orchestra.run.smithi177.stdout:1861 trunc from 0x70f6191 to 0x74f2576 2019-12-16T22:45:55.399 INFO:teuthology.orchestra.run.smithi177.stdout:2310 trunc from 0x96e0e0b to 0xba27a96 2019-12-16T22:45:55.404 INFO:teuthology.orchestra.run.smithi177.stdout:1844 read 0x57282 thru 0x59e22 (0x2ba1 bytes) 2019-12-16T22:45:55.404 INFO:teuthology.orchestra.run.smithi177.stdout:1846 read 0x222a307 thru 0x2236b5f (0xc859 bytes) 2019-12-16T22:45:55.405 INFO:teuthology.orchestra.run.smithi177.stdout:1847 read 0x3707640 thru 0x3708150 (0xb11 bytes) 2019-12-16T22:45:55.405 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.405 INFO:teuthology.orchestra.run.smithi177.stdout:1850 writesame 0x4c2b9eb thru 0x4c2fa6a data_size 0x40(0x4080 bytes) 2019-12-16T22:45:55.412 INFO:teuthology.orchestra.run.smithi177.stdout:1851 read 0x2628117 thru 0x2635aa3 (0xd98d bytes) 2019-12-16T22:45:55.413 INFO:teuthology.orchestra.run.smithi177.stdout:1852 punch from 0x54d1879 to 0x54dc9af, (0xb136 bytes) 2019-12-16T22:45:55.414 INFO:teuthology.orchestra.run.smithi177.stdout:1862 clone 19 order 19 su 16384 sc 13 2019-12-16T22:45:55.418 INFO:teuthology.orchestra.run.smithi177.stdout:2312 punch from 0x4881445 to 0x4890786, (0xf341 bytes) 2019-12-16T22:45:55.418 INFO:teuthology.orchestra.run.smithi177.stdout:2315 read 0x9991a69 thru 0x9992c5f (0x11f7 bytes) 2019-12-16T22:45:55.419 INFO:teuthology.orchestra.run.smithi177.stdout:2317 write 0x3555865 thru 0x3557833 (0x1fcf bytes) 2019-12-16T22:45:55.428 INFO:teuthology.orchestra.run.smithi177.stdout:2318 write 0x9d26769 thru 0x9d2906b (0x2903 bytes) 2019-12-16T22:45:55.435 INFO:teuthology.orchestra.run.smithi177.stdout:2320 write 0x993c9ad thru 0x9941dfb (0x544f bytes) 2019-12-16T22:45:55.442 INFO:teuthology.orchestra.run.smithi177.stdout:1853 write 0x90ef4b5 thru 0x90f527e (0x5dca bytes) 2019-12-16T22:45:55.449 INFO:teuthology.orchestra.run.smithi177.stdout:1854 read 0x614f6ee thru 0x615f5b8 (0xfecb bytes) 2019-12-16T22:45:55.457 INFO:teuthology.orchestra.run.smithi177.stdout:1855 trunc from 0x90f527f to 0x90fff7c 2019-12-16T22:45:55.457 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #13, image image_cluster1.client.mirror.3-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent14 2019-12-16T22:45:55.462 INFO:teuthology.orchestra.run.smithi177.stdout:2322 trunc from 0xba27a96 to 0xec9ebc 2019-12-16T22:45:55.468 INFO:teuthology.orchestra.run.smithi177.stdout:1857 write 0x211e527 thru 0x212080b (0x22e5 bytes) 2019-12-16T22:45:55.473 INFO:teuthology.orchestra.run.smithi177.stdout:1951 trunc from 0xd9780f to 0x5f30e2c 2019-12-16T22:45:55.477 INFO:teuthology.orchestra.run.smithi177.stdout:1861 punch from 0x280625a to 0x28083ae, (0x2154 bytes) 2019-12-16T22:45:55.478 INFO:teuthology.orchestra.run.smithi177.stdout:1741 punch from 0x4eed42b to 0x4eef308, (0x1edd bytes) 2019-12-16T22:45:55.479 INFO:teuthology.orchestra.run.smithi177.stdout:1862 trunc from 0x90fff7c to 0x7714f57 2019-12-16T22:45:55.508 INFO:teuthology.orchestra.run.smithi177.stdout:1742 punch from 0x80f86c8 to 0x80fd9c9, (0x5301 bytes) 2019-12-16T22:45:55.508 INFO:teuthology.orchestra.run.smithi177.stdout:1743 read 0x8dfe572 thru 0x8e070e2 (0x8b71 bytes) 2019-12-16T22:45:55.518 INFO:teuthology.orchestra.run.smithi177.stdout:1744 trunc from 0xec4e645 to 0x7e61d22 2019-12-16T22:45:55.528 INFO:teuthology.orchestra.run.smithi177.stdout:1953 read 0x253c787 thru 0x25466ac (0x9f26 bytes) 2019-12-16T22:45:55.528 INFO:teuthology.orchestra.run.smithi177.stdout:1956 read 0x5764bd1 thru 0x57740e2 (0xf512 bytes) 2019-12-16T22:45:55.528 INFO:teuthology.orchestra.run.smithi177.stdout:1957 punch from 0x54f9a3b to 0x54fe697, (0x4c5c bytes) 2019-12-16T22:45:55.562 INFO:teuthology.orchestra.run.smithi177.stdout:1958 writesame 0x65abf8a thru 0x65b3d6d data_size 0xe(0x7de4 bytes) 2019-12-16T22:45:55.583 INFO:teuthology.orchestra.run.smithi177.stdout:1864 write 0xa0fcda5 thru 0xa0ff75a (0x29b6 bytes) 2019-12-16T22:45:55.590 INFO:teuthology.orchestra.run.smithi177.stdout:1865 write 0xe29feb thru 0xe2c2e1 (0x22f7 bytes) 2019-12-16T22:45:55.596 INFO:teuthology.orchestra.run.smithi177.stdout:1866 write 0xf25a6d thru 0xf26d41 (0x12d5 bytes) 2019-12-16T22:45:55.599 INFO:teuthology.orchestra.run.smithi177.stdout:1959 write 0xcbfef9d thru 0xcc0bc76 (0xccda bytes) 2019-12-16T22:45:55.604 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.605 INFO:teuthology.orchestra.run.smithi177.stdout:1871 punch from 0x5532e04 to 0x5540831, (0xda2d bytes) 2019-12-16T22:45:55.605 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.612 INFO:teuthology.orchestra.run.smithi177.stdout:2323 writesame 0x8dfe91f thru 0x8e062a8 data_size 0x2(0x798a bytes) 2019-12-16T22:45:55.617 INFO:teuthology.orchestra.run.smithi177.stdout:2325 read 0x70d5d8b thru 0x70e131d (0xb593 bytes) 2019-12-16T22:45:55.618 INFO:teuthology.orchestra.run.smithi177.stdout:1746 writesame 0xc8afef7 thru 0xc8be321 data_size 0x1(0xe42b bytes) 2019-12-16T22:45:55.620 INFO:teuthology.orchestra.run.smithi177.stdout:1747 write 0x1f9113e thru 0x1f9891e (0x77e1 bytes) 2019-12-16T22:45:55.622 INFO:teuthology.orchestra.run.smithi177.stdout:1961 read 0xc851f6f thru 0xc85a87e (0x8910 bytes) 2019-12-16T22:45:55.625 INFO:teuthology.orchestra.run.smithi177.stdout:1962 trunc from 0xcc0bc77 to 0xba9cfcc 2019-12-16T22:45:55.634 INFO:teuthology.orchestra.run.smithi177.stdout:1873 writesame 0xa8792c4 thru 0xa87b869 data_size 0x1(0x25a6 bytes) 2019-12-16T22:45:55.648 INFO:teuthology.orchestra.run.smithi177.stdout:2329 write 0xc19562a thru 0xc1a43bf (0xed96 bytes) 2019-12-16T22:45:55.652 INFO:teuthology.orchestra.run.smithi177.stdout:1748 punch from 0x7efe632 to 0x7f09352, (0xad20 bytes) 2019-12-16T22:45:55.652 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.652 INFO:teuthology.orchestra.run.smithi177.stdout:1751 write 0x3fb47f8 thru 0x3fb5793 (0xf9c bytes) 2019-12-16T22:45:55.657 INFO:teuthology.orchestra.run.smithi177.stdout:1874 trunc from 0xa87b86a to 0x242dc4f 2019-12-16T22:45:55.658 INFO:teuthology.orchestra.run.smithi177.stdout:2331 writesame 0x89788cd thru 0x897c994 data_size 0xc(0x40c8 bytes) 2019-12-16T22:45:55.666 INFO:teuthology.orchestra.run.smithi177.stdout:2332 read 0xaa5e4ec thru 0xaa666a0 (0x81b5 bytes) 2019-12-16T22:45:55.666 INFO:teuthology.orchestra.run.smithi177.stdout:1963 write 0xb5ffe36 thru 0xb6083fc (0x85c7 bytes) 2019-12-16T22:45:55.675 INFO:teuthology.orchestra.run.smithi177.stdout:1752 read 0xbb64945 thru 0xbb74295 (0xf951 bytes) 2019-12-16T22:45:55.685 INFO:teuthology.orchestra.run.smithi177.stdout:2333 trunc from 0xc1a43c0 to 0x283e22a 2019-12-16T22:45:55.692 INFO:teuthology.orchestra.run.smithi177.stdout:1964 writesame 0x9126d48 thru 0x912fd0f data_size 0x2b(0x8fc8 bytes) 2019-12-16T22:45:55.696 INFO:teuthology.orchestra.run.smithi177.stdout:1753 trunc from 0xc8be322 to 0x1a32072 2019-12-16T22:45:55.707 INFO:teuthology.orchestra.run.smithi177.stdout:1967 write 0x622e40c thru 0x6230aed (0x26e2 bytes) 2019-12-16T22:45:55.718 INFO:teuthology.orchestra.run.smithi177.stdout:1968 read 0x82655e3 thru 0x8272744 (0xd162 bytes) 2019-12-16T22:45:55.718 INFO:teuthology.orchestra.run.smithi177.stdout:1969 read 0x55e7ff4 thru 0x55f6d58 (0xed65 bytes) 2019-12-16T22:45:55.719 INFO:teuthology.orchestra.run.smithi177.stdout:1970 clone 14 order 21 su 8192 sc 11 2019-12-16T22:45:55.748 INFO:teuthology.orchestra.run.smithi177.stdout:1875 writesame 0xaacc60e thru 0xaad86c8 data_size 0x1(0xc0bb bytes) 2019-12-16T22:45:55.756 INFO:teuthology.orchestra.run.smithi177.stdout:1877 trunc from 0xaad86c9 to 0xcbd5d34 2019-12-16T22:45:55.761 INFO:teuthology.orchestra.run.smithi177.stdout:2334 writesame 0xc6346f2 thru 0xc63e19a data_size 0x11(0x9aa9 bytes) 2019-12-16T22:45:55.763 INFO:teuthology.orchestra.run.smithi177.stdout:2336 punch from 0x3d44dcd to 0x3d49db6, (0x4fe9 bytes) 2019-12-16T22:45:55.782 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.782 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.782 INFO:teuthology.orchestra.run.smithi177.stdout:1883 read 0x2d07282 thru 0x2d0b30a (0x4089 bytes) 2019-12-16T22:45:55.793 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.793 INFO:teuthology.orchestra.run.smithi177.stdout:1886 write 0x3eafb5c thru 0x3eb4878 (0x4d1d bytes) 2019-12-16T22:45:55.794 INFO:teuthology.orchestra.run.smithi177.stdout:1887 read 0x966fe4d thru 0x96709d5 (0xb89 bytes) 2019-12-16T22:45:55.794 INFO:teuthology.orchestra.run.smithi177.stdout:1889 punch from 0x2d787be to 0x2d79cc6, (0x1508 bytes) 2019-12-16T22:45:55.794 INFO:teuthology.orchestra.run.smithi177.stdout:1890 read 0x582ce85 thru 0x583c83e (0xf9ba bytes) 2019-12-16T22:45:55.794 INFO:teuthology.orchestra.run.smithi177.stdout:1891 punch from 0x5529034 to 0x553570f, (0xc6db bytes) 2019-12-16T22:45:55.794 INFO:teuthology.orchestra.run.smithi177.stdout:1893 writesame 0xb15ca5 thru 0xb16e7e data_size 0x5(0x11da bytes) 2019-12-16T22:45:55.794 INFO:teuthology.orchestra.run.smithi177.stdout:2337 write 0xcd9741d thru 0xcd9b24e (0x3e32 bytes) 2019-12-16T22:45:55.796 INFO:teuthology.orchestra.run.smithi177.stdout:1894 read 0x393aba7 thru 0x3946c03 (0xc05d bytes) 2019-12-16T22:45:55.798 INFO:teuthology.orchestra.run.smithi177.stdout:1896 write 0x8be1e1f thru 0x8bedae6 (0xbcc8 bytes) 2019-12-16T22:45:55.803 INFO:teuthology.orchestra.run.smithi177.stdout:2338 read 0xaf0ccf6 thru 0xaf1042f (0x373a bytes) 2019-12-16T22:45:55.803 INFO:teuthology.orchestra.run.smithi177.stdout:2341 writesame 0x2ff04dc thru 0x2ff1b39 data_size 0x7(0x165e bytes) 2019-12-16T22:45:55.825 INFO:teuthology.orchestra.run.smithi177.stdout:1898 write 0x3baa34a thru 0x3bb346d (0x9124 bytes) 2019-12-16T22:45:55.825 INFO:teuthology.orchestra.run.smithi177.stdout:2342 punch from 0x1f4d9 to 0x2dd34, (0xe85b bytes) 2019-12-16T22:45:55.826 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.826 INFO:teuthology.orchestra.run.smithi177.stdout:2344 read 0xa770a6f thru 0xa77b97a (0xaf0c bytes) 2019-12-16T22:45:55.826 INFO:teuthology.orchestra.run.smithi177.stdout:2345 writesame 0x4aa789c thru 0x4ab5beb data_size 0x8(0xe350 bytes) 2019-12-16T22:45:55.831 INFO:teuthology.orchestra.run.smithi177.stdout:1900 writesame 0x33381c5 thru 0x33444f5 data_size 0x1(0xc331 bytes) 2019-12-16T22:45:55.838 INFO:teuthology.orchestra.run.smithi177.stdout:2346 write 0x2ceccb5 thru 0x2cf9a77 (0xcdc3 bytes) 2019-12-16T22:45:55.839 INFO:teuthology.orchestra.run.smithi177.stdout:1754 read 0xff476c thru 0xff71ff (0x2a94 bytes) 2019-12-16T22:45:55.879 INFO:teuthology.orchestra.run.smithi177.stdout:1901 write 0x115d2f6 thru 0x11613b2 (0x40bd bytes) 2019-12-16T22:45:55.879 INFO:teuthology.orchestra.run.smithi177.stdout:1755 write 0x585d92a thru 0x5862fa9 (0x5680 bytes) 2019-12-16T22:45:55.884 INFO:teuthology.orchestra.run.smithi177.stdout:1756 trunc from 0x5862faa to 0x3de6f50 2019-12-16T22:45:55.891 INFO:teuthology.orchestra.run.smithi177.stdout:2347 writesame 0xec2e585 thru 0xec36284 data_size 0x80(0x7d00 bytes) 2019-12-16T22:45:55.893 INFO:teuthology.orchestra.run.smithi177.stdout:2349 read 0x2c77dd1 thru 0x2c7d89e (0x5ace bytes) 2019-12-16T22:45:55.893 INFO:teuthology.orchestra.run.smithi177.stdout:2352 write 0xacdf851 thru 0xace76ba (0x7e6a bytes) 2019-12-16T22:45:55.894 INFO:teuthology.orchestra.run.smithi177.stdout:1902 trunc from 0xcbd5d34 to 0x37dbd19 2019-12-16T22:45:55.902 INFO:teuthology.orchestra.run.smithi177.stdout:2354 writesame 0xe340ccd thru 0xe347b2b data_size 0x1(0x6e5f bytes) 2019-12-16T22:45:55.916 INFO:teuthology.orchestra.run.smithi177.stdout:1757 trunc from 0x3de6f50 to 0x16d32a3 2019-12-16T22:45:55.924 INFO:teuthology.orchestra.run.smithi177.stdout:2356 read 0x23b0fac thru 0x23b79c3 (0x6a18 bytes) 2019-12-16T22:45:55.925 INFO:teuthology.orchestra.run.smithi177.stdout:2357 punch from 0x6b91fe6 to 0x6b9d398, (0xb3b2 bytes) 2019-12-16T22:45:55.925 INFO:teuthology.orchestra.run.smithi177.stdout:2358 write 0x1fdb256 thru 0x1fe586a (0xa615 bytes) 2019-12-16T22:45:55.940 INFO:teuthology.orchestra.run.smithi177.stdout:2359 read 0x30d6ed2 thru 0x30d8e64 (0x1f93 bytes) 2019-12-16T22:45:55.941 INFO:teuthology.orchestra.run.smithi177.stdout:2360 write 0x33f3691 thru 0x3400253 (0xcbc3 bytes) 2019-12-16T22:45:55.951 INFO:teuthology.orchestra.run.smithi177.stdout:2361 punch from 0xd52b2f7 to 0xd52f76d, (0x4476 bytes) 2019-12-16T22:45:55.952 INFO:teuthology.orchestra.run.smithi177.stdout:2362 write 0xc46d161 thru 0xc47a436 (0xd2d6 bytes) 2019-12-16T22:45:55.963 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:55.963 INFO:teuthology.orchestra.run.smithi177.stdout:2364 read 0x6104869 thru 0x610c1c9 (0x7961 bytes) 2019-12-16T22:45:55.963 INFO:teuthology.orchestra.run.smithi177.stdout:2365 read 0xa4e3ed thru 0xa5ca87 (0xe69b bytes) 2019-12-16T22:45:55.965 INFO:teuthology.orchestra.run.smithi177.stdout:2366 write 0x7da6a8c thru 0x7db36b9 (0xcc2e bytes) 2019-12-16T22:45:55.974 INFO:teuthology.orchestra.run.smithi177.stdout:1903 writesame 0xd4137cf thru 0xd41d724 data_size 0x5(0x9f56 bytes) 2019-12-16T22:45:55.985 INFO:teuthology.orchestra.run.smithi177.stdout:1758 write 0xa213cd9 thru 0xa216e2a (0x3152 bytes) 2019-12-16T22:45:55.987 INFO:teuthology.orchestra.run.smithi177.stdout:2368 trunc from 0xec36285 to 0x5708ece 2019-12-16T22:45:55.992 INFO:teuthology.orchestra.run.smithi177.stdout:1759 write 0x3ff2c53 thru 0x3ffa976 (0x7d24 bytes) 2019-12-16T22:45:56.000 INFO:teuthology.orchestra.run.smithi177.stdout:1905 write 0xd7e087e thru 0xd7e5b21 (0x52a4 bytes) 2019-12-16T22:45:56.003 INFO:teuthology.orchestra.run.smithi177.stdout:1760 read 0x6e2e059 thru 0x6e36b0c (0x8ab4 bytes) 2019-12-16T22:45:56.003 INFO:teuthology.orchestra.run.smithi177.stdout:1761 punch from 0x1ab60b7 to 0x1ab9150, (0x3099 bytes) 2019-12-16T22:45:56.003 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.004 INFO:teuthology.orchestra.run.smithi177.stdout:1764 write 0x6803854 thru 0x681124c (0xd9f9 bytes) 2019-12-16T22:45:56.012 INFO:teuthology.orchestra.run.smithi177.stdout:1907 write 0xaf58ff4 thru 0xaf63b5e (0xab6b bytes) 2019-12-16T22:45:56.032 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.032 INFO:teuthology.orchestra.run.smithi177.stdout:1766 write 0x54f9468 thru 0x54fc10f (0x2ca8 bytes) 2019-12-16T22:45:56.042 INFO:teuthology.orchestra.run.smithi177.stdout:2369 read 0x128c256 thru 0x1294e7d (0x8c28 bytes) 2019-12-16T22:45:56.044 INFO:teuthology.orchestra.run.smithi177.stdout:2370 read 0x27896f7 thru 0x278badc (0x23e6 bytes) 2019-12-16T22:45:56.044 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.044 INFO:teuthology.orchestra.run.smithi177.stdout:2373 read 0x3985bba thru 0x3992442 (0xc889 bytes) 2019-12-16T22:45:56.045 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.051 INFO:teuthology.orchestra.run.smithi177.stdout:1767 punch from 0x5eadaba to 0x5ebb39c, (0xd8e2 bytes) 2019-12-16T22:45:56.051 INFO:teuthology.orchestra.run.smithi177.stdout:1769 read 0x33d13e thru 0x349586 (0xc449 bytes) 2019-12-16T22:45:56.051 INFO:teuthology.orchestra.run.smithi177.stdout:1770 write 0x271663f thru 0x2722221 (0xbbe3 bytes) 2019-12-16T22:45:56.052 INFO:teuthology.orchestra.run.smithi177.stdout:1909 read 0x2fe2766 thru 0x2fefa87 (0xd322 bytes) 2019-12-16T22:45:56.060 INFO:teuthology.orchestra.run.smithi177.stdout:1773 read 0x8348919 thru 0x834c396 (0x3a7e bytes) 2019-12-16T22:45:56.060 INFO:teuthology.orchestra.run.smithi177.stdout:1774 punch from 0x2a428c9 to 0x2a4993b, (0x7072 bytes) 2019-12-16T22:45:56.061 INFO:teuthology.orchestra.run.smithi177.stdout:1775 write 0x7be95d thru 0x7c5fa8 (0x764c bytes) 2019-12-16T22:45:56.064 INFO:teuthology.orchestra.run.smithi177.stdout:1910 trunc from 0xd7e5b22 to 0xa16c821 2019-12-16T22:45:56.067 INFO:teuthology.orchestra.run.smithi177.stdout:2375 trunc from 0x5708ece to 0xe583eca 2019-12-16T22:45:56.069 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.089 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.090 INFO:teuthology.orchestra.run.smithi177.stdout:2379 write 0xbc0c9e2 thru 0xbc0ee99 (0x24b8 bytes) 2019-12-16T22:45:56.090 INFO:teuthology.orchestra.run.smithi177.stdout:1778 trunc from 0xa216e2b to 0x32a446 2019-12-16T22:45:56.101 INFO:teuthology.orchestra.run.smithi177.stdout:2380 writesame 0x42c1fd1 thru 0x42c2382 data_size 0x2(0x3b2 bytes) 2019-12-16T22:45:56.114 INFO:teuthology.orchestra.run.smithi177.stdout:2382 write 0xdbd4ef7 thru 0xdbd5143 (0x24d bytes) 2019-12-16T22:45:56.122 INFO:teuthology.orchestra.run.smithi177.stdout:1911 trunc from 0xa16c821 to 0x40b9199 2019-12-16T22:45:56.123 INFO:teuthology.orchestra.run.smithi177.stdout:2383 write 0x582207e thru 0x582d862 (0xb7e5 bytes) 2019-12-16T22:45:56.136 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.136 INFO:teuthology.orchestra.run.smithi177.stdout:2385 writesame 0x2bd417e thru 0x2bd8df9 data_size 0x59(0x4c7c bytes) 2019-12-16T22:45:56.137 INFO:teuthology.orchestra.run.smithi177.stdout:1779 read 0x201914 thru 0x205648 (0x3d35 bytes) 2019-12-16T22:45:56.144 INFO:teuthology.orchestra.run.smithi177.stdout:2386 writesame 0xcb4ded thru 0xcb517a data_size 0x2(0x38e bytes) 2019-12-16T22:45:56.146 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.146 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.146 INFO:teuthology.orchestra.run.smithi177.stdout:2391 read 0xe20b024 thru 0xe20ea70 (0x3a4d bytes) 2019-12-16T22:45:56.152 INFO:teuthology.orchestra.run.smithi177.stdout:2392 trunc from 0xe583eca to 0xb460760 2019-12-16T22:45:56.189 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone12 from 0xe7bd7e4 (overlap 0x629ad52) to 0x2771220 2019-12-16T22:45:56.220 INFO:teuthology.orchestra.run.smithi177.stdout:1780 writesame 0xce1fef2 thru 0xce212b0 data_size 0x5(0x13bf bytes) 2019-12-16T22:45:56.221 INFO:teuthology.orchestra.run.smithi177.stdout:1912 write 0xe778c4d thru 0xe785e39 (0xd1ed bytes) 2019-12-16T22:45:56.221 INFO:teuthology.orchestra.run.smithi177.stdout:2393 trunc from 0xb460760 to 0x1a1d87a 2019-12-16T22:45:56.227 INFO:teuthology.orchestra.run.smithi177.stdout:1781 writesame 0xb70ea02 thru 0xb715869 data_size 0x4(0x6e68 bytes) 2019-12-16T22:45:56.239 INFO:teuthology.orchestra.run.smithi177.stdout:1913 read 0xc89c0c2 thru 0xc8a2f64 (0x6ea3 bytes) 2019-12-16T22:45:56.239 INFO:teuthology.orchestra.run.smithi177.stdout:1914 punch from 0xd331711 to 0xd33af7b, (0x986a bytes) 2019-12-16T22:45:56.240 INFO:teuthology.orchestra.run.smithi177.stdout:1916 read 0xa3dc7ba thru 0xa3e79b3 (0xb1fa bytes) 2019-12-16T22:45:56.243 INFO:teuthology.orchestra.run.smithi177.stdout:1782 writesame 0x71831f6 thru 0x71893d9 data_size 0x23(0x61e4 bytes) 2019-12-16T22:45:56.245 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone13 from 0xba9cfcc (overlap 0xd9780f) to 0x827b3c 2019-12-16T22:45:56.251 INFO:teuthology.orchestra.run.smithi177.stdout:1917 trunc from 0xe785e3a to 0x903fa29 2019-12-16T22:45:56.261 INFO:teuthology.orchestra.run.smithi177.stdout:1783 punch from 0x148fed6 to 0x14919b3, (0x1add bytes) 2019-12-16T22:45:56.261 INFO:teuthology.orchestra.run.smithi177.stdout:1784 write 0x1e08958 thru 0x1e0f072 (0x671b bytes) 2019-12-16T22:45:56.272 INFO:teuthology.orchestra.run.smithi177.stdout:2394 read 0xe0d20d thru 0xe1c2af (0xf0a3 bytes) 2019-12-16T22:45:56.274 INFO:teuthology.orchestra.run.smithi177.stdout:2395 read 0x15012a6 thru 0x1508ea0 (0x7bfb bytes) 2019-12-16T22:45:56.288 INFO:teuthology.orchestra.run.smithi177.stdout:1785 trunc from 0xce212b1 to 0x66fd5df 2019-12-16T22:45:56.303 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone18 from 0x74f2576 (overlap 0x70f6191) to 0x2d2f3d3 2019-12-16T22:45:56.340 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.340 INFO:teuthology.orchestra.run.smithi177.stdout:1919 read 0x87b283 thru 0x881b3c (0x68ba bytes) 2019-12-16T22:45:56.342 INFO:teuthology.orchestra.run.smithi177.stdout:1920 trunc from 0x903fa29 to 0x885f524 2019-12-16T22:45:56.343 INFO:teuthology.orchestra.run.smithi177.stdout:2396 write 0x73d4808 thru 0x73d5110 (0x909 bytes) 2019-12-16T22:45:56.384 INFO:teuthology.orchestra.run.smithi177.stdout:2397 read 0x4d019f1 thru 0x4d037a7 (0x1db7 bytes) 2019-12-16T22:45:56.384 INFO:teuthology.orchestra.run.smithi177.stdout:2401 write 0x65ffecc thru 0x6607831 (0x7966 bytes) 2019-12-16T22:45:56.414 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.414 INFO:teuthology.orchestra.run.smithi177.stdout:1788 punch from 0x2c1cb5 to 0x2c321d, (0x1568 bytes) 2019-12-16T22:45:56.414 INFO:teuthology.orchestra.run.smithi177.stdout:1790 write 0x400d38c thru 0x4018b37 (0xb7ac bytes) 2019-12-16T22:45:56.416 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #11, image image_cluster1.client.mirror.2-clone11 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent12 2019-12-16T22:45:56.425 INFO:teuthology.orchestra.run.smithi177.stdout:1791 read 0x61d3d4d thru 0x61d7768 (0x3a1c bytes) 2019-12-16T22:45:56.441 INFO:teuthology.orchestra.run.smithi177.stdout:1921 writesame 0x8c8b7b7 thru 0x8c8e04c data_size 0x5(0x2896 bytes) 2019-12-16T22:45:56.458 INFO:teuthology.orchestra.run.smithi177.stdout:2403 write 0xe25464d thru 0xe2557fb (0x11af bytes) 2019-12-16T22:45:56.463 INFO:teuthology.orchestra.run.smithi177.stdout:1792 write 0xe9527e0 thru 0xe95a3cc (0x7bed bytes) 2019-12-16T22:45:56.465 INFO:teuthology.orchestra.run.smithi177.stdout:2404 punch from 0x4796a23 to 0x479d8ad, (0x6e8a bytes) 2019-12-16T22:45:56.466 INFO:teuthology.orchestra.run.smithi177.stdout:2405 flatten 2019-12-16T22:45:56.473 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.474 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.474 INFO:teuthology.orchestra.run.smithi177.stdout:1795 write 0x45a80f thru 0x45c392 (0x1b84 bytes) 2019-12-16T22:45:56.476 INFO:teuthology.orchestra.run.smithi177.stdout:1922 write 0xedc941d thru 0xedc9c29 (0x80d bytes) 2019-12-16T22:45:56.484 INFO:teuthology.orchestra.run.smithi177.stdout:1923 writesame 0x183088b thru 0x183a6e6 data_size 0xa(0x9e5c bytes) 2019-12-16T22:45:56.489 INFO:teuthology.orchestra.run.smithi177.stdout:2407 punch from 0xd134919 to 0xd13a689, (0x5d70 bytes) 2019-12-16T22:45:56.490 INFO:teuthology.orchestra.run.smithi177.stdout:2408 read 0xd6da1b8 thru 0xd6dac3e (0xa87 bytes) 2019-12-16T22:45:56.490 INFO:teuthology.orchestra.run.smithi177.stdout:2410 writesame 0x18e515c thru 0x18ed2bf data_size 0x1c(0x8164 bytes) 2019-12-16T22:45:56.505 INFO:teuthology.orchestra.run.smithi177.stdout:1796 trunc from 0xe95a3cd to 0x6cc57a6 2019-12-16T22:45:56.505 INFO:teuthology.orchestra.run.smithi177.stdout:2411 read 0x5a2cd88 thru 0x5a2d550 (0x7c9 bytes) 2019-12-16T22:45:56.505 INFO:teuthology.orchestra.run.smithi177.stdout:2413 clone 14 order 22 su 2097152 sc 15 2019-12-16T22:45:56.513 INFO:teuthology.orchestra.run.smithi177.stdout:1926 trunc from 0xedc9c2a to 0x1e2cc9c 2019-12-16T22:45:56.527 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #12, image image_cluster1.client.mirror.5-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent13 2019-12-16T22:45:56.539 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.546 INFO:teuthology.orchestra.run.smithi177.stdout:1798 write 0xc08e8e3 thru 0xc09c647 (0xdd65 bytes) 2019-12-16T22:45:56.555 INFO:teuthology.orchestra.run.smithi177.stdout:1799 read 0x3e2f4f7 thru 0x3e354d7 (0x5fe1 bytes) 2019-12-16T22:45:56.556 INFO:teuthology.orchestra.run.smithi177.stdout:1800 read 0x1af1aac thru 0x1afb5a7 (0x9afc bytes) 2019-12-16T22:45:56.568 INFO:teuthology.orchestra.run.smithi177.stdout:1928 write 0x8b2d460 thru 0x8b34fc0 (0x7b61 bytes) 2019-12-16T22:45:56.574 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.576 INFO:teuthology.orchestra.run.smithi177.stdout:1801 write 0xd6ae46a thru 0xd6b0b2c (0x26c3 bytes) 2019-12-16T22:45:56.581 INFO:teuthology.orchestra.run.smithi177.stdout:1802 writesame 0x7f9926b thru 0x7fa327b data_size 0x1d(0xa011 bytes) 2019-12-16T22:45:56.589 INFO:teuthology.orchestra.run.smithi177.stdout:1973 writesame 0x7de8acf thru 0x7df24e3 data_size 0x31(0x9a15 bytes) 2019-12-16T22:45:56.589 INFO:teuthology.orchestra.run.smithi177.stdout:1804 write 0x70c269 thru 0x7188ba (0xc652 bytes) 2019-12-16T22:45:56.594 INFO:teuthology.orchestra.run.smithi177.stdout:1805 writesame 0xc68bfe2 thru 0xc68e75b data_size 0x1f(0x277a bytes) 2019-12-16T22:45:56.602 INFO:teuthology.orchestra.run.smithi177.stdout:1806 clone 16 order 23 su 4194304 sc 9 2019-12-16T22:45:56.606 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #17, image image_cluster1.client.mirror.0-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent18 2019-12-16T22:45:56.607 INFO:teuthology.orchestra.run.smithi177.stdout:1930 write 0xea0f702 thru 0xea10e39 (0x1738 bytes) 2019-12-16T22:45:56.613 INFO:teuthology.orchestra.run.smithi177.stdout:1931 write 0x9ab5d04 thru 0x9abb11b (0x5418 bytes) 2019-12-16T22:45:56.616 INFO:teuthology.orchestra.run.smithi177.stdout:1527 writesame 0x5d097c0 thru 0x5d15e86 data_size 0x1(0xc6c7 bytes) 2019-12-16T22:45:56.625 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.627 INFO:teuthology.orchestra.run.smithi177.stdout:1933 punch from 0x825a67e to 0x8261ef4, (0x7876 bytes) 2019-12-16T22:45:56.627 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.627 INFO:teuthology.orchestra.run.smithi177.stdout:1935 read 0x6a4f316 thru 0x6a4ff01 (0xbec bytes) 2019-12-16T22:45:56.627 INFO:teuthology.orchestra.run.smithi177.stdout:1936 write 0x774b551 thru 0x7758166 (0xcc16 bytes) 2019-12-16T22:45:56.637 INFO:teuthology.orchestra.run.smithi177.stdout:1938 writesame 0x82c7aa8 thru 0x82d5909 data_size 0x5(0xde62 bytes) 2019-12-16T22:45:56.653 INFO:teuthology.orchestra.run.smithi177.stdout:1941 write 0x71637dd thru 0x7167b33 (0x4357 bytes) 2019-12-16T22:45:56.671 INFO:teuthology.orchestra.run.smithi177.stdout:1974 read 0x2b4278e thru 0x2b4e5fc (0xbe6f bytes) 2019-12-16T22:45:56.680 INFO:teuthology.orchestra.run.smithi177.stdout:1942 write 0x2fee578 thru 0x2ffbe81 (0xd90a bytes) 2019-12-16T22:45:56.694 INFO:teuthology.orchestra.run.smithi177.stdout:1975 write 0xbcaba21 thru 0xbcac5e7 (0xbc7 bytes) 2019-12-16T22:45:56.699 INFO:teuthology.orchestra.run.smithi177.stdout:1863 trunc from 0x74f2576 to 0x814a391 2019-12-16T22:45:56.699 INFO:teuthology.orchestra.run.smithi177.stdout:1528 write 0xe8c36e2 thru 0xe8c3a1c (0x33b bytes) 2019-12-16T22:45:56.708 INFO:teuthology.orchestra.run.smithi177.stdout:1943 trunc from 0xea10e3a to 0x5cf7e8f 2019-12-16T22:45:56.709 INFO:teuthology.orchestra.run.smithi177.stdout:1977 write 0x7fb5da9 thru 0x7fbcd0b (0x6f63 bytes) 2019-12-16T22:45:56.711 INFO:teuthology.orchestra.run.smithi177.stdout:1530 trunc from 0xe8c3a1d to 0xc5c74ee 2019-12-16T22:45:56.730 INFO:teuthology.orchestra.run.smithi177.stdout:1978 writesame 0x531c9b0 thru 0x532790c data_size 0x1(0xaf5d bytes) 2019-12-16T22:45:56.742 INFO:teuthology.orchestra.run.smithi177.stdout:1865 write 0xc74871 thru 0xc74a02 (0x192 bytes) 2019-12-16T22:45:56.749 INFO:teuthology.orchestra.run.smithi177.stdout:1944 read 0x3e486db thru 0x3e56ae7 (0xe40d bytes) 2019-12-16T22:45:56.750 INFO:teuthology.orchestra.run.smithi177.stdout:1945 read 0x2832c4e thru 0x283c7ec (0x9b9f bytes) 2019-12-16T22:45:56.757 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.757 INFO:teuthology.orchestra.run.smithi177.stdout:1867 read 0x567d89c thru 0x5686f56 (0x96bb bytes) 2019-12-16T22:45:56.757 INFO:teuthology.orchestra.run.smithi177.stdout:1869 trunc from 0x814a391 to 0x87346a7 2019-12-16T22:45:56.786 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.786 INFO:teuthology.orchestra.run.smithi177.stdout:1980 write 0x429b121 thru 0x42a66f1 (0xb5d1 bytes) 2019-12-16T22:45:56.788 INFO:teuthology.orchestra.run.smithi177.stdout:1946 write 0x5ed68d6 thru 0x5ed8a64 (0x218f bytes) 2019-12-16T22:45:56.792 INFO:teuthology.orchestra.run.smithi177.stdout:1871 punch from 0x3286d2e to 0x3290f1f, (0xa1f1 bytes) 2019-12-16T22:45:56.793 INFO:teuthology.orchestra.run.smithi177.stdout:1872 read 0x3608e92 thru 0x3615980 (0xcaef bytes) 2019-12-16T22:45:56.797 INFO:teuthology.orchestra.run.smithi177.stdout:1532 write 0x1a11ccb thru 0x1a15c4c (0x3f82 bytes) 2019-12-16T22:45:56.797 INFO:teuthology.orchestra.run.smithi177.stdout:1947 read 0x3df794f thru 0x3df9e8a (0x253c bytes) 2019-12-16T22:45:56.807 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.813 INFO:teuthology.orchestra.run.smithi177.stdout:1985 trunc from 0xbcac5e8 to 0x95d7c34 2019-12-16T22:45:56.824 INFO:teuthology.orchestra.run.smithi177.stdout:1533 flatten 2019-12-16T22:45:56.825 INFO:teuthology.orchestra.run.smithi177.stdout:1873 write 0xc94c8f7 thru 0xc94f52e (0x2c38 bytes) 2019-12-16T22:45:56.845 INFO:teuthology.orchestra.run.smithi177.stdout:1948 write 0xc0d6997 thru 0xc0e3c43 (0xd2ad bytes) 2019-12-16T22:45:56.867 INFO:teuthology.orchestra.run.smithi177.stdout:1950 read 0xd5a481 thru 0xd6103d (0x6bbd bytes) 2019-12-16T22:45:56.869 INFO:teuthology.orchestra.run.smithi177.stdout:1951 write 0x717a325 thru 0x7188791 (0xe46d bytes) 2019-12-16T22:45:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:56.892 INFO:teuthology.orchestra.run.smithi177.stdout:1953 write 0xd7a53c thru 0xd8835f (0xde24 bytes) 2019-12-16T22:45:56.909 INFO:teuthology.orchestra.run.smithi177.stdout:1956 punch from 0xb094ca1 to 0xb09bb00, (0x6e5f bytes) 2019-12-16T22:45:56.909 INFO:teuthology.orchestra.run.smithi177.stdout:1957 punch from 0x62719 to 0x62fb0, (0x897 bytes) 2019-12-16T22:45:56.910 INFO:teuthology.orchestra.run.smithi177.stdout:1958 read 0x1958a5 thru 0x197423 (0x1b7f bytes) 2019-12-16T22:45:56.910 INFO:teuthology.orchestra.run.smithi177.stdout:1959 write 0x110d4b thru 0x11e7e0 (0xda96 bytes) 2019-12-16T22:45:56.936 INFO:teuthology.orchestra.run.smithi177.stdout:1961 writesame 0xb1cdf9 thru 0xb25fe1 data_size 0x1(0x91e9 bytes) 2019-12-16T22:45:56.942 INFO:teuthology.orchestra.run.smithi177.stdout:1877 write 0xe47f231 thru 0xe4817af (0x257f bytes) 2019-12-16T22:45:56.982 INFO:teuthology.orchestra.run.smithi177.stdout:1878 trunc from 0xe4817b0 to 0x7e41450 2019-12-16T22:45:56.985 INFO:teuthology.orchestra.run.smithi177.stdout:1986 read 0x3f18f66 thru 0x3f20e78 (0x7f13 bytes) 2019-12-16T22:45:56.986 INFO:teuthology.orchestra.run.smithi177.stdout:1988 write 0x7468379 thru 0x74781f0 (0xfe78 bytes) 2019-12-16T22:45:56.986 INFO:teuthology.orchestra.run.smithi177.stdout:1963 read 0x670e931 thru 0x671c220 (0xd8f0 bytes) 2019-12-16T22:45:56.987 INFO:teuthology.orchestra.run.smithi177.stdout:1964 read 0x7da0395 thru 0x7da618c (0x5df8 bytes) 2019-12-16T22:45:56.988 INFO:teuthology.orchestra.run.smithi177.stdout:1966 read 0x7c8bfe8 thru 0x7c9b453 (0xf46c bytes) 2019-12-16T22:45:56.988 INFO:teuthology.orchestra.run.smithi177.stdout:1968 write 0xf563c6 thru 0xf60ea8 (0xaae3 bytes) 2019-12-16T22:45:57.001 INFO:teuthology.orchestra.run.smithi177.stdout:1970 read 0x564c3da thru 0x565429b (0x7ec2 bytes) 2019-12-16T22:45:57.001 INFO:teuthology.orchestra.run.smithi177.stdout:1971 read 0x6b9e71e thru 0x6ba398e (0x5271 bytes) 2019-12-16T22:45:57.001 INFO:teuthology.orchestra.run.smithi177.stdout:1973 write 0x74f015b thru 0x74f7874 (0x771a bytes) 2019-12-16T22:45:57.031 INFO:teuthology.orchestra.run.smithi177.stdout:1974 trunc from 0xc0e3c44 to 0xecb51f 2019-12-16T22:45:57.043 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.050 INFO:teuthology.orchestra.run.smithi177.stdout:1879 writesame 0x4ed48b8 thru 0x4edcc87 data_size 0x30(0x83d0 bytes) 2019-12-16T22:45:57.121 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.132 INFO:teuthology.orchestra.run.smithi177.stdout:1991 write 0xc67ef4e thru 0xc67fa3a (0xaed bytes) 2019-12-16T22:45:57.135 INFO:teuthology.orchestra.run.smithi177.stdout:1976 read 0xabd61b thru 0xac9b55 (0xc53b bytes) 2019-12-16T22:45:57.135 INFO:teuthology.orchestra.run.smithi177.stdout:1534 writesame 0xe31973d thru 0xe326925 data_size 0x1d(0xd1e9 bytes) 2019-12-16T22:45:57.145 INFO:teuthology.orchestra.run.smithi177.stdout:1977 read 0xc58bf5 thru 0xc5b2b7 (0x26c3 bytes) 2019-12-16T22:45:57.145 INFO:teuthology.orchestra.run.smithi177.stdout:1536 read 0x9b0bce0 thru 0x9b13bb0 (0x7ed1 bytes) 2019-12-16T22:45:57.145 INFO:teuthology.orchestra.run.smithi177.stdout:1537 trunc from 0xe326926 to 0xd9766f8 2019-12-16T22:45:57.156 INFO:teuthology.orchestra.run.smithi177.stdout:1992 read 0xc59ce6e thru 0xc59fe26 (0x2fb9 bytes) 2019-12-16T22:45:57.156 INFO:teuthology.orchestra.run.smithi177.stdout:1993 write 0x65d28ea thru 0x65dc819 (0x9f30 bytes) 2019-12-16T22:45:57.189 INFO:teuthology.orchestra.run.smithi177.stdout:1882 writesame 0xab5b807 thru 0xab66178 data_size 0x2e(0xa972 bytes) 2019-12-16T22:45:57.194 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.195 INFO:teuthology.orchestra.run.smithi177.stdout:1884 read 0x92a3690 thru 0x92afadb (0xc44c bytes) 2019-12-16T22:45:57.195 INFO:teuthology.orchestra.run.smithi177.stdout:1885 writesame 0x55f5d4a thru 0x55ff32a data_size 0x25(0x95e1 bytes) 2019-12-16T22:45:57.203 INFO:teuthology.orchestra.run.smithi177.stdout:1978 writesame 0xc4d68a9 thru 0xc4de3d7 data_size 0x7(0x7b2f bytes) 2019-12-16T22:45:57.208 INFO:teuthology.orchestra.run.smithi177.stdout:1980 write 0x1b3768a thru 0x1b456e8 (0xe05f bytes) 2019-12-16T22:45:57.212 INFO:teuthology.orchestra.run.smithi177.stdout:1538 read 0x4d2c1c4 thru 0x4d30d25 (0x4b62 bytes) 2019-12-16T22:45:57.212 INFO:teuthology.orchestra.run.smithi177.stdout:1539 write 0x713232d thru 0x713eff9 (0xcccd bytes) 2019-12-16T22:45:57.222 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.222 INFO:teuthology.orchestra.run.smithi177.stdout:1983 writesame 0xb3520b4 thru 0xb35a1ca data_size 0x1(0x8117 bytes) 2019-12-16T22:45:57.233 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.233 INFO:teuthology.orchestra.run.smithi177.stdout:1996 read 0xbd85bf4 thru 0xbd8b0bc (0x54c9 bytes) 2019-12-16T22:45:57.233 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.233 INFO:teuthology.orchestra.run.smithi177.stdout:1999 writesame 0x65ae53e thru 0x65b9bc0 data_size 0x1(0xb683 bytes) 2019-12-16T22:45:57.235 INFO:teuthology.orchestra.run.smithi177.stdout:1886 read 0x7097658 thru 0x709a0d0 (0x2a79 bytes) 2019-12-16T22:45:57.236 INFO:teuthology.orchestra.run.smithi177.stdout:1887 read 0xa63d822 thru 0xa640283 (0x2a62 bytes) 2019-12-16T22:45:57.236 INFO:teuthology.orchestra.run.smithi177.stdout:1888 read 0xa75374c thru 0xa75e8c0 (0xb175 bytes) 2019-12-16T22:45:57.236 INFO:teuthology.orchestra.run.smithi177.stdout:1541 read 0x6cff4e6 thru 0x6d0704f (0x7b6a bytes) 2019-12-16T22:45:57.236 INFO:teuthology.orchestra.run.smithi177.stdout:1542 punch from 0x9aa1558 to 0x9aa60f9, (0x4ba1 bytes) 2019-12-16T22:45:57.249 INFO:teuthology.orchestra.run.smithi177.stdout:1546 trunc from 0xd9766f8 to 0x7176cca 2019-12-16T22:45:57.254 INFO:teuthology.orchestra.run.smithi177.stdout:1889 trunc from 0xab66179 to 0x627a87 2019-12-16T22:45:57.259 INFO:teuthology.orchestra.run.smithi177.stdout:1985 read 0x8b277d2 thru 0x8b2a19e (0x29cd bytes) 2019-12-16T22:45:57.260 INFO:teuthology.orchestra.run.smithi177.stdout:1986 write 0x63c69ef thru 0x63cd9e7 (0x6ff9 bytes) 2019-12-16T22:45:57.280 INFO:teuthology.orchestra.run.smithi177.stdout:1988 read 0x71c6a4f thru 0x71d2963 (0xbf15 bytes) 2019-12-16T22:45:57.280 INFO:teuthology.orchestra.run.smithi177.stdout:1989 read 0x9e05f48 thru 0x9e10351 (0xa40a bytes) 2019-12-16T22:45:57.281 INFO:teuthology.orchestra.run.smithi177.stdout:1990 write 0xa9f6c9 thru 0xaaab43 (0xb47b bytes) 2019-12-16T22:45:57.290 INFO:teuthology.orchestra.run.smithi177.stdout:1992 read 0xba05425 thru 0xba14f6c (0xfb48 bytes) 2019-12-16T22:45:57.290 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.291 INFO:teuthology.orchestra.run.smithi177.stdout:1994 write 0xb126837 thru 0xb135956 (0xf120 bytes) 2019-12-16T22:45:57.327 INFO:teuthology.orchestra.run.smithi177.stdout:2000 write 0x8e44a23 thru 0x8e51b19 (0xd0f7 bytes) 2019-12-16T22:45:57.329 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.329 INFO:teuthology.orchestra.run.smithi177.stdout:1997 writesame 0x6ad48a2 thru 0x6addc9d data_size 0x9a(0x93fc bytes) 2019-12-16T22:45:57.347 INFO:teuthology.orchestra.run.smithi177.stdout:2001 write 0x2a6c547 thru 0x2a6f416 (0x2ed0 bytes) 2019-12-16T22:45:57.351 INFO:teuthology.orchestra.run.smithi177.stdout:1547 read 0x3a1e87c thru 0x3a23e69 (0x55ee bytes) 2019-12-16T22:45:57.352 INFO:teuthology.orchestra.run.smithi177.stdout:1551 writesame 0x1394e83 thru 0x139cae1 data_size 0x1(0x7c5f bytes) 2019-12-16T22:45:57.360 INFO:teuthology.orchestra.run.smithi177.stdout:2001 read 0x36d97ad thru 0x36e45b7 (0xae0b bytes) 2019-12-16T22:45:57.360 INFO:teuthology.orchestra.run.smithi177.stdout:2002 read 0x3b44eda thru 0x3b48496 (0x35bd bytes) 2019-12-16T22:45:57.360 INFO:teuthology.orchestra.run.smithi177.stdout:2002 read 0x10bc111 thru 0x10c9643 (0xd533 bytes) 2019-12-16T22:45:57.360 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.360 INFO:teuthology.orchestra.run.smithi177.stdout:2005 read 0x648b6bc thru 0x649768e (0xbfd3 bytes) 2019-12-16T22:45:57.361 INFO:teuthology.orchestra.run.smithi177.stdout:2006 read 0x7a6fa75 thru 0x7a73b7f (0x410b bytes) 2019-12-16T22:45:57.365 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.365 INFO:teuthology.orchestra.run.smithi177.stdout:2009 punch from 0x1c7a0db to 0x1c7eaee, (0x4a13 bytes) 2019-12-16T22:45:57.366 INFO:teuthology.orchestra.run.smithi177.stdout:2010 clone 15 order 19 su 65536 sc 3 2019-12-16T22:45:57.377 INFO:teuthology.orchestra.run.smithi177.stdout:1554 punch from 0x2bfa693 to 0x2c049a8, (0xa315 bytes) 2019-12-16T22:45:57.377 INFO:teuthology.orchestra.run.smithi177.stdout:1555 clone 14 order 19 su 8192 sc 11 2019-12-16T22:45:57.394 INFO:teuthology.orchestra.run.smithi177.stdout:2003 write 0xdca6731 thru 0xdcb0a02 (0xa2d2 bytes) 2019-12-16T22:45:57.400 INFO:teuthology.orchestra.run.smithi177.stdout:1890 read 0x55d326 thru 0x568f59 (0xbc34 bytes) 2019-12-16T22:45:57.401 INFO:teuthology.orchestra.run.smithi177.stdout:1891 read 0x2ee144 thru 0x2f67e7 (0x86a4 bytes) 2019-12-16T22:45:57.407 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone15 from 0xd6b0b2d (overlap 0x32a446) to 0x1441b5 2019-12-16T22:45:57.412 INFO:teuthology.orchestra.run.smithi177.stdout:2004 read 0xa6cf4a0 thru 0xa6d5dc4 (0x6925 bytes) 2019-12-16T22:45:57.413 INFO:teuthology.orchestra.run.smithi177.stdout:2005 punch from 0x77e0557 to 0x77edbe8, (0xd691 bytes) 2019-12-16T22:45:57.413 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.436 INFO:teuthology.orchestra.run.smithi177.stdout:2007 write 0xdcd35f3 thru 0xdcdd12e (0x9b3c bytes) 2019-12-16T22:45:57.436 INFO:teuthology.orchestra.run.smithi177.stdout:1892 writesame 0x5296d2d thru 0x529e878 data_size 0x1a(0x7b4c bytes) 2019-12-16T22:45:57.451 INFO:teuthology.orchestra.run.smithi177.stdout:2008 write 0xa72f05e thru 0xa73529f (0x6242 bytes) 2019-12-16T22:45:57.469 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #12, image image_cluster1.client.mirror.1-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent13 2019-12-16T22:45:57.477 INFO:teuthology.orchestra.run.smithi177.stdout:1893 write 0x64edb75 thru 0x64eea0d (0xe99 bytes) 2019-12-16T22:45:57.479 INFO:teuthology.orchestra.run.smithi177.stdout:2009 trunc from 0xdcdd12f to 0xb4307e6 2019-12-16T22:45:57.480 INFO:teuthology.orchestra.run.smithi177.stdout:1894 read 0x5ec0631 thru 0x5ecc556 (0xbf26 bytes) 2019-12-16T22:45:57.507 INFO:teuthology.orchestra.run.smithi177.stdout:1895 write 0x9e0de48 thru 0x9e10341 (0x24fa bytes) 2019-12-16T22:45:57.509 INFO:teuthology.orchestra.run.smithi177.stdout:2011 write 0xa5a4166 thru 0xa5a762b (0x34c6 bytes) 2019-12-16T22:45:57.514 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.515 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.515 INFO:teuthology.orchestra.run.smithi177.stdout:2016 read 0xaf566e0 thru 0xaf5c5b3 (0x5ed4 bytes) 2019-12-16T22:45:57.515 INFO:teuthology.orchestra.run.smithi177.stdout:2017 write 0xc16874 thru 0xc18ecc (0x2659 bytes) 2019-12-16T22:45:57.516 INFO:teuthology.orchestra.run.smithi177.stdout:1899 write 0x83f1f3a thru 0x840115f (0xf226 bytes) 2019-12-16T22:45:57.550 INFO:teuthology.orchestra.run.smithi177.stdout:1900 punch from 0x94166cf to 0x9416c40, (0x571 bytes) 2019-12-16T22:45:57.551 INFO:teuthology.orchestra.run.smithi177.stdout:1901 write 0x9b7b1c4 thru 0x9b814b4 (0x62f1 bytes) 2019-12-16T22:45:57.596 INFO:teuthology.orchestra.run.smithi177.stdout:2020 write 0xe3b047c thru 0xe3b5b82 (0x5707 bytes) 2019-12-16T22:45:57.608 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.612 INFO:teuthology.orchestra.run.smithi177.stdout:1902 write 0xd53b333 thru 0xd54101f (0x5ced bytes) 2019-12-16T22:45:57.629 INFO:teuthology.orchestra.run.smithi177.stdout:2022 trunc from 0xe3b5b83 to 0x158284f 2019-12-16T22:45:57.641 INFO:teuthology.orchestra.run.smithi177.stdout:1903 trunc from 0xd541020 to 0x2ff3209 2019-12-16T22:45:57.697 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #14, image image_cluster1.client.mirror.3-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent15 2019-12-16T22:45:57.822 INFO:teuthology.orchestra.run.smithi177.stdout:1904 writesame 0x197a4d9 thru 0x1982ff0 data_size 0x4(0x8b18 bytes) 2019-12-16T22:45:57.887 INFO:teuthology.orchestra.run.smithi177.stdout:1905 trunc from 0x2ff3209 to 0xb576b79 2019-12-16T22:45:57.907 INFO:teuthology.orchestra.run.smithi177.stdout:1907 write 0x2dea9 thru 0x3dc34 (0xfd8c bytes) 2019-12-16T22:45:57.917 INFO:teuthology.orchestra.run.smithi177.stdout:1910 read 0x2c8115d thru 0x2c862e2 (0x5186 bytes) 2019-12-16T22:45:57.918 INFO:teuthology.orchestra.run.smithi177.stdout:1911 trunc from 0xb576b79 to 0xc47feec 2019-12-16T22:45:57.926 INFO:teuthology.orchestra.run.smithi177.stdout:2025 writesame 0x175e0a4 thru 0x176cf95 data_size 0xf(0xeef2 bytes) 2019-12-16T22:45:57.933 INFO:teuthology.orchestra.run.smithi177.stdout:1913 read 0x9184dd1 thru 0x9186cb2 (0x1ee2 bytes) 2019-12-16T22:45:57.933 INFO:teuthology.orchestra.run.smithi177.stdout:1915 write 0x9def77e thru 0x9df14c1 (0x1d44 bytes) 2019-12-16T22:45:57.938 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.938 INFO:teuthology.orchestra.run.smithi177.stdout:2416 write 0x3c5e0d5 thru 0x3c6c0e3 (0xe00f bytes) 2019-12-16T22:45:57.942 INFO:teuthology.orchestra.run.smithi177.stdout:1916 write 0x1f2314f thru 0x1f31ef2 (0xeda4 bytes) 2019-12-16T22:45:57.950 INFO:teuthology.orchestra.run.smithi177.stdout:2027 trunc from 0x176cf96 to 0xeb8f2dd 2019-12-16T22:45:57.963 INFO:teuthology.orchestra.run.smithi177.stdout:1918 writesame 0x406369 thru 0x413829 data_size 0x5(0xd4c1 bytes) 2019-12-16T22:45:57.963 INFO:teuthology.orchestra.run.smithi177.stdout:2417 read 0xb573657 thru 0xb5775bf (0x3f69 bytes) 2019-12-16T22:45:57.964 INFO:teuthology.orchestra.run.smithi177.stdout:2418 punch from 0x18f89ea to 0x1908528, (0xfb3e bytes) 2019-12-16T22:45:57.964 INFO:teuthology.orchestra.run.smithi177.stdout:2420 writesame 0xdb55f49 thru 0xdb635d5 data_size 0x41(0xd68d bytes) 2019-12-16T22:45:57.974 INFO:teuthology.orchestra.run.smithi177.stdout:1807 trunc from 0xd6b0b2d to 0x13db416 2019-12-16T22:45:57.989 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.990 INFO:teuthology.orchestra.run.smithi177.stdout:1921 read 0x9848a1c thru 0x9850e3d (0x8422 bytes) 2019-12-16T22:45:57.990 INFO:teuthology.orchestra.run.smithi177.stdout:1923 read 0x56e2174 thru 0x56f04de (0xe36b bytes) 2019-12-16T22:45:57.990 INFO:teuthology.orchestra.run.smithi177.stdout:1924 read 0x71300a1 thru 0x713ab15 (0xaa75 bytes) 2019-12-16T22:45:57.990 INFO:teuthology.orchestra.run.smithi177.stdout:1925 read 0x81016fe thru 0x810f8b2 (0xe1b5 bytes) 2019-12-16T22:45:57.990 INFO:teuthology.orchestra.run.smithi177.stdout:1927 punch from 0xf6bbdf to 0xf72232, (0x6653 bytes) 2019-12-16T22:45:57.990 INFO:teuthology.orchestra.run.smithi177.stdout:1928 read 0x49da3c5 thru 0x49e1660 (0x729c bytes) 2019-12-16T22:45:57.991 INFO:teuthology.orchestra.run.smithi177.stdout:1930 punch from 0x2b81ef8 to 0x2b89b21, (0x7c29 bytes) 2019-12-16T22:45:57.991 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:57.991 INFO:teuthology.orchestra.run.smithi177.stdout:1932 punch from 0x67af0b to 0x68a1d2, (0xf2c7 bytes) 2019-12-16T22:45:57.991 INFO:teuthology.orchestra.run.smithi177.stdout:1933 write 0x18fc3a7 thru 0x1904015 (0x7c6f bytes) 2019-12-16T22:45:58.005 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.005 INFO:teuthology.orchestra.run.smithi177.stdout:2029 punch from 0x1645f9c to 0x16542a3, (0xe307 bytes) 2019-12-16T22:45:58.005 INFO:teuthology.orchestra.run.smithi177.stdout:2030 writesame 0x35abed9 thru 0x35bb790 data_size 0x54(0xf8b8 bytes) 2019-12-16T22:45:58.013 INFO:teuthology.orchestra.run.smithi177.stdout:2421 trunc from 0xe2557fc to 0x1f31f47 2019-12-16T22:45:58.017 INFO:teuthology.orchestra.run.smithi177.stdout:1934 trunc from 0xc47feec to 0xd82645e 2019-12-16T22:45:58.068 INFO:teuthology.orchestra.run.smithi177.stdout:2031 read 0x67df8fa thru 0x67e2009 (0x2710 bytes) 2019-12-16T22:45:58.069 INFO:teuthology.orchestra.run.smithi177.stdout:2034 read 0xcbbdb6a thru 0xcbc3032 (0x54c9 bytes) 2019-12-16T22:45:58.074 INFO:teuthology.orchestra.run.smithi177.stdout:1935 write 0xd564b9 thru 0xd5e8cb (0x8413 bytes) 2019-12-16T22:45:58.078 INFO:teuthology.orchestra.run.smithi177.stdout:2037 trunc from 0xeb8f2dd to 0x94039df 2019-12-16T22:45:58.102 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.106 INFO:teuthology.orchestra.run.smithi177.stdout:1936 punch from 0xaf5bba6 to 0xaf65911, (0x9d6b bytes) 2019-12-16T22:45:58.107 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.107 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.107 INFO:teuthology.orchestra.run.smithi177.stdout:1939 writesame 0x1c1b4cf thru 0x1c2373d data_size 0x1(0x826f bytes) 2019-12-16T22:45:58.126 INFO:teuthology.orchestra.run.smithi177.stdout:1940 punch from 0x3dbd89d to 0x3dbe011, (0x774 bytes) 2019-12-16T22:45:58.127 INFO:teuthology.orchestra.run.smithi177.stdout:1941 clone 20 order 25 su 16777216 sc 13 2019-12-16T22:45:58.131 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.131 INFO:teuthology.orchestra.run.smithi177.stdout:2040 write 0x31f000 thru 0x3258a1 (0x68a2 bytes) 2019-12-16T22:45:58.143 INFO:teuthology.orchestra.run.smithi177.stdout:2041 read 0x903053 thru 0x906f30 (0x3ede bytes) 2019-12-16T22:45:58.144 INFO:teuthology.orchestra.run.smithi177.stdout:2042 read 0x5f334af thru 0x5f412d6 (0xde28 bytes) 2019-12-16T22:45:58.146 INFO:teuthology.orchestra.run.smithi177.stdout:1811 write 0x2abeb92 thru 0x2abeea1 (0x310 bytes) 2019-12-16T22:45:58.171 INFO:teuthology.orchestra.run.smithi177.stdout:2422 write 0x4e63436 thru 0x4e662f2 (0x2ebd bytes) 2019-12-16T22:45:58.178 INFO:teuthology.orchestra.run.smithi177.stdout:1812 writesame 0x4f89a4a thru 0x4f8ef6f data_size 0x15(0x5526 bytes) 2019-12-16T22:45:58.180 INFO:teuthology.orchestra.run.smithi177.stdout:1813 write 0x3562e36 thru 0x356675c (0x3927 bytes) 2019-12-16T22:45:58.188 INFO:teuthology.orchestra.run.smithi177.stdout:2044 write 0xe699a63 thru 0xe69bc61 (0x21ff bytes) 2019-12-16T22:45:58.192 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.4-clone14 intact 2019-12-16T22:45:58.203 INFO:teuthology.orchestra.run.smithi177.stdout:2423 write 0x701d18e thru 0x7024f3b (0x7dae bytes) 2019-12-16T22:45:58.215 INFO:teuthology.orchestra.run.smithi177.stdout:2424 read 0x1c1615d thru 0x1c1624a (0xee bytes) 2019-12-16T22:45:58.216 INFO:teuthology.orchestra.run.smithi177.stdout:2425 write 0x468b9b0 thru 0x468ea65 (0x30b6 bytes) 2019-12-16T22:45:58.220 INFO:teuthology.orchestra.run.smithi177.stdout:1814 write 0xb8a5cd5 thru 0xb8acd65 (0x7091 bytes) 2019-12-16T22:45:58.223 INFO:teuthology.orchestra.run.smithi177.stdout:2045 write 0xeb0bee4 thru 0xeb1a202 (0xe31f bytes) 2019-12-16T22:45:58.228 INFO:teuthology.orchestra.run.smithi177.stdout:2427 trunc from 0x7024f3c to 0x885eaad 2019-12-16T22:45:58.256 INFO:teuthology.orchestra.run.smithi177.stdout:2046 read 0x3c91cc3 thru 0x3ca18e5 (0xfc23 bytes) 2019-12-16T22:45:58.258 INFO:teuthology.orchestra.run.smithi177.stdout:2047 read 0x11415ab thru 0x114767d (0x60d3 bytes) 2019-12-16T22:45:58.259 INFO:teuthology.orchestra.run.smithi177.stdout:2051 write 0x9761e89 thru 0x976785c (0x59d4 bytes) 2019-12-16T22:45:58.264 INFO:teuthology.orchestra.run.smithi177.stdout:1815 writesame 0xd9aec69 thru 0xd9b3759 data_size 0x5(0x4af1 bytes) 2019-12-16T22:45:58.265 INFO:teuthology.orchestra.run.smithi177.stdout:1816 read 0x8492b17 thru 0x8499665 (0x6b4f bytes) 2019-12-16T22:45:58.265 INFO:teuthology.orchestra.run.smithi177.stdout:1817 punch from 0x6bf83c7 to 0x6c07880, (0xf4b9 bytes) 2019-12-16T22:45:58.265 INFO:teuthology.orchestra.run.smithi177.stdout:1818 writesame 0xe43626 thru 0xe5315b data_size 0x3b(0xfb36 bytes) 2019-12-16T22:45:58.270 INFO:teuthology.orchestra.run.smithi177.stdout:2428 trunc from 0x885eaad to 0xe30b698 2019-12-16T22:45:58.276 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.279 INFO:teuthology.orchestra.run.smithi177.stdout:2053 trunc from 0xeb1a203 to 0xc102af0 2019-12-16T22:45:58.291 INFO:teuthology.orchestra.run.smithi177.stdout:1819 trunc from 0xd9b375a to 0x32b84a6 2019-12-16T22:45:58.295 INFO:teuthology.orchestra.run.smithi177.stdout:2429 write 0xc7213b4 thru 0xc72f1f0 (0xde3d bytes) 2019-12-16T22:45:58.317 INFO:teuthology.orchestra.run.smithi177.stdout:2430 write 0x19b2311 thru 0x19bebfe (0xc8ee bytes) 2019-12-16T22:45:58.317 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #12, image image_cluster1.client.mirror.2-clone12 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent13 2019-12-16T22:45:58.341 INFO:teuthology.orchestra.run.smithi177.stdout:2431 trunc from 0xe30b698 to 0x5ec4424 2019-12-16T22:45:58.342 INFO:teuthology.orchestra.run.smithi177.stdout:2055 write 0x75a3b69 thru 0x75ac91d (0x8db5 bytes) 2019-12-16T22:45:58.345 INFO:teuthology.orchestra.run.smithi177.stdout:1820 punch from 0x1e4d34d to 0x1e5632d, (0x8fe0 bytes) 2019-12-16T22:45:58.346 INFO:teuthology.orchestra.run.smithi177.stdout:1821 read 0x1c701a2 thru 0x1c7671e (0x657d bytes) 2019-12-16T22:45:58.346 INFO:teuthology.orchestra.run.smithi177.stdout:1822 read 0x2ac392e thru 0x2ac655b (0x2c2e bytes) 2019-12-16T22:45:58.350 INFO:teuthology.orchestra.run.smithi177.stdout:1823 trunc from 0x32b84a6 to 0x3a7b23e 2019-12-16T22:45:58.373 INFO:teuthology.orchestra.run.smithi177.stdout:2056 trunc from 0xc102af0 to 0xd66dcd2 2019-12-16T22:45:58.388 INFO:teuthology.orchestra.run.smithi177.stdout:1824 trunc from 0x3a7b23e to 0xc5e58fa 2019-12-16T22:45:58.389 INFO:teuthology.orchestra.run.smithi177.stdout:2432 trunc from 0x5ec4424 to 0x213406f 2019-12-16T22:45:58.391 INFO:teuthology.orchestra.run.smithi177.stdout:2057 write 0x7b487e7 thru 0x7b4c085 (0x389f bytes) 2019-12-16T22:45:58.407 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #13, image image_cluster1.client.mirror.4-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent14 2019-12-16T22:45:58.410 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.410 INFO:teuthology.orchestra.run.smithi177.stdout:1826 punch from 0x28ef9c6 to 0x28fd070, (0xd6aa bytes) 2019-12-16T22:45:58.411 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.411 INFO:teuthology.orchestra.run.smithi177.stdout:1828 read 0x7769ddc thru 0x776f289 (0x54ae bytes) 2019-12-16T22:45:58.411 INFO:teuthology.orchestra.run.smithi177.stdout:1829 read 0x2e5794e thru 0x2e5e9c3 (0x7076 bytes) 2019-12-16T22:45:58.412 INFO:teuthology.orchestra.run.smithi177.stdout:2058 read 0x38e2dd3 thru 0x38e8199 (0x53c7 bytes) 2019-12-16T22:45:58.413 INFO:teuthology.orchestra.run.smithi177.stdout:1556 read 0xf438bc thru 0xf480b8 (0x47fd bytes) 2019-12-16T22:45:58.427 INFO:teuthology.orchestra.run.smithi177.stdout:2059 writesame 0xd3cb9a6 thru 0xd3cfb78 data_size 0x3(0x41d3 bytes) 2019-12-16T22:45:58.428 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.435 INFO:teuthology.orchestra.run.smithi177.stdout:1831 trunc from 0xc5e58fa to 0x6201d37 2019-12-16T22:45:58.438 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.438 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.438 INFO:teuthology.orchestra.run.smithi177.stdout:2064 read 0x763e0b8 thru 0x764bbcd (0xdb16 bytes) 2019-12-16T22:45:58.439 INFO:teuthology.orchestra.run.smithi177.stdout:2065 punch from 0x5d177b7 to 0x5d20537, (0x8d80 bytes) 2019-12-16T22:45:58.441 INFO:teuthology.orchestra.run.smithi177.stdout:1557 trunc from 0x7176cca to 0x6945eb 2019-12-16T22:45:58.451 INFO:teuthology.orchestra.run.smithi177.stdout:2066 trunc from 0xd66dcd2 to 0x5e55db0 2019-12-16T22:45:58.469 INFO:teuthology.orchestra.run.smithi177.stdout:2436 writesame 0x34bdaf4 thru 0x34cb5a1 data_size 0x17(0xdaae bytes) 2019-12-16T22:45:58.472 INFO:teuthology.orchestra.run.smithi177.stdout:1832 write 0x34dbe3f thru 0x34e46e4 (0x88a6 bytes) 2019-12-16T22:45:58.498 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.498 INFO:teuthology.orchestra.run.smithi177.stdout:1835 punch from 0x5fe420d to 0x5fedb05, (0x98f8 bytes) 2019-12-16T22:45:58.515 INFO:teuthology.orchestra.run.smithi177.stdout:1836 trunc from 0x6201d37 to 0xd079489 2019-12-16T22:45:58.517 INFO:teuthology.orchestra.run.smithi177.stdout:2012 punch from 0x148b41b to 0x14973ef, (0xbfd4 bytes) 2019-12-16T22:45:58.518 INFO:teuthology.orchestra.run.smithi177.stdout:2068 read 0x1707564 thru 0x170d99b (0x6438 bytes) 2019-12-16T22:45:58.534 INFO:teuthology.orchestra.run.smithi177.stdout:2014 write 0x3a1e316 thru 0x3a29ecc (0xbbb7 bytes) 2019-12-16T22:45:58.537 INFO:teuthology.orchestra.run.smithi177.stdout:2437 write 0xa7e3b91 thru 0xa7edc3a (0xa0aa bytes) 2019-12-16T22:45:58.545 INFO:teuthology.orchestra.run.smithi177.stdout:1837 write 0x428bff0 thru 0x429b7d7 (0xf7e8 bytes) 2019-12-16T22:45:58.557 INFO:teuthology.orchestra.run.smithi177.stdout:1559 punch from 0x50d730 to 0x51c182, (0xea52 bytes) 2019-12-16T22:45:58.557 INFO:teuthology.orchestra.run.smithi177.stdout:1560 write 0x2a2707 thru 0x2b1dc8 (0xf6c2 bytes) 2019-12-16T22:45:58.557 INFO:teuthology.orchestra.run.smithi177.stdout:2438 write 0x3ec97df thru 0x3ed2ee2 (0x9704 bytes) 2019-12-16T22:45:58.562 INFO:teuthology.orchestra.run.smithi177.stdout:1838 write 0x73ed265 thru 0x73f3d75 (0x6b11 bytes) 2019-12-16T22:45:58.564 INFO:teuthology.orchestra.run.smithi177.stdout:2072 writesame 0xd778c64 thru 0xd7887b5 data_size 0x3(0xfb52 bytes) 2019-12-16T22:45:58.568 INFO:teuthology.orchestra.run.smithi177.stdout:2073 write 0x83d5ba4 thru 0x83e3d1d (0xe17a bytes) 2019-12-16T22:45:58.573 INFO:teuthology.orchestra.run.smithi177.stdout:2439 write 0x2a7fd4e thru 0x2a8f612 (0xf8c5 bytes) 2019-12-16T22:45:58.591 INFO:teuthology.orchestra.run.smithi177.stdout:1839 writesame 0x25329e1 thru 0x25398e7 data_size 0x1(0x6f07 bytes) 2019-12-16T22:45:58.625 INFO:teuthology.orchestra.run.smithi177.stdout:1840 write 0x61b0ced thru 0x61bfb58 (0xee6c bytes) 2019-12-16T22:45:58.649 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.652 INFO:teuthology.orchestra.run.smithi177.stdout:2074 write 0x379e5a6 thru 0x37a6fae (0x8a09 bytes) 2019-12-16T22:45:58.652 INFO:teuthology.orchestra.run.smithi177.stdout:2015 write 0xd12a3d7 thru 0xd138c30 (0xe85a bytes) 2019-12-16T22:45:58.652 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.662 INFO:teuthology.orchestra.run.smithi177.stdout:2440 write 0xb5a2b42 thru 0xb5b111c (0xe5db bytes) 2019-12-16T22:45:58.675 INFO:teuthology.orchestra.run.smithi177.stdout:1842 trunc from 0xd079489 to 0xedd300 2019-12-16T22:45:58.675 INFO:teuthology.orchestra.run.smithi177.stdout:2016 read 0x759126c thru 0x759a151 (0x8ee6 bytes) 2019-12-16T22:45:58.675 INFO:teuthology.orchestra.run.smithi177.stdout:2017 writesame 0x1d9134d thru 0x1da0118 data_size 0xb2(0xedcc bytes) 2019-12-16T22:45:58.678 INFO:teuthology.orchestra.run.smithi177.stdout:2078 write 0x8fd722f thru 0x8fe3e0e (0xcbe0 bytes) 2019-12-16T22:45:58.680 INFO:teuthology.orchestra.run.smithi177.stdout:2442 read 0x15e0476 thru 0x15e1890 (0x141b bytes) 2019-12-16T22:45:58.695 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.695 INFO:teuthology.orchestra.run.smithi177.stdout:2019 write 0x2e12af6 thru 0x2e175f4 (0x4aff bytes) 2019-12-16T22:45:58.711 INFO:teuthology.orchestra.run.smithi177.stdout:2020 read 0x597497d thru 0x597832f (0x39b3 bytes) 2019-12-16T22:45:58.711 INFO:teuthology.orchestra.run.smithi177.stdout:2021 read 0xc2a622c thru 0xc2af9ff (0x97d4 bytes) 2019-12-16T22:45:58.711 INFO:teuthology.orchestra.run.smithi177.stdout:2022 writesame 0x2a7e8dc thru 0x2a80236 data_size 0x1(0x195b bytes) 2019-12-16T22:45:58.711 INFO:teuthology.orchestra.run.smithi177.stdout:1565 writesame 0xc909527 thru 0xc9107f2 data_size 0x1f(0x72cc bytes) 2019-12-16T22:45:58.715 INFO:teuthology.orchestra.run.smithi177.stdout:1566 writesame 0x61178d4 thru 0x6121a3b data_size 0x14(0xa168 bytes) 2019-12-16T22:45:58.718 INFO:teuthology.orchestra.run.smithi177.stdout:2080 read 0x724047a thru 0x724a6b4 (0xa23b bytes) 2019-12-16T22:45:58.718 INFO:teuthology.orchestra.run.smithi177.stdout:2443 write 0xdcf7ec9 thru 0xdd00bca (0x8d02 bytes) 2019-12-16T22:45:58.719 INFO:teuthology.orchestra.run.smithi177.stdout:2081 write 0x1ec801b thru 0x1ed55c5 (0xd5ab bytes) 2019-12-16T22:45:58.729 INFO:teuthology.orchestra.run.smithi177.stdout:2023 writesame 0xbfdc8a4 thru 0xbfe0af2 data_size 0x23(0x424f bytes) 2019-12-16T22:45:58.734 INFO:teuthology.orchestra.run.smithi177.stdout:2445 write 0x1e0ec52 thru 0x1e1078d (0x1b3c bytes) 2019-12-16T22:45:58.749 INFO:teuthology.orchestra.run.smithi177.stdout:2446 read 0xb79ac48 thru 0xb79d876 (0x2c2f bytes) 2019-12-16T22:45:58.750 INFO:teuthology.orchestra.run.smithi177.stdout:2448 read 0xadcae9f thru 0xadcd07e (0x21e0 bytes) 2019-12-16T22:45:58.750 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.754 INFO:teuthology.orchestra.run.smithi177.stdout:2450 trunc from 0xdd00bcb to 0xe8f11fb 2019-12-16T22:45:58.754 INFO:teuthology.orchestra.run.smithi177.stdout:2024 writesame 0xb70e5da thru 0xb71af7b data_size 0x15(0xc9a2 bytes) 2019-12-16T22:45:58.754 INFO:teuthology.orchestra.run.smithi177.stdout:1567 writesame 0xb9cc78f thru 0xb9d7d55 data_size 0x29(0xb5c7 bytes) 2019-12-16T22:45:58.763 INFO:teuthology.orchestra.run.smithi177.stdout:2082 read 0x3a9805c thru 0x3aa5814 (0xd7b9 bytes) 2019-12-16T22:45:58.763 INFO:teuthology.orchestra.run.smithi177.stdout:2083 write 0x99f975d thru 0x9a0701b (0xd8bf bytes) 2019-12-16T22:45:58.777 INFO:teuthology.orchestra.run.smithi177.stdout:1843 write 0x44f20a8 thru 0x45008fa (0xe853 bytes) 2019-12-16T22:45:58.777 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.778 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.778 INFO:teuthology.orchestra.run.smithi177.stdout:2030 write 0x1d87758 thru 0x1d91434 (0x9cdd bytes) 2019-12-16T22:45:58.784 INFO:teuthology.orchestra.run.smithi177.stdout:1568 read 0x86f16ea thru 0x86fcc4a (0xb561 bytes) 2019-12-16T22:45:58.793 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.793 INFO:teuthology.orchestra.run.smithi177.stdout:2033 punch from 0x7deafea to 0x7df25be, (0x75d4 bytes) 2019-12-16T22:45:58.793 INFO:teuthology.orchestra.run.smithi177.stdout:2034 punch from 0x54b60d0 to 0x54c0d0d, (0xac3d bytes) 2019-12-16T22:45:58.793 INFO:teuthology.orchestra.run.smithi177.stdout:2037 write 0x9d34726 thru 0x9d3a4d7 (0x5db2 bytes) 2019-12-16T22:45:58.797 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.797 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.797 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.797 INFO:teuthology.orchestra.run.smithi177.stdout:2088 writesame 0x1a6a588 thru 0x1a72f25 data_size 0x41(0x899e bytes) 2019-12-16T22:45:58.798 INFO:teuthology.orchestra.run.smithi177.stdout:2451 punch from 0x981c2bd to 0x981e9bd, (0x2700 bytes) 2019-12-16T22:45:58.802 INFO:teuthology.orchestra.run.smithi177.stdout:2089 write 0x548b4bc thru 0x54925de (0x7123 bytes) 2019-12-16T22:45:58.803 INFO:teuthology.orchestra.run.smithi177.stdout:1569 trunc from 0xc9107f3 to 0x42426be 2019-12-16T22:45:58.812 INFO:teuthology.orchestra.run.smithi177.stdout:1845 trunc from 0x45008fb to 0xe6e70ee 2019-12-16T22:45:58.825 INFO:teuthology.orchestra.run.smithi177.stdout:2038 trunc from 0xd138c31 to 0x17d75c5 2019-12-16T22:45:58.836 INFO:teuthology.orchestra.run.smithi177.stdout:2452 write 0xeb7bac9 thru 0xeb85302 (0x983a bytes) 2019-12-16T22:45:58.838 INFO:teuthology.orchestra.run.smithi177.stdout:2090 write 0x90a6b2d thru 0x90b35ac (0xca80 bytes) 2019-12-16T22:45:58.849 INFO:teuthology.orchestra.run.smithi177.stdout:2453 read 0x2f0db20 thru 0x2f1098f (0x2e70 bytes) 2019-12-16T22:45:58.857 INFO:teuthology.orchestra.run.smithi177.stdout:1846 read 0x60fe35e thru 0x60fe8e1 (0x584 bytes) 2019-12-16T22:45:58.857 INFO:teuthology.orchestra.run.smithi177.stdout:1847 punch from 0x5254e50 to 0x525bc41, (0x6df1 bytes) 2019-12-16T22:45:58.857 INFO:teuthology.orchestra.run.smithi177.stdout:1848 punch from 0xdde32fb to 0xddea308, (0x700d bytes) 2019-12-16T22:45:58.858 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.858 INFO:teuthology.orchestra.run.smithi177.stdout:1851 read 0x9f391b1 thru 0x9f400f7 (0x6f47 bytes) 2019-12-16T22:45:58.858 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.859 INFO:teuthology.orchestra.run.smithi177.stdout:2454 trunc from 0xeb85303 to 0xb7b8b65 2019-12-16T22:45:58.862 INFO:teuthology.orchestra.run.smithi177.stdout:2091 write 0x8624f5 thru 0x86d68c (0xb198 bytes) 2019-12-16T22:45:58.864 INFO:teuthology.orchestra.run.smithi177.stdout:1571 read 0x33b24ff thru 0x33bb96d (0x946f bytes) 2019-12-16T22:45:58.864 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.879 INFO:teuthology.orchestra.run.smithi177.stdout:2093 read 0x757a6df thru 0x757c2a9 (0x1bcb bytes) 2019-12-16T22:45:58.880 INFO:teuthology.orchestra.run.smithi177.stdout:2094 punch from 0x1153a5b to 0x115d87a, (0x9e1f bytes) 2019-12-16T22:45:58.880 INFO:teuthology.orchestra.run.smithi177.stdout:2095 write 0x495472d thru 0x4961bbd (0xd491 bytes) 2019-12-16T22:45:58.880 INFO:teuthology.orchestra.run.smithi177.stdout:1853 trunc from 0xe6e70ee to 0x2ce131d 2019-12-16T22:45:58.904 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.904 INFO:teuthology.orchestra.run.smithi177.stdout:2097 read 0x842e2b7 thru 0x84341a6 (0x5ef0 bytes) 2019-12-16T22:45:58.905 INFO:teuthology.orchestra.run.smithi177.stdout:2098 write 0x51c9fb8 thru 0x51d3aa1 (0x9aea bytes) 2019-12-16T22:45:58.906 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.907 INFO:teuthology.orchestra.run.smithi177.stdout:2458 write 0x3a75f03 thru 0x3a80a80 (0xab7e bytes) 2019-12-16T22:45:58.909 INFO:teuthology.orchestra.run.smithi177.stdout:1574 write 0xbf7cffc thru 0xbf851e1 (0x81e6 bytes) 2019-12-16T22:45:58.911 INFO:teuthology.orchestra.run.smithi177.stdout:1856 read 0x1e2c074 thru 0x1e384e8 (0xc475 bytes) 2019-12-16T22:45:58.911 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.932 INFO:teuthology.orchestra.run.smithi177.stdout:2039 writesame 0x962ae71 thru 0x963a081 data_size 0x1(0xf211 bytes) 2019-12-16T22:45:58.935 INFO:teuthology.orchestra.run.smithi177.stdout:1575 write 0x7a9b983 thru 0x7a9ff33 (0x45b1 bytes) 2019-12-16T22:45:58.935 INFO:teuthology.orchestra.run.smithi177.stdout:2099 trunc from 0xd7887b6 to 0x607b2eb 2019-12-16T22:45:58.935 INFO:teuthology.orchestra.run.smithi177.stdout:2459 trunc from 0xb7b8b65 to 0x4cbdb7b 2019-12-16T22:45:58.938 INFO:teuthology.orchestra.run.smithi177.stdout:2040 read 0x4463877 thru 0x4470d11 (0xd49b bytes) 2019-12-16T22:45:58.950 INFO:teuthology.orchestra.run.smithi177.stdout:1858 write 0x9d17e32 thru 0x9d1e5fa (0x67c9 bytes) 2019-12-16T22:45:58.951 INFO:teuthology.orchestra.run.smithi177.stdout:1576 read 0x1ad4b32 thru 0x1adeeb0 (0xa37f bytes) 2019-12-16T22:45:58.951 INFO:teuthology.orchestra.run.smithi177.stdout:1577 read 0x1b41101 thru 0x1b4c47f (0xb37f bytes) 2019-12-16T22:45:58.952 INFO:teuthology.orchestra.run.smithi177.stdout:1579 write 0xb7bba30 thru 0xb7c2ffa (0x75cb bytes) 2019-12-16T22:45:58.969 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.969 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:58.980 INFO:teuthology.orchestra.run.smithi177.stdout:2041 writesame 0xe44250d thru 0xe4457ac data_size 0x3c(0x32a0 bytes) 2019-12-16T22:45:58.982 INFO:teuthology.orchestra.run.smithi177.stdout:2460 punch from 0x2f7d8ad to 0x2f7f98b, (0x20de bytes) 2019-12-16T22:45:58.982 INFO:teuthology.orchestra.run.smithi177.stdout:2463 punch from 0x1d9d689 to 0x1da49f6, (0x736d bytes) 2019-12-16T22:45:58.982 INFO:teuthology.orchestra.run.smithi177.stdout:1580 writesame 0x5e7b411 thru 0x5e85ca3 data_size 0x2d(0xa893 bytes) 2019-12-16T22:45:58.986 INFO:teuthology.orchestra.run.smithi177.stdout:2042 trunc from 0xe4457ad to 0xcf55202 2019-12-16T22:45:58.989 INFO:teuthology.orchestra.run.smithi177.stdout:1865 trunc from 0x9d1e5fb to 0x39c13e 2019-12-16T22:45:59.011 INFO:teuthology.orchestra.run.smithi177.stdout:2102 write 0x3a5b7e0 thru 0x3a6822f (0xca50 bytes) 2019-12-16T22:45:59.027 INFO:teuthology.orchestra.run.smithi177.stdout:1581 read 0x77de49c thru 0x77e114e (0x2cb3 bytes) 2019-12-16T22:45:59.027 INFO:teuthology.orchestra.run.smithi177.stdout:1582 writesame 0x15a1a54 thru 0x15aa409 data_size 0x1(0x89b6 bytes) 2019-12-16T22:45:59.027 INFO:teuthology.orchestra.run.smithi177.stdout:2103 punch from 0x310b582 to 0x310fa26, (0x44a4 bytes) 2019-12-16T22:45:59.028 INFO:teuthology.orchestra.run.smithi177.stdout:2104 read 0x591b07b thru 0x5924e50 (0x9dd6 bytes) 2019-12-16T22:45:59.028 INFO:teuthology.orchestra.run.smithi177.stdout:2105 write 0x77dd1f thru 0x78257c (0x485e bytes) 2019-12-16T22:45:59.034 INFO:teuthology.orchestra.run.smithi177.stdout:2043 read 0x7f02cdb thru 0x7f069f4 (0x3d1a bytes) 2019-12-16T22:45:59.034 INFO:teuthology.orchestra.run.smithi177.stdout:2045 read 0x3c44bbe thru 0x3c47167 (0x25aa bytes) 2019-12-16T22:45:59.034 INFO:teuthology.orchestra.run.smithi177.stdout:2046 write 0x3911a3a thru 0x3912591 (0xb58 bytes) 2019-12-16T22:45:59.035 INFO:teuthology.orchestra.run.smithi177.stdout:2464 writesame 0x64e1994 thru 0x64e4b7f data_size 0x5(0x31ec bytes) 2019-12-16T22:45:59.044 INFO:teuthology.orchestra.run.smithi177.stdout:2106 read 0x1148eff thru 0x1153c7d (0xad7f bytes) 2019-12-16T22:45:59.049 INFO:teuthology.orchestra.run.smithi177.stdout:2107 punch from 0x1ba20e6 to 0x1bb1208, (0xf122 bytes) 2019-12-16T22:45:59.055 INFO:teuthology.orchestra.run.smithi177.stdout:2047 read 0x3e1cbb9 thru 0x3e2bff9 (0xf441 bytes) 2019-12-16T22:45:59.055 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.070 INFO:teuthology.orchestra.run.smithi177.stdout:2050 trunc from 0xcf55202 to 0x5ad70a4 2019-12-16T22:45:59.074 INFO:teuthology.orchestra.run.smithi177.stdout:1583 read 0xf2c60b thru 0xf3be2c (0xf822 bytes) 2019-12-16T22:45:59.076 INFO:teuthology.orchestra.run.smithi177.stdout:1586 trunc from 0xbf851e2 to 0xcbde367 2019-12-16T22:45:59.089 INFO:teuthology.orchestra.run.smithi177.stdout:2108 write 0x740e849 thru 0x7412327 (0x3adf bytes) 2019-12-16T22:45:59.089 INFO:teuthology.orchestra.run.smithi177.stdout:1866 punch from 0x350d23 to 0x357a20, (0x6cfd bytes) 2019-12-16T22:45:59.090 INFO:teuthology.orchestra.run.smithi177.stdout:2465 write 0x9a373d7 thru 0x9a38de7 (0x1a11 bytes) 2019-12-16T22:45:59.099 INFO:teuthology.orchestra.run.smithi177.stdout:2466 read 0x9625f6b thru 0x9635975 (0xfa0b bytes) 2019-12-16T22:45:59.099 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.101 INFO:teuthology.orchestra.run.smithi177.stdout:2467 trunc from 0x9a38de8 to 0x7fdb52f 2019-12-16T22:45:59.105 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.105 INFO:teuthology.orchestra.run.smithi177.stdout:1588 read 0x27b079c thru 0x27ba173 (0x99d8 bytes) 2019-12-16T22:45:59.106 INFO:teuthology.orchestra.run.smithi177.stdout:1590 write 0x24a1d3b thru 0x24ae86a (0xcb30 bytes) 2019-12-16T22:45:59.113 INFO:teuthology.orchestra.run.smithi177.stdout:2110 trunc from 0x7412328 to 0xac7568c 2019-12-16T22:45:59.138 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:45:59.130+0000 7f884a7b2700 -1 reset not still connected to 0x56012386c0d0 2019-12-16T22:45:59.138 INFO:teuthology.orchestra.run.smithi177.stdout:1867 write 0x6c7fdf4 thru 0x6c832d2 (0x34df bytes) 2019-12-16T22:45:59.138 INFO:teuthology.orchestra.run.smithi177.stdout:2052 writesame 0x9c91e02 thru 0x9c91fae data_size 0x3(0x1ad bytes) 2019-12-16T22:45:59.141 INFO:teuthology.orchestra.run.smithi177.stdout:1591 writesame 0x51991b1 thru 0x519951e data_size 0x1(0x36e bytes) 2019-12-16T22:45:59.141 INFO:teuthology.orchestra.run.smithi177.stdout:2053 read 0x58221d0 thru 0x582f6ad (0xd4de bytes) 2019-12-16T22:45:59.141 INFO:teuthology.orchestra.run.smithi177.stdout:2054 read 0x3363d6a thru 0x336e062 (0xa2f9 bytes) 2019-12-16T22:45:59.143 INFO:teuthology.orchestra.run.smithi177.stdout:1592 writesame 0x245c400 thru 0x24654a5 data_size 0x2(0x90a6 bytes) 2019-12-16T22:45:59.153 INFO:teuthology.orchestra.run.smithi177.stdout:1593 write 0x2206fd5 thru 0x2207b2b (0xb57 bytes) 2019-12-16T22:45:59.162 INFO:teuthology.orchestra.run.smithi177.stdout:1595 punch from 0x27dc8b4 to 0x27e8971, (0xc0bd bytes) 2019-12-16T22:45:59.162 INFO:teuthology.orchestra.run.smithi177.stdout:2112 trunc from 0xac7568c to 0xde2818 2019-12-16T22:45:59.171 INFO:teuthology.orchestra.run.smithi177.stdout:2469 write 0xeca3297 thru 0xeca33e6 (0x150 bytes) 2019-12-16T22:45:59.176 INFO:teuthology.orchestra.run.smithi177.stdout:1597 trunc from 0xcbde367 to 0x4f0f0a0 2019-12-16T22:45:59.184 INFO:teuthology.orchestra.run.smithi177.stdout:2055 write 0xd9282ec thru 0xd9348db (0xc5f0 bytes) 2019-12-16T22:45:59.185 INFO:teuthology.orchestra.run.smithi177.stdout:1868 write 0x9bd6671 thru 0x9be02b6 (0x9c46 bytes) 2019-12-16T22:45:59.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.194+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574621a2d20 finish: resending after timeout 2019-12-16T22:45:59.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.198+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557461a0dde0 finish: resending after timeout 2019-12-16T22:45:59.202 INFO:teuthology.orchestra.run.smithi177.stdout:2471 write 0x6003c2 thru 0x6029ec (0x262b bytes) 2019-12-16T22:45:59.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.198+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557464a722b0 finish: resending after timeout 2019-12-16T22:45:59.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.198+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557461bb1a40 finish: resending after timeout 2019-12-16T22:45:59.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.198+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557461bb30c0 finish: resending after timeout 2019-12-16T22:45:59.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.198+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574626e3390 finish: resending after timeout 2019-12-16T22:45:59.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.202+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574626e23a0 finish: resending after timeout 2019-12-16T22:45:59.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.202+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557462173930 finish: resending after timeout 2019-12-16T22:45:59.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.202+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557462172a30 finish: resending after timeout 2019-12-16T22:45:59.215 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.215 INFO:teuthology.orchestra.run.smithi177.stdout:2057 writesame 0x8e43db0 thru 0x8e50386 data_size 0x1(0xc5d7 bytes) 2019-12-16T22:45:59.215 INFO:teuthology.orchestra.run.smithi177.stdout:2472 write 0x8804724 thru 0x880f448 (0xad25 bytes) 2019-12-16T22:45:59.215 INFO:teuthology.orchestra.run.smithi177.stdout:1869 trunc from 0x9be02b7 to 0xbd4831c 2019-12-16T22:45:59.255 INFO:teuthology.orchestra.run.smithi177.stdout:2113 punch from 0x99a393 to 0x9a9a4d, (0xf6ba bytes) 2019-12-16T22:45:59.267 INFO:teuthology.orchestra.run.smithi177.stdout:2475 trunc from 0xeca33e7 to 0xc84240e 2019-12-16T22:45:59.269 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.269 INFO:teuthology.orchestra.run.smithi177.stdout:1599 read 0x3f039b4 thru 0x3f071ef (0x383c bytes) 2019-12-16T22:45:59.270 INFO:teuthology.orchestra.run.smithi177.stdout:1600 punch from 0x32d65b3 to 0x32e3206, (0xcc53 bytes) 2019-12-16T22:45:59.270 INFO:teuthology.orchestra.run.smithi177.stdout:1601 write 0x369646a thru 0x36a39c6 (0xd55d bytes) 2019-12-16T22:45:59.276 INFO:teuthology.orchestra.run.smithi177.stdout:1870 punch from 0x8c86ec to 0x8d0077, (0x798b bytes) 2019-12-16T22:45:59.276 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.276 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.277 INFO:teuthology.orchestra.run.smithi177.stdout:1874 read 0x64c8d4 thru 0x654a8f (0x81bc bytes) 2019-12-16T22:45:59.277 INFO:teuthology.orchestra.run.smithi177.stdout:1875 read 0xbb39e19 thru 0xbb4695d (0xcb45 bytes) 2019-12-16T22:45:59.277 INFO:teuthology.orchestra.run.smithi177.stdout:1879 write 0x4ffb0db thru 0x500920c (0xe132 bytes) 2019-12-16T22:45:59.301 INFO:teuthology.orchestra.run.smithi177.stdout:2059 write 0x1f1369 thru 0x1fc47a (0xb112 bytes) 2019-12-16T22:45:59.312 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.312 INFO:teuthology.orchestra.run.smithi177.stdout:1881 write 0x9d2fc15 thru 0x9d36a3a (0x6e26 bytes) 2019-12-16T22:45:59.326 INFO:teuthology.orchestra.run.smithi177.stdout:2115 write 0xe5345c2 thru 0xe53dd73 (0x97b2 bytes) 2019-12-16T22:45:59.326 INFO:teuthology.orchestra.run.smithi177.stdout:1602 write 0x1296676 thru 0x12a14c0 (0xae4b bytes) 2019-12-16T22:45:59.329 INFO:teuthology.orchestra.run.smithi177.stdout:1882 read 0x778b216 thru 0x778db23 (0x290e bytes) 2019-12-16T22:45:59.329 INFO:teuthology.orchestra.run.smithi177.stdout:2060 write 0x4c56c69 thru 0x4c5c8ca (0x5c62 bytes) 2019-12-16T22:45:59.341 INFO:teuthology.orchestra.run.smithi177.stdout:2476 read 0x2b55e2 thru 0x2be954 (0x9373 bytes) 2019-12-16T22:45:59.345 INFO:teuthology.orchestra.run.smithi177.stdout:2477 clone 15 order 18 su 16384 sc 2 2019-12-16T22:45:59.347 INFO:teuthology.orchestra.run.smithi177.stdout:2061 write 0x368b1e9 thru 0x368f7f9 (0x4611 bytes) 2019-12-16T22:45:59.354 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone19 from 0xd82645e (overlap 0x627a87) to 0x4ec86c 2019-12-16T22:45:59.362 INFO:teuthology.orchestra.run.smithi177.stdout:2062 write 0x2250ed0 thru 0x225ad1d (0x9e4e bytes) 2019-12-16T22:45:59.363 INFO:teuthology.orchestra.run.smithi177.stdout:1603 writesame 0xa16b02 thru 0xa1bc95 data_size 0x2e(0x5194 bytes) 2019-12-16T22:45:59.376 INFO:teuthology.orchestra.run.smithi177.stdout:2116 punch from 0x4a9ec49 to 0x4aa785a, (0x8c11 bytes) 2019-12-16T22:45:59.379 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.379 INFO:teuthology.orchestra.run.smithi177.stdout:2064 write 0xb9b852b thru 0xb9c0d45 (0x881b bytes) 2019-12-16T22:45:59.385 INFO:teuthology.orchestra.run.smithi177.stdout:1605 trunc from 0x4f0f0a0 to 0x730dc97 2019-12-16T22:45:59.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:45:59.378+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557464999680 finish: resending after timeout 2019-12-16T22:45:59.386 INFO:teuthology.orchestra.run.smithi177.stdout:1883 write 0xd0fc86e thru 0xd1082dd (0xba70 bytes) 2019-12-16T22:45:59.391 INFO:teuthology.orchestra.run.smithi177.stdout:2117 trunc from 0xe53dd74 to 0x7464a2e 2019-12-16T22:45:59.393 INFO:teuthology.orchestra.run.smithi177.stdout:2066 writesame 0x26c82c1 thru 0x26caa81 data_size 0x1(0x27c1 bytes) 2019-12-16T22:45:59.397 INFO:teuthology.orchestra.run.smithi177.stdout:1884 read 0x7f22050 thru 0x7f29945 (0x78f6 bytes) 2019-12-16T22:45:59.398 INFO:teuthology.orchestra.run.smithi177.stdout:1886 writesame 0x942046 thru 0x943e92 data_size 0x1(0x1e4d bytes) 2019-12-16T22:45:59.409 INFO:teuthology.orchestra.run.smithi177.stdout:2067 read 0x3e9c2e3 thru 0x3eaa067 (0xdd85 bytes) 2019-12-16T22:45:59.409 INFO:teuthology.orchestra.run.smithi177.stdout:2068 write 0xa14d54c thru 0xa155e4e (0x8903 bytes) 2019-12-16T22:45:59.425 INFO:teuthology.orchestra.run.smithi177.stdout:1606 punch from 0x4b19eef to 0x4b1e950, (0x4a61 bytes) 2019-12-16T22:45:59.446 INFO:teuthology.orchestra.run.smithi177.stdout:2119 write 0x256dcc3 thru 0x2575c13 (0x7f51 bytes) 2019-12-16T22:45:59.448 INFO:teuthology.orchestra.run.smithi177.stdout:2069 trunc from 0xd9348dc to 0x5a84fb5 2019-12-16T22:45:59.451 INFO:teuthology.orchestra.run.smithi177.stdout:1887 write 0xea415da thru 0xea4c7db (0xb202 bytes) 2019-12-16T22:45:59.451 INFO:teuthology.orchestra.run.smithi177.stdout:1608 write 0x8d7c96f thru 0x8d832d1 (0x6963 bytes) 2019-12-16T22:45:59.478 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.478 INFO:teuthology.orchestra.run.smithi177.stdout:1889 read 0xc0066e thru 0xc05937 (0x52ca bytes) 2019-12-16T22:45:59.478 INFO:teuthology.orchestra.run.smithi177.stdout:2120 read 0x26deaa6 thru 0x26e3cbb (0x5216 bytes) 2019-12-16T22:45:59.478 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.482 INFO:teuthology.orchestra.run.smithi177.stdout:1609 read 0x3ac86d0 thru 0x3acb7b2 (0x30e3 bytes) 2019-12-16T22:45:59.482 INFO:teuthology.orchestra.run.smithi177.stdout:1610 read 0x16da1c1 thru 0x16dbc35 (0x1a75 bytes) 2019-12-16T22:45:59.482 INFO:teuthology.orchestra.run.smithi177.stdout:1892 trunc from 0xea4c7dc to 0xd15ddd4 2019-12-16T22:45:59.483 INFO:teuthology.orchestra.run.smithi177.stdout:1612 writesame 0x2a45f3d thru 0x2a545cf data_size 0x1(0xe693 bytes) 2019-12-16T22:45:59.494 INFO:teuthology.orchestra.run.smithi177.stdout:2070 read 0x12a3c4 thru 0x12b503 (0x1140 bytes) 2019-12-16T22:45:59.503 INFO:teuthology.orchestra.run.smithi177.stdout:2072 trunc from 0x5a84fb5 to 0x1906337 2019-12-16T22:45:59.517 INFO:teuthology.orchestra.run.smithi177.stdout:2122 write 0xa3b3f5d thru 0xa3bc834 (0x88d8 bytes) 2019-12-16T22:45:59.534 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.534 INFO:teuthology.orchestra.run.smithi177.stdout:1614 writesame 0x878c04f thru 0x8798a70 data_size 0x1(0xca22 bytes) 2019-12-16T22:45:59.545 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.546 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.558 INFO:teuthology.orchestra.run.smithi177.stdout:2124 read 0x4e555aa thru 0x4e649e5 (0xf43c bytes) 2019-12-16T22:45:59.558 INFO:teuthology.orchestra.run.smithi177.stdout:2125 read 0x21a7467 thru 0x21b4fa2 (0xdb3c bytes) 2019-12-16T22:45:59.559 INFO:teuthology.orchestra.run.smithi177.stdout:1893 writesame 0xe02143c thru 0xe026046 data_size 0x3f(0x4c0b bytes) 2019-12-16T22:45:59.561 INFO:teuthology.orchestra.run.smithi177.stdout:1894 write 0x18e5d27 thru 0x18e7a5a (0x1d34 bytes) 2019-12-16T22:45:59.563 INFO:teuthology.orchestra.run.smithi177.stdout:2126 write 0x1721d7a thru 0x1731026 (0xf2ad bytes) 2019-12-16T22:45:59.575 INFO:teuthology.orchestra.run.smithi177.stdout:1615 read 0x3047773 thru 0x304e8bc (0x714a bytes) 2019-12-16T22:45:59.576 INFO:teuthology.orchestra.run.smithi177.stdout:1617 read 0x4e65e5e thru 0x4e73829 (0xd9cc bytes) 2019-12-16T22:45:59.576 INFO:teuthology.orchestra.run.smithi177.stdout:1618 clone 15 order 24 su 2097152 sc 3 2019-12-16T22:45:59.584 INFO:teuthology.orchestra.run.smithi177.stdout:1895 read 0x515c792 thru 0x51640d5 (0x7944 bytes) 2019-12-16T22:45:59.584 INFO:teuthology.orchestra.run.smithi177.stdout:1896 writesame 0x30c5439 thru 0x30cf920 data_size 0xc(0xa4e8 bytes) 2019-12-16T22:45:59.591 INFO:teuthology.orchestra.run.smithi177.stdout:2076 writesame 0x4aac9c4 thru 0x4ab207b data_size 0x1e(0x56b8 bytes) 2019-12-16T22:45:59.593 INFO:teuthology.orchestra.run.smithi177.stdout:2127 punch from 0x66919af to 0x669fcd6, (0xe327 bytes) 2019-12-16T22:45:59.593 INFO:teuthology.orchestra.run.smithi177.stdout:2129 read 0x54fc47b thru 0x550555d (0x90e3 bytes) 2019-12-16T22:45:59.594 INFO:teuthology.orchestra.run.smithi177.stdout:2130 punch from 0x8323d49 to 0x83294f4, (0x57ab bytes) 2019-12-16T22:45:59.594 INFO:teuthology.orchestra.run.smithi177.stdout:2131 writesame 0x5bcb161 thru 0x5bd4ad0 data_size 0x28(0x9970 bytes) 2019-12-16T22:45:59.606 INFO:teuthology.orchestra.run.smithi177.stdout:1898 trunc from 0xe026047 to 0x9362082 2019-12-16T22:45:59.617 INFO:teuthology.orchestra.run.smithi177.stdout:2077 writesame 0x515ef05 thru 0x5169b61 data_size 0x19(0xac5d bytes) 2019-12-16T22:45:59.618 INFO:teuthology.orchestra.run.smithi177.stdout:2132 trunc from 0xa3bc835 to 0xc9f83a5 2019-12-16T22:45:59.641 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.641 INFO:teuthology.orchestra.run.smithi177.stdout:2136 read 0x36778ba thru 0x368516c (0xd8b3 bytes) 2019-12-16T22:45:59.641 INFO:teuthology.orchestra.run.smithi177.stdout:2138 writesame 0x67c6638 thru 0x67c782b data_size 0x6(0x11f4 bytes) 2019-12-16T22:45:59.642 INFO:teuthology.orchestra.run.smithi177.stdout:1899 read 0x3c8151e thru 0x3c90ac0 (0xf5a3 bytes) 2019-12-16T22:45:59.642 INFO:teuthology.orchestra.run.smithi177.stdout:1902 read 0x49afcd3 thru 0x49b0162 (0x490 bytes) 2019-12-16T22:45:59.642 INFO:teuthology.orchestra.run.smithi177.stdout:2078 writesame 0x5a5cb91 thru 0x5a6a358 data_size 0x14(0xd7c8 bytes) 2019-12-16T22:45:59.646 INFO:teuthology.orchestra.run.smithi177.stdout:2140 punch from 0x19021d5 to 0x190dbd7, (0xba02 bytes) 2019-12-16T22:45:59.649 INFO:teuthology.orchestra.run.smithi177.stdout:2141 trunc from 0xc9f83a5 to 0xc42a5d6 2019-12-16T22:45:59.649 INFO:teuthology.orchestra.run.smithi177.stdout:2080 trunc from 0x5a6a359 to 0x360334f 2019-12-16T22:45:59.655 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #18, image image_cluster1.client.mirror.0-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent19 2019-12-16T22:45:59.667 INFO:teuthology.orchestra.run.smithi177.stdout:1903 writesame 0xbc9570e thru 0xbca108e data_size 0xd(0xb981 bytes) 2019-12-16T22:45:59.671 INFO:teuthology.orchestra.run.smithi177.stdout:1904 write 0x24a0dc thru 0x258a27 (0xe94c bytes) 2019-12-16T22:45:59.675 INFO:teuthology.orchestra.run.smithi177.stdout:2081 read 0x2849da thru 0x28e071 (0x9698 bytes) 2019-12-16T22:45:59.675 INFO:teuthology.orchestra.run.smithi177.stdout:2142 read 0xb5fb02b thru 0xb5fde02 (0x2dd8 bytes) 2019-12-16T22:45:59.675 INFO:teuthology.orchestra.run.smithi177.stdout:2143 write 0x65dc7f5 thru 0x65e4b90 (0x839c bytes) 2019-12-16T22:45:59.681 INFO:teuthology.orchestra.run.smithi177.stdout:1905 clone 17 order 23 su 2097152 sc 15 2019-12-16T22:45:59.687 INFO:teuthology.orchestra.run.smithi177.stdout:2145 writesame 0x1d9c7f6 thru 0x1d9fa05 data_size 0x9(0x3210 bytes) 2019-12-16T22:45:59.711 INFO:teuthology.orchestra.run.smithi177.stdout:2146 trunc from 0xc42a5d6 to 0x105f8c9 2019-12-16T22:45:59.719 INFO:teuthology.orchestra.run.smithi177.stdout:2082 write 0x82a4c6c thru 0x82b0b06 (0xbe9b bytes) 2019-12-16T22:45:59.776 INFO:teuthology.orchestra.run.smithi177.stdout:2147 read 0x6c5092 thru 0x6cb720 (0x668f bytes) 2019-12-16T22:45:59.796 INFO:teuthology.orchestra.run.smithi177.stdout:2084 write 0xdd06cec thru 0xdd12f84 (0xc299 bytes) 2019-12-16T22:45:59.796 INFO:teuthology.orchestra.run.smithi177.stdout:2149 writesame 0x1107225 thru 0x1116812 data_size 0x15(0xf5ee bytes) 2019-12-16T22:45:59.802 INFO:teuthology.orchestra.run.smithi177.stdout:2085 read 0x618646e thru 0x618e5a0 (0x8133 bytes) 2019-12-16T22:45:59.819 INFO:teuthology.orchestra.run.smithi177.stdout:2087 trunc from 0xdd12f85 to 0x7598f9d 2019-12-16T22:45:59.832 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.832 INFO:teuthology.orchestra.run.smithi177.stdout:1943 read 0x8198e2f thru 0x81a2bcb (0x9d9d bytes) 2019-12-16T22:45:59.843 INFO:teuthology.orchestra.run.smithi177.stdout:2151 write 0xd637051 thru 0xd6372d1 (0x281 bytes) 2019-12-16T22:45:59.852 INFO:teuthology.orchestra.run.smithi177.stdout:1944 writesame 0x609978b thru 0x60a700c data_size 0x2(0xd882 bytes) 2019-12-16T22:45:59.852 INFO:teuthology.orchestra.run.smithi177.stdout:2153 read 0x8c18018 thru 0x8c1ac58 (0x2c41 bytes) 2019-12-16T22:45:59.852 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.853 INFO:teuthology.orchestra.run.smithi177.stdout:2155 read 0xcc861d8 thru 0xcc8f140 (0x8f69 bytes) 2019-12-16T22:45:59.872 INFO:teuthology.orchestra.run.smithi177.stdout:2156 trunc from 0xd6372d2 to 0x1a67a8f 2019-12-16T22:45:59.875 INFO:teuthology.orchestra.run.smithi177.stdout:1945 read 0x189cbb3 thru 0x18aad56 (0xe1a4 bytes) 2019-12-16T22:45:59.875 INFO:teuthology.orchestra.run.smithi177.stdout:1947 write 0x38e62e6 thru 0x38e7d2d (0x1a48 bytes) 2019-12-16T22:45:59.881 INFO:teuthology.orchestra.run.smithi177.stdout:1948 punch from 0x99b7db1 to 0x99ba2ae, (0x24fd bytes) 2019-12-16T22:45:59.882 INFO:teuthology.orchestra.run.smithi177.stdout:2088 write 0xd3889c5 thru 0xd395e1f (0xd45b bytes) 2019-12-16T22:45:59.889 INFO:teuthology.orchestra.run.smithi177.stdout:1949 trunc from 0xd82645e to 0xacf962f 2019-12-16T22:45:59.894 INFO:teuthology.orchestra.run.smithi177.stdout:2089 punch from 0x2676ce3 to 0x2678f0d, (0x222a bytes) 2019-12-16T22:45:59.895 INFO:teuthology.orchestra.run.smithi177.stdout:2093 read 0x8df2504 thru 0x8df2ea8 (0x9a5 bytes) 2019-12-16T22:45:59.895 INFO:teuthology.orchestra.run.smithi177.stdout:2097 read 0x3589647 thru 0x35913a2 (0x7d5c bytes) 2019-12-16T22:45:59.897 INFO:teuthology.orchestra.run.smithi177.stdout:2098 write 0x2ccd3f3 thru 0x2cd0016 (0x2c24 bytes) 2019-12-16T22:45:59.909 INFO:teuthology.orchestra.run.smithi177.stdout:2099 read 0x99c2ef3 thru 0x99cbb5a (0x8c68 bytes) 2019-12-16T22:45:59.909 INFO:teuthology.orchestra.run.smithi177.stdout:2100 punch from 0xb1001b4 to 0xb10dac9, (0xd915 bytes) 2019-12-16T22:45:59.909 INFO:teuthology.orchestra.run.smithi177.stdout:2101 writesame 0x2213e94 thru 0x22195c5 data_size 0x1(0x5732 bytes) 2019-12-16T22:45:59.925 INFO:teuthology.orchestra.run.smithi177.stdout:2102 read 0x17bb9e3 thru 0x17c5d9a (0xa3b8 bytes) 2019-12-16T22:45:59.926 INFO:teuthology.orchestra.run.smithi177.stdout:2103 clone 16 order 23 su 65536 sc 6 2019-12-16T22:45:59.941 INFO:teuthology.orchestra.run.smithi177.stdout:2157 write 0xe49056e thru 0xe49a3eb (0x9e7e bytes) 2019-12-16T22:45:59.943 INFO:teuthology.orchestra.run.smithi177.stdout:1953 read 0x240714a thru 0x2407d7d (0xc34 bytes) 2019-12-16T22:45:59.944 INFO:teuthology.orchestra.run.smithi177.stdout:1954 write 0x6f8f9ab thru 0x6f9274f (0x2da5 bytes) 2019-12-16T22:45:59.952 INFO:teuthology.orchestra.run.smithi177.stdout:1955 read 0x3fbf0b7 thru 0x3fc203b (0x2f85 bytes) 2019-12-16T22:45:59.952 INFO:teuthology.orchestra.run.smithi177.stdout:1956 flatten 2019-12-16T22:45:59.968 INFO:teuthology.orchestra.run.smithi177.stdout:2159 read 0xc3cb5c7 thru 0xc3d8819 (0xd253 bytes) 2019-12-16T22:45:59.968 INFO:teuthology.orchestra.run.smithi177.stdout:2160 writesame 0x885efc5 thru 0x8864a69 data_size 0x5b(0x5aa5 bytes) 2019-12-16T22:45:59.984 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:45:59.985 INFO:teuthology.orchestra.run.smithi177.stdout:2162 punch from 0x9e9e62a to 0x9eaae2b, (0xc801 bytes) 2019-12-16T22:45:59.985 INFO:teuthology.orchestra.run.smithi177.stdout:2163 punch from 0xd02b0b0 to 0xd03753d, (0xc48d bytes) 2019-12-16T22:45:59.985 INFO:teuthology.orchestra.run.smithi177.stdout:2166 clone 15 order 22 su 16384 sc 2 2019-12-16T22:45:59.999 INFO:teuthology.orchestra.run.smithi177.stdout:1958 punch from 0x7395e1a to 0x739c478, (0x665e bytes) 2019-12-16T22:46:00.032 INFO:teuthology.orchestra.run.smithi177.stdout:1960 writesame 0xd6f2ccd thru 0xd6fb5ed data_size 0x55(0x8921 bytes) 2019-12-16T22:46:00.043 INFO:teuthology.orchestra.run.smithi177.stdout:1961 read 0x13ba242 thru 0x13c9f1b (0xfcda bytes) 2019-12-16T22:46:00.043 INFO:teuthology.orchestra.run.smithi177.stdout:1962 punch from 0x6abbe4f to 0x6ac8e55, (0xd006 bytes) 2019-12-16T22:46:00.044 INFO:teuthology.orchestra.run.smithi177.stdout:1963 write 0x420493b thru 0x4209b6d (0x5233 bytes) 2019-12-16T22:46:00.077 INFO:teuthology.orchestra.run.smithi177.stdout:1964 trunc from 0xd6fb5ee to 0xdebaf7a 2019-12-16T22:46:00.123 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.124 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.136 INFO:teuthology.orchestra.run.smithi177.stdout:1967 trunc from 0xdebaf7a to 0x6b0ca0d 2019-12-16T22:46:00.212 INFO:teuthology.orchestra.run.smithi177.stdout:1968 write 0x8ec9d3d thru 0x8ed41ba (0xa47e bytes) 2019-12-16T22:46:00.234 INFO:teuthology.orchestra.run.smithi177.stdout:1969 trunc from 0x8ed41bb to 0x4156b66 2019-12-16T22:46:00.247 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.1-clone14 2019-12-16T22:46:00.258 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone14 from 0x8d832d2 (overlap 0x6945eb) to 0x5437ef 2019-12-16T22:46:00.283 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.293 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone15 from 0xd395e20 (overlap 0x17d75c5) to 0x989582 2019-12-16T22:46:00.321 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone14 from 0xe49a3ec (overlap 0xde2818) to 0xc7f0e2 2019-12-16T22:46:00.336 INFO:teuthology.orchestra.run.smithi177.stdout:1972 writesame 0x52097a1 thru 0x5216c51 data_size 0x1(0xd4b1 bytes) 2019-12-16T22:46:00.352 INFO:teuthology.orchestra.run.smithi177.stdout:1973 write 0x2d148e6 thru 0x2d1c54e (0x7c69 bytes) 2019-12-16T22:46:00.375 INFO:teuthology.orchestra.run.smithi177.stdout:1974 read 0x414384 thru 0x423349 (0xefc6 bytes) 2019-12-16T22:46:00.376 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.3-clone16 intact 2019-12-16T22:46:00.427 INFO:teuthology.orchestra.run.smithi177.stdout:1975 writesame 0xd313cee thru 0xd31c8bd data_size 0x8(0x8bd0 bytes) 2019-12-16T22:46:00.450 INFO:teuthology.orchestra.run.smithi177.stdout:1976 trunc from 0xd31c8be to 0x470c4af 2019-12-16T22:46:00.456 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #13, image image_cluster1.client.mirror.1-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent14 2019-12-16T22:46:00.498 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #13, image image_cluster1.client.mirror.2-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent14 2019-12-16T22:46:00.498 INFO:teuthology.orchestra.run.smithi177.stdout:1979 writesame 0xafd5d69 thru 0xafd93ca data_size 0x1(0x3662 bytes) 2019-12-16T22:46:00.523 INFO:teuthology.orchestra.run.smithi177.stdout:1980 write 0xc6bff1d thru 0xc6c2049 (0x212d bytes) 2019-12-16T22:46:00.529 INFO:teuthology.orchestra.run.smithi177.stdout:1981 write 0x85546f9 thru 0x855b007 (0x690f bytes) 2019-12-16T22:46:00.537 INFO:teuthology.orchestra.run.smithi177.stdout:1982 writesame 0x361a027 thru 0x362286d data_size 0x1d(0x8847 bytes) 2019-12-16T22:46:00.561 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #14, image image_cluster1.client.mirror.4-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent15 2019-12-16T22:46:00.561 INFO:teuthology.orchestra.run.smithi177.stdout:1983 trunc from 0xc6c204a to 0x9094e14 2019-12-16T22:46:00.561 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #13, image image_cluster1.client.mirror.5-clone13 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent14 2019-12-16T22:46:00.584 INFO:teuthology.orchestra.run.smithi177.stdout:1984 trunc from 0x9094e14 to 0x2d73e53 2019-12-16T22:46:00.735 INFO:teuthology.orchestra.run.smithi177.stdout:1985 writesame 0xcee7b09 thru 0xcee8abb data_size 0x1(0xfb3 bytes) 2019-12-16T22:46:00.742 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #15, image image_cluster1.client.mirror.3-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent16 2019-12-16T22:46:00.743 INFO:teuthology.orchestra.run.smithi177.stdout:2168 write 0x429d70f thru 0x429e722 (0x1014 bytes) 2019-12-16T22:46:00.761 INFO:teuthology.orchestra.run.smithi177.stdout:1987 writesame 0xead1480 thru 0xeadf47f data_size 0x20(0xe000 bytes) 2019-12-16T22:46:00.773 INFO:teuthology.orchestra.run.smithi177.stdout:1989 write 0x9ca8e09 thru 0x9cb4606 (0xb7fe bytes) 2019-12-16T22:46:00.773 INFO:teuthology.orchestra.run.smithi177.stdout:2169 read 0xb4e381c thru 0xb4ef9fc (0xc1e1 bytes) 2019-12-16T22:46:00.773 INFO:teuthology.orchestra.run.smithi177.stdout:2170 read 0x3fcaf37 thru 0x3fd1d49 (0x6e13 bytes) 2019-12-16T22:46:00.774 INFO:teuthology.orchestra.run.smithi177.stdout:2171 write 0x134bdfa thru 0x134d1d2 (0x13d9 bytes) 2019-12-16T22:46:00.778 INFO:teuthology.orchestra.run.smithi177.stdout:1907 punch from 0x91b6945 to 0x91b7283, (0x93e bytes) 2019-12-16T22:46:00.791 INFO:teuthology.orchestra.run.smithi177.stdout:1990 trunc from 0xeadf480 to 0x89bf8cd 2019-12-16T22:46:00.810 INFO:teuthology.orchestra.run.smithi177.stdout:1620 write 0xaa1ed3f thru 0xaa211a4 (0x2466 bytes) 2019-12-16T22:46:00.813 INFO:teuthology.orchestra.run.smithi177.stdout:2173 read 0x7ca8e08 thru 0x7cb5e93 (0xd08c bytes) 2019-12-16T22:46:00.814 INFO:teuthology.orchestra.run.smithi177.stdout:2174 read 0x376716c thru 0x3776067 (0xeefc bytes) 2019-12-16T22:46:00.814 INFO:teuthology.orchestra.run.smithi177.stdout:2175 write 0x96629ff thru 0x9667d36 (0x5338 bytes) 2019-12-16T22:46:00.821 INFO:teuthology.orchestra.run.smithi177.stdout:1621 read 0x59d9b30 thru 0x59dd10c (0x35dd bytes) 2019-12-16T22:46:00.821 INFO:teuthology.orchestra.run.smithi177.stdout:1622 writesame 0x9bfab98 thru 0x9bfe7d1 data_size 0xd(0x3c3a bytes) 2019-12-16T22:46:00.830 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.835 INFO:teuthology.orchestra.run.smithi177.stdout:1624 writesame 0x4dcf94d thru 0x4dd374c data_size 0x8(0x3e00 bytes) 2019-12-16T22:46:00.842 INFO:teuthology.orchestra.run.smithi177.stdout:1908 writesame 0xd020d4b thru 0xd02c676 data_size 0xe(0xb92c bytes) 2019-12-16T22:46:00.842 INFO:teuthology.orchestra.run.smithi177.stdout:2176 write 0x1278497 thru 0x1287f8c (0xfaf6 bytes) 2019-12-16T22:46:00.848 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.861 INFO:teuthology.orchestra.run.smithi177.stdout:1909 write 0xae1fa62 thru 0xae2116d (0x170c bytes) 2019-12-16T22:46:00.862 INFO:teuthology.orchestra.run.smithi177.stdout:1912 punch from 0x765f44c to 0x7662c2d, (0x37e1 bytes) 2019-12-16T22:46:00.862 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.862 INFO:teuthology.orchestra.run.smithi177.stdout:1918 write 0x354e211 thru 0x3556a88 (0x8878 bytes) 2019-12-16T22:46:00.862 INFO:teuthology.orchestra.run.smithi177.stdout:2178 writesame 0x6c6057b thru 0x6c6c7ca data_size 0x8(0xc250 bytes) 2019-12-16T22:46:00.862 INFO:teuthology.orchestra.run.smithi177.stdout:1996 writesame 0xb8be22f thru 0xb8c14d3 data_size 0x1(0x32a5 bytes) 2019-12-16T22:46:00.862 INFO:teuthology.orchestra.run.smithi177.stdout:1997 write 0x542eaa thru 0x54ae07 (0x7f5e bytes) 2019-12-16T22:46:00.863 INFO:teuthology.orchestra.run.smithi177.stdout:1626 trunc from 0xaa211a5 to 0x5233ab9 2019-12-16T22:46:00.869 INFO:teuthology.orchestra.run.smithi177.stdout:1919 punch from 0xade07a8 to 0xade75e8, (0x6e40 bytes) 2019-12-16T22:46:00.869 INFO:teuthology.orchestra.run.smithi177.stdout:1920 writesame 0x57a3c37 thru 0x57ac3d9 data_size 0x1(0x87a3 bytes) 2019-12-16T22:46:00.874 INFO:teuthology.orchestra.run.smithi177.stdout:1998 read 0x602c2c6 thru 0x603c080 (0xfdbb bytes) 2019-12-16T22:46:00.875 INFO:teuthology.orchestra.run.smithi177.stdout:1999 write 0x4f0e44 thru 0x4f992d (0x8aea bytes) 2019-12-16T22:46:00.876 INFO:teuthology.orchestra.run.smithi177.stdout:2179 read 0x2ae7bd0 thru 0x2aec027 (0x4458 bytes) 2019-12-16T22:46:00.877 INFO:teuthology.orchestra.run.smithi177.stdout:2180 punch from 0xf5687 to 0xff661, (0x9fda bytes) 2019-12-16T22:46:00.877 INFO:teuthology.orchestra.run.smithi177.stdout:2181 read 0x54514b9 thru 0x545e089 (0xcbd1 bytes) 2019-12-16T22:46:00.877 INFO:teuthology.orchestra.run.smithi177.stdout:2182 writesame 0xc044f06 thru 0xc04f4f3 data_size 0x2(0xa5ee bytes) 2019-12-16T22:46:00.886 INFO:teuthology.orchestra.run.smithi177.stdout:2003 trunc from 0xb8c14d4 to 0xd766cbe 2019-12-16T22:46:00.910 INFO:teuthology.orchestra.run.smithi177.stdout:2183 read 0x1b2c950 thru 0x1b34222 (0x78d3 bytes) 2019-12-16T22:46:00.911 INFO:teuthology.orchestra.run.smithi177.stdout:2184 punch from 0x96b075a to 0x96be43c, (0xdce2 bytes) 2019-12-16T22:46:00.913 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.913 INFO:teuthology.orchestra.run.smithi177.stdout:1922 write 0xc22964d thru 0xc231479 (0x7e2d bytes) 2019-12-16T22:46:00.915 INFO:teuthology.orchestra.run.smithi177.stdout:2004 write 0x33e6b19 thru 0x33edf7e (0x7466 bytes) 2019-12-16T22:46:00.924 INFO:teuthology.orchestra.run.smithi177.stdout:1923 punch from 0x5fa529f to 0x5fa5561, (0x2c2 bytes) 2019-12-16T22:46:00.924 INFO:teuthology.orchestra.run.smithi177.stdout:1924 write 0x736599b thru 0x7370cc0 (0xb326 bytes) 2019-12-16T22:46:00.925 INFO:teuthology.orchestra.run.smithi177.stdout:2005 punch from 0xb69c029 to 0xb6a13d5, (0x53ac bytes) 2019-12-16T22:46:00.926 INFO:teuthology.orchestra.run.smithi177.stdout:2006 read 0x70272fd thru 0x7031c75 (0xa979 bytes) 2019-12-16T22:46:00.926 INFO:teuthology.orchestra.run.smithi177.stdout:2007 writesame 0xcaa4e5c thru 0xcaaad07 data_size 0x4(0x5eac bytes) 2019-12-16T22:46:00.933 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:00.933 INFO:teuthology.orchestra.run.smithi177.stdout:1926 writesame 0x96b57dc thru 0x96c1359 data_size 0x2(0xbb7e bytes) 2019-12-16T22:46:00.934 INFO:teuthology.orchestra.run.smithi177.stdout:2185 trunc from 0xe49a3ec to 0x543360 2019-12-16T22:46:00.935 INFO:teuthology.orchestra.run.smithi177.stdout:2008 read 0x9b2dc3b thru 0x9b3207f (0x4445 bytes) 2019-12-16T22:46:00.936 INFO:teuthology.orchestra.run.smithi177.stdout:2010 read 0x96cc8a5 thru 0x96d5186 (0x88e2 bytes) 2019-12-16T22:46:00.939 INFO:teuthology.orchestra.run.smithi177.stdout:1627 write 0x728124a thru 0x7285a73 (0x482a bytes) 2019-12-16T22:46:00.952 INFO:teuthology.orchestra.run.smithi177.stdout:1927 read 0x208bff4 thru 0x20946f3 (0x8700 bytes) 2019-12-16T22:46:00.955 INFO:teuthology.orchestra.run.smithi177.stdout:1928 trunc from 0xd02c677 to 0xc026c39 2019-12-16T22:46:00.956 INFO:teuthology.orchestra.run.smithi177.stdout:2011 trunc from 0xd766cbe to 0x260dfc9 2019-12-16T22:46:01.017 INFO:teuthology.orchestra.run.smithi177.stdout:1629 writesame 0xb88afe8 thru 0xb895768 data_size 0x1(0xa781 bytes) 2019-12-16T22:46:01.019 INFO:teuthology.orchestra.run.smithi177.stdout:1631 write 0x41c7894 thru 0x41d6bc6 (0xf333 bytes) 2019-12-16T22:46:01.028 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.028 INFO:teuthology.orchestra.run.smithi177.stdout:1930 write 0x7771410 thru 0x778090b (0xf4fc bytes) 2019-12-16T22:46:01.050 INFO:teuthology.orchestra.run.smithi177.stdout:2105 trunc from 0xd395e20 to 0x7858875 2019-12-16T22:46:01.054 INFO:teuthology.orchestra.run.smithi177.stdout:2480 writesame 0x5ca2cb0 thru 0x5caada4 data_size 0x1(0x80f5 bytes) 2019-12-16T22:46:01.061 INFO:teuthology.orchestra.run.smithi177.stdout:1931 punch from 0x56fda40 to 0x570b1ed, (0xd7ad bytes) 2019-12-16T22:46:01.062 INFO:teuthology.orchestra.run.smithi177.stdout:1932 read 0xcf1545 thru 0xcfbb3b (0xa5f7 bytes) 2019-12-16T22:46:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:1933 punch from 0xad90d4b to 0xad9d28f, (0xc544 bytes) 2019-12-16T22:46:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:1934 punch from 0x1de71f6 to 0x1de8c74, (0x1a7e bytes) 2019-12-16T22:46:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.063 INFO:teuthology.orchestra.run.smithi177.stdout:1936 clone 18 order 25 su 131072 sc 8 2019-12-16T22:46:01.075 INFO:teuthology.orchestra.run.smithi177.stdout:1632 writesame 0x20f3987 thru 0x20f81b2 data_size 0x3e(0x482c bytes) 2019-12-16T22:46:01.080 INFO:teuthology.orchestra.run.smithi177.stdout:2013 write 0x34225cb thru 0x342731a (0x4d50 bytes) 2019-12-16T22:46:01.115 INFO:teuthology.orchestra.run.smithi177.stdout:2014 trunc from 0x342731b to 0x3d6710b 2019-12-16T22:46:01.160 INFO:teuthology.orchestra.run.smithi177.stdout:1634 read 0x5099a3d thru 0x50a8083 (0xe647 bytes) 2019-12-16T22:46:01.162 INFO:teuthology.orchestra.run.smithi177.stdout:1635 clone 16 order 24 su 262144 sc 5 2019-12-16T22:46:01.183 INFO:teuthology.orchestra.run.smithi177.stdout:2481 read 0xacbd9d6 thru 0xacbda62 (0x8d bytes) 2019-12-16T22:46:01.184 INFO:teuthology.orchestra.run.smithi177.stdout:2483 read 0xed65c0 thru 0xee1737 (0xb178 bytes) 2019-12-16T22:46:01.185 INFO:teuthology.orchestra.run.smithi177.stdout:2485 read 0x35e2127 thru 0x35e3bdf (0x1ab9 bytes) 2019-12-16T22:46:01.186 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.187 INFO:teuthology.orchestra.run.smithi177.stdout:2489 punch from 0xc09b1e3 to 0xc09ea7b, (0x3898 bytes) 2019-12-16T22:46:01.187 INFO:teuthology.orchestra.run.smithi177.stdout:2490 punch from 0xb677579 to 0xb682dcd, (0xb854 bytes) 2019-12-16T22:46:01.188 INFO:teuthology.orchestra.run.smithi177.stdout:2492 trunc from 0xc84240e to 0xbda0bda 2019-12-16T22:46:01.222 INFO:teuthology.orchestra.run.smithi177.stdout:2186 write 0x823a6bb thru 0x823dcd6 (0x361c bytes) 2019-12-16T22:46:01.229 INFO:teuthology.orchestra.run.smithi177.stdout:2015 writesame 0xb61c502 thru 0xb623e3e data_size 0x1(0x793d bytes) 2019-12-16T22:46:01.231 INFO:teuthology.orchestra.run.smithi177.stdout:2106 trunc from 0x7858875 to 0xbaee408 2019-12-16T22:46:01.232 INFO:teuthology.orchestra.run.smithi177.stdout:2016 write 0x990d142 thru 0x991437d (0x723c bytes) 2019-12-16T22:46:01.237 INFO:teuthology.orchestra.run.smithi177.stdout:2494 read 0x3a19375 thru 0x3a19610 (0x29c bytes) 2019-12-16T22:46:01.238 INFO:teuthology.orchestra.run.smithi177.stdout:2495 write 0x62fd1b2 thru 0x63068db (0x972a bytes) 2019-12-16T22:46:01.242 INFO:teuthology.orchestra.run.smithi177.stdout:2017 write 0xa3c769 thru 0xa4b2c2 (0xeb5a bytes) 2019-12-16T22:46:01.253 INFO:teuthology.orchestra.run.smithi177.stdout:2107 read 0xd51313 thru 0xd5aea2 (0x9b90 bytes) 2019-12-16T22:46:01.253 INFO:teuthology.orchestra.run.smithi177.stdout:2021 read 0x5bf373a thru 0x5c01dd5 (0xe69c bytes) 2019-12-16T22:46:01.253 INFO:teuthology.orchestra.run.smithi177.stdout:2022 write 0x69d1472 thru 0x69ddada (0xc669 bytes) 2019-12-16T22:46:01.254 INFO:teuthology.orchestra.run.smithi177.stdout:2108 write 0xb488714 thru 0xb48bcf0 (0x35dd bytes) 2019-12-16T22:46:01.258 INFO:teuthology.orchestra.run.smithi177.stdout:2498 read 0x95a6db1 thru 0x95b3eb8 (0xd108 bytes) 2019-12-16T22:46:01.269 INFO:teuthology.orchestra.run.smithi177.stdout:2110 write 0x865cf69 thru 0x86615c3 (0x465b bytes) 2019-12-16T22:46:01.269 INFO:teuthology.orchestra.run.smithi177.stdout:2023 write 0x30b4440 thru 0x30bac88 (0x6849 bytes) 2019-12-16T22:46:01.270 INFO:teuthology.orchestra.run.smithi177.stdout:2188 write 0x87a5468 thru 0x87ab3e8 (0x5f81 bytes) 2019-12-16T22:46:01.285 INFO:teuthology.orchestra.run.smithi177.stdout:2112 read 0x8cdd066 thru 0x8ce1d61 (0x4cfc bytes) 2019-12-16T22:46:01.285 INFO:teuthology.orchestra.run.smithi177.stdout:2114 trunc from 0xbaee408 to 0xaf37bf4 2019-12-16T22:46:01.290 INFO:teuthology.orchestra.run.smithi177.stdout:2499 write 0xd0eec2a thru 0xd0f60d2 (0x74a9 bytes) 2019-12-16T22:46:01.301 INFO:teuthology.orchestra.run.smithi177.stdout:2502 read 0x2b50245 thru 0x2b50df9 (0xbb5 bytes) 2019-12-16T22:46:01.302 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.302 INFO:teuthology.orchestra.run.smithi177.stdout:2506 read 0x80db997 thru 0x80e3e03 (0x846d bytes) 2019-12-16T22:46:01.302 INFO:teuthology.orchestra.run.smithi177.stdout:2507 writesame 0xc07ab4e thru 0xc07bbae data_size 0x1(0x1061 bytes) 2019-12-16T22:46:01.304 INFO:teuthology.orchestra.run.smithi177.stdout:2115 write 0xa8e354c thru 0xa8e9362 (0x5e17 bytes) 2019-12-16T22:46:01.306 INFO:teuthology.orchestra.run.smithi177.stdout:2024 write 0xcf91ba1 thru 0xcf9daad (0xbf0d bytes) 2019-12-16T22:46:01.313 INFO:teuthology.orchestra.run.smithi177.stdout:2116 read 0x7e5f9d6 thru 0x7e603d2 (0x9fd bytes) 2019-12-16T22:46:01.316 INFO:teuthology.orchestra.run.smithi177.stdout:2510 trunc from 0xd0f60d3 to 0xe48c1b8 2019-12-16T22:46:01.316 INFO:teuthology.orchestra.run.smithi177.stdout:2117 trunc from 0xaf37bf4 to 0x9ad947b 2019-12-16T22:46:01.317 INFO:teuthology.orchestra.run.smithi177.stdout:2026 read 0x75ebad0 thru 0x75ec8bb (0xdec bytes) 2019-12-16T22:46:01.317 INFO:teuthology.orchestra.run.smithi177.stdout:2027 read 0x10ffff3 thru 0x110ff43 (0xff51 bytes) 2019-12-16T22:46:01.317 INFO:teuthology.orchestra.run.smithi177.stdout:2190 write 0xc6544ff thru 0xc65b403 (0x6f05 bytes) 2019-12-16T22:46:01.318 INFO:teuthology.orchestra.run.smithi177.stdout:2029 read 0x5e829b6 thru 0x5e8ccca (0xa315 bytes) 2019-12-16T22:46:01.319 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.319 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.328 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.332 INFO:teuthology.orchestra.run.smithi177.stdout:2032 trunc from 0xcf9daae to 0x756ed07 2019-12-16T22:46:01.338 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.339 INFO:teuthology.orchestra.run.smithi177.stdout:2512 write 0xc58c74b thru 0xc59bb4c (0xf402 bytes) 2019-12-16T22:46:01.351 INFO:teuthology.orchestra.run.smithi177.stdout:2118 read 0x41eeba8 thru 0x41eff75 (0x13ce bytes) 2019-12-16T22:46:01.371 INFO:teuthology.orchestra.run.smithi177.stdout:2192 write 0xe6b2a00 thru 0xe6c2006 (0xf607 bytes) 2019-12-16T22:46:01.372 INFO:teuthology.orchestra.run.smithi177.stdout:2513 trunc from 0xe48c1b8 to 0x522093e 2019-12-16T22:46:01.377 INFO:teuthology.orchestra.run.smithi177.stdout:2120 write 0xc9ad45e thru 0xc9b3ad6 (0x6679 bytes) 2019-12-16T22:46:01.389 INFO:teuthology.orchestra.run.smithi177.stdout:2033 trunc from 0x756ed07 to 0xb446213 2019-12-16T22:46:01.395 INFO:teuthology.orchestra.run.smithi177.stdout:2193 read 0xd80bdd7 thru 0xd814e54 (0x907e bytes) 2019-12-16T22:46:01.401 INFO:teuthology.orchestra.run.smithi177.stdout:2121 trunc from 0xc9b3ad7 to 0xdde0b7b 2019-12-16T22:46:01.421 INFO:teuthology.orchestra.run.smithi177.stdout:2034 punch from 0xaeb4e62 to 0xaeb9d31, (0x4ecf bytes) 2019-12-16T22:46:01.422 INFO:teuthology.orchestra.run.smithi177.stdout:2035 trunc from 0xb446213 to 0xb218440 2019-12-16T22:46:01.429 INFO:teuthology.orchestra.run.smithi177.stdout:2194 write 0xe99c11b thru 0xe9a45cb (0x84b1 bytes) 2019-12-16T22:46:01.430 INFO:teuthology.orchestra.run.smithi177.stdout:2122 write 0x58c11df thru 0x58d0941 (0xf763 bytes) 2019-12-16T22:46:01.443 INFO:teuthology.orchestra.run.smithi177.stdout:2195 write 0x5470fae thru 0x547d64e (0xc6a1 bytes) 2019-12-16T22:46:01.451 INFO:teuthology.orchestra.run.smithi177.stdout:2037 trunc from 0xb218440 to 0xe1b939a 2019-12-16T22:46:01.456 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.471 INFO:teuthology.orchestra.run.smithi177.stdout:2514 write 0xdac7d71 thru 0xdad7879 (0xfb09 bytes) 2019-12-16T22:46:01.477 INFO:teuthology.orchestra.run.smithi177.stdout:2196 trunc from 0xe9a45cc to 0x637997c 2019-12-16T22:46:01.479 INFO:teuthology.orchestra.run.smithi177.stdout:2124 write 0xe8758fd thru 0xe875a13 (0x117 bytes) 2019-12-16T22:46:01.485 INFO:teuthology.orchestra.run.smithi177.stdout:2517 read 0x4d4fae thru 0x4dc6b9 (0x770c bytes) 2019-12-16T22:46:01.489 INFO:teuthology.orchestra.run.smithi177.stdout:2518 writesame 0xd6c83b1 thru 0xd6d1ff2 data_size 0x6(0x9c42 bytes) 2019-12-16T22:46:01.493 INFO:teuthology.orchestra.run.smithi177.stdout:2038 trunc from 0xe1b939a to 0x518b281 2019-12-16T22:46:01.501 INFO:teuthology.orchestra.run.smithi177.stdout:2520 punch from 0x4b6a94d to 0x4b71c3b, (0x72ee bytes) 2019-12-16T22:46:01.502 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.502 INFO:teuthology.orchestra.run.smithi177.stdout:2522 write 0x79d592e thru 0x79dcc7e (0x7351 bytes) 2019-12-16T22:46:01.502 INFO:teuthology.orchestra.run.smithi177.stdout:2125 trunc from 0xe875a14 to 0x6bb3944 2019-12-16T22:46:01.510 INFO:teuthology.orchestra.run.smithi177.stdout:2524 writesame 0x9e6be9b thru 0x9e716ad data_size 0x1(0x5813 bytes) 2019-12-16T22:46:01.512 INFO:teuthology.orchestra.run.smithi177.stdout:2197 punch from 0x5b8614b to 0x5b93c8d, (0xdb42 bytes) 2019-12-16T22:46:01.512 INFO:teuthology.orchestra.run.smithi177.stdout:2198 punch from 0x62772e4 to 0x6285630, (0xe34c bytes) 2019-12-16T22:46:01.512 INFO:teuthology.orchestra.run.smithi177.stdout:2199 read 0x51c765b thru 0x51cdf47 (0x68ed bytes) 2019-12-16T22:46:01.521 INFO:teuthology.orchestra.run.smithi177.stdout:2200 trunc from 0x637997c to 0x238493b 2019-12-16T22:46:01.531 INFO:teuthology.orchestra.run.smithi177.stdout:2525 write 0x5fd8e28 thru 0x5fdfcea (0x6ec3 bytes) 2019-12-16T22:46:01.536 INFO:teuthology.orchestra.run.smithi177.stdout:2039 write 0x1c06604 thru 0x1c11d30 (0xb72d bytes) 2019-12-16T22:46:01.541 INFO:teuthology.orchestra.run.smithi177.stdout:2126 write 0x6859b5a thru 0x6868141 (0xe5e8 bytes) 2019-12-16T22:46:01.551 INFO:teuthology.orchestra.run.smithi177.stdout:2128 write 0x50edf32 thru 0x50f9e9b (0xbf6a bytes) 2019-12-16T22:46:01.558 INFO:teuthology.orchestra.run.smithi177.stdout:2131 punch from 0x15d94e to 0x164e9f, (0x7551 bytes) 2019-12-16T22:46:01.560 INFO:teuthology.orchestra.run.smithi177.stdout:2202 punch from 0x180fb12 to 0x1819002, (0x94f0 bytes) 2019-12-16T22:46:01.561 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.569 INFO:teuthology.orchestra.run.smithi177.stdout:2526 trunc from 0xdad787a to 0x1e29434 2019-12-16T22:46:01.575 INFO:teuthology.orchestra.run.smithi177.stdout:2133 trunc from 0x6bb3944 to 0xba6603a 2019-12-16T22:46:01.598 INFO:teuthology.orchestra.run.smithi177.stdout:2040 writesame 0xe7c25c7 thru 0xe7cbeeb data_size 0x1(0x9925 bytes) 2019-12-16T22:46:01.603 INFO:teuthology.orchestra.run.smithi177.stdout:2041 read 0x4af0f10 thru 0x4af7397 (0x6488 bytes) 2019-12-16T22:46:01.604 INFO:teuthology.orchestra.run.smithi177.stdout:2042 trunc from 0xe7cbeec to 0xe528ef3 2019-12-16T22:46:01.606 INFO:teuthology.orchestra.run.smithi177.stdout:2204 writesame 0xaf89e2c thru 0xaf97163 data_size 0x24(0xd338 bytes) 2019-12-16T22:46:01.609 INFO:teuthology.orchestra.run.smithi177.stdout:2205 write 0x8ebe902 thru 0x8ec2fb3 (0x46b2 bytes) 2019-12-16T22:46:01.620 INFO:teuthology.orchestra.run.smithi177.stdout:2206 punch from 0x4e428a3 to 0x4e4f5c2, (0xcd1f bytes) 2019-12-16T22:46:01.620 INFO:teuthology.orchestra.run.smithi177.stdout:2207 read 0x7bbb796 thru 0x7bc863f (0xceaa bytes) 2019-12-16T22:46:01.620 INFO:teuthology.orchestra.run.smithi177.stdout:2210 punch from 0x467feb2 to 0x4688fbe, (0x910c bytes) 2019-12-16T22:46:01.621 INFO:teuthology.orchestra.run.smithi177.stdout:2211 writesame 0x11e62ec thru 0x11ed808 data_size 0x1(0x751d bytes) 2019-12-16T22:46:01.621 INFO:teuthology.orchestra.run.smithi177.stdout:2527 read 0x693fb thru 0x7302f (0x9c35 bytes) 2019-12-16T22:46:01.640 INFO:teuthology.orchestra.run.smithi177.stdout:2528 punch from 0xa5e0e to 0xadf5a, (0x814c bytes) 2019-12-16T22:46:01.641 INFO:teuthology.orchestra.run.smithi177.stdout:2134 trunc from 0xba6603a to 0x3ac4031 2019-12-16T22:46:01.641 INFO:teuthology.orchestra.run.smithi177.stdout:2044 read 0x28e4e8a thru 0x28f1a0a (0xcb81 bytes) 2019-12-16T22:46:01.641 INFO:teuthology.orchestra.run.smithi177.stdout:2046 trunc from 0xe528ef3 to 0xc89da2d 2019-12-16T22:46:01.643 INFO:teuthology.orchestra.run.smithi177.stdout:2214 writesame 0x1e0a3cc thru 0x1e0ba99 data_size 0xe(0x16ce bytes) 2019-12-16T22:46:01.655 INFO:teuthology.orchestra.run.smithi177.stdout:2215 trunc from 0xaf97164 to 0xc8de835 2019-12-16T22:46:01.661 INFO:teuthology.orchestra.run.smithi177.stdout:2533 write 0x6ae9821 thru 0x6af3674 (0x9e54 bytes) 2019-12-16T22:46:01.664 INFO:teuthology.orchestra.run.smithi177.stdout:2048 writesame 0x20adcfc thru 0x20b8ad9 data_size 0x5(0xadde bytes) 2019-12-16T22:46:01.675 INFO:teuthology.orchestra.run.smithi177.stdout:2049 read 0xab9e2e4 thru 0xab9f5e0 (0x12fd bytes) 2019-12-16T22:46:01.675 INFO:teuthology.orchestra.run.smithi177.stdout:2050 writesame 0x986ece7 thru 0x9870f12 data_size 0x12(0x222c bytes) 2019-12-16T22:46:01.681 INFO:teuthology.orchestra.run.smithi177.stdout:2535 trunc from 0x6af3675 to 0xac1f175 2019-12-16T22:46:01.683 INFO:teuthology.orchestra.run.smithi177.stdout:2216 writesame 0x4bef6d8 thru 0x4bf0931 data_size 0x1d(0x125a bytes) 2019-12-16T22:46:01.698 INFO:teuthology.orchestra.run.smithi177.stdout:2217 trunc from 0xc8de835 to 0xd67b680 2019-12-16T22:46:01.708 INFO:teuthology.orchestra.run.smithi177.stdout:2536 writesame 0x1175f4 thru 0x123b6e data_size 0x1(0xc57b bytes) 2019-12-16T22:46:01.713 INFO:teuthology.orchestra.run.smithi177.stdout:2139 writesame 0x5d23e99 thru 0x5d2fee7 data_size 0xd(0xc04f bytes) 2019-12-16T22:46:01.717 INFO:teuthology.orchestra.run.smithi177.stdout:2142 write 0x21d9843 thru 0x21e17ee (0x7fac bytes) 2019-12-16T22:46:01.719 INFO:teuthology.orchestra.run.smithi177.stdout:2051 writesame 0xd51642a thru 0xd5171e1 data_size 0x4(0xdb8 bytes) 2019-12-16T22:46:01.724 INFO:teuthology.orchestra.run.smithi177.stdout:2219 write 0x1e7c0ff thru 0x1e7f56c (0x346e bytes) 2019-12-16T22:46:01.734 INFO:teuthology.orchestra.run.smithi177.stdout:2052 writesame 0x96ac6a5 thru 0x96adb7d data_size 0x3(0x14d9 bytes) 2019-12-16T22:46:01.739 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.746 INFO:teuthology.orchestra.run.smithi177.stdout:2057 trunc from 0xd5171e2 to 0x98b3a18 2019-12-16T22:46:01.754 INFO:teuthology.orchestra.run.smithi177.stdout:2537 punch from 0x8e57677 to 0x8e62d5f, (0xb6e8 bytes) 2019-12-16T22:46:01.754 INFO:teuthology.orchestra.run.smithi177.stdout:2539 write 0x556e1aa thru 0x557ae37 (0xcc8e bytes) 2019-12-16T22:46:01.754 INFO:teuthology.orchestra.run.smithi177.stdout:2220 trunc from 0xd67b680 to 0x40f5f7c 2019-12-16T22:46:01.767 INFO:teuthology.orchestra.run.smithi177.stdout:2143 write 0x54f1fdb thru 0x54ffcc6 (0xdcec bytes) 2019-12-16T22:46:01.776 INFO:teuthology.orchestra.run.smithi177.stdout:2540 write 0x8c89f55 thru 0x8c8bbe9 (0x1c95 bytes) 2019-12-16T22:46:01.779 INFO:teuthology.orchestra.run.smithi177.stdout:2144 write 0x5ae7537 thru 0x5af5071 (0xdb3b bytes) 2019-12-16T22:46:01.786 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.789 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.789 INFO:teuthology.orchestra.run.smithi177.stdout:2147 read 0x595222b thru 0x595db73 (0xb949 bytes) 2019-12-16T22:46:01.790 INFO:teuthology.orchestra.run.smithi177.stdout:2148 read 0xf7c19f thru 0xf7f2c9 (0x312b bytes) 2019-12-16T22:46:01.790 INFO:teuthology.orchestra.run.smithi177.stdout:2149 punch from 0x19017d9 to 0x1905859, (0x4080 bytes) 2019-12-16T22:46:01.790 INFO:teuthology.orchestra.run.smithi177.stdout:2151 read 0x3933c51 thru 0x393575a (0x1b0a bytes) 2019-12-16T22:46:01.791 INFO:teuthology.orchestra.run.smithi177.stdout:2152 read 0x1e0b5bd thru 0x1e156d3 (0xa117 bytes) 2019-12-16T22:46:01.791 INFO:teuthology.orchestra.run.smithi177.stdout:2153 read 0x34af9b3 thru 0x34b9b1b (0xa169 bytes) 2019-12-16T22:46:01.791 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.791 INFO:teuthology.orchestra.run.smithi177.stdout:2059 punch from 0x2db46e1 to 0x2db7468, (0x2d87 bytes) 2019-12-16T22:46:01.795 INFO:teuthology.orchestra.run.smithi177.stdout:2544 trunc from 0xac1f175 to 0x64d1361 2019-12-16T22:46:01.795 INFO:teuthology.orchestra.run.smithi177.stdout:2155 trunc from 0x5d2fee8 to 0x44cff85 2019-12-16T22:46:01.814 INFO:teuthology.orchestra.run.smithi177.stdout:2062 writesame 0x9faac4b thru 0x9fab47b data_size 0x3(0x831 bytes) 2019-12-16T22:46:01.818 INFO:teuthology.orchestra.run.smithi177.stdout:2221 write 0x6608a41 thru 0x66143e1 (0xb9a1 bytes) 2019-12-16T22:46:01.819 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.819 INFO:teuthology.orchestra.run.smithi177.stdout:2064 write 0x2fdc0bb thru 0x2fde145 (0x208b bytes) 2019-12-16T22:46:01.824 INFO:teuthology.orchestra.run.smithi177.stdout:2545 write 0x48ca440 thru 0x48ccbec (0x27ad bytes) 2019-12-16T22:46:01.832 INFO:teuthology.orchestra.run.smithi177.stdout:2065 read 0x3fff490 thru 0x400203f (0x2bb0 bytes) 2019-12-16T22:46:01.832 INFO:teuthology.orchestra.run.smithi177.stdout:2066 write 0x407b5de thru 0x4085cf3 (0xa716 bytes) 2019-12-16T22:46:01.843 INFO:teuthology.orchestra.run.smithi177.stdout:2548 punch from 0x2fa7e32 to 0x2fa8167, (0x335 bytes) 2019-12-16T22:46:01.843 INFO:teuthology.orchestra.run.smithi177.stdout:2549 writesame 0x37e2ed thru 0x3890cf data_size 0x1d(0xade3 bytes) 2019-12-16T22:46:01.848 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.848 INFO:teuthology.orchestra.run.smithi177.stdout:2069 writesame 0x433c005 thru 0x4343d5c data_size 0x2a(0x7d58 bytes) 2019-12-16T22:46:01.854 INFO:teuthology.orchestra.run.smithi177.stdout:2070 write 0x2ab78a thru 0x2b10b4 (0x592b bytes) 2019-12-16T22:46:01.860 INFO:teuthology.orchestra.run.smithi177.stdout:2156 write 0xac77116 thru 0xac81fa7 (0xae92 bytes) 2019-12-16T22:46:01.873 INFO:teuthology.orchestra.run.smithi177.stdout:2072 read 0x30649f0 thru 0x3072267 (0xd878 bytes) 2019-12-16T22:46:01.874 INFO:teuthology.orchestra.run.smithi177.stdout:2073 read 0x20082e4 thru 0x20146ff (0xc41c bytes) 2019-12-16T22:46:01.874 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.879 INFO:teuthology.orchestra.run.smithi177.stdout:2157 read 0x7c68d6f thru 0x7c6c932 (0x3bc4 bytes) 2019-12-16T22:46:01.880 INFO:teuthology.orchestra.run.smithi177.stdout:2159 read 0x8c8bdf8 thru 0x8c90de6 (0x4fef bytes) 2019-12-16T22:46:01.880 INFO:teuthology.orchestra.run.smithi177.stdout:2160 write 0x560b902 thru 0x5610bf6 (0x52f5 bytes) 2019-12-16T22:46:01.880 INFO:teuthology.orchestra.run.smithi177.stdout:2223 writesame 0xa5af422 thru 0xa5b3948 data_size 0x15(0x4527 bytes) 2019-12-16T22:46:01.889 INFO:teuthology.orchestra.run.smithi177.stdout:2164 write 0x2276dd1 thru 0x22803df (0x960f bytes) 2019-12-16T22:46:01.889 INFO:teuthology.orchestra.run.smithi177.stdout:2077 trunc from 0x9fab47c to 0x741fd6 2019-12-16T22:46:01.900 INFO:teuthology.orchestra.run.smithi177.stdout:2550 read 0x4cfabc3 thru 0x4d0803a (0xd478 bytes) 2019-12-16T22:46:01.900 INFO:teuthology.orchestra.run.smithi177.stdout:2551 punch from 0x1658c9 to 0x173f62, (0xe699 bytes) 2019-12-16T22:46:01.901 INFO:teuthology.orchestra.run.smithi177.stdout:2552 read 0x51366ec thru 0x5142578 (0xbe8d bytes) 2019-12-16T22:46:01.901 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.924 INFO:teuthology.orchestra.run.smithi177.stdout:2225 write 0xcbd8ffc thru 0xcbe2e91 (0x9e96 bytes) 2019-12-16T22:46:01.936 INFO:teuthology.orchestra.run.smithi177.stdout:2165 read 0x59fdda5 thru 0x5a037b1 (0x5a0d bytes) 2019-12-16T22:46:01.937 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:01.937 INFO:teuthology.orchestra.run.smithi177.stdout:2167 read 0x852a692 thru 0x852e822 (0x4191 bytes) 2019-12-16T22:46:01.937 INFO:teuthology.orchestra.run.smithi177.stdout:2168 read 0x7caf51b thru 0x7caf7e7 (0x2cd bytes) 2019-12-16T22:46:01.938 INFO:teuthology.orchestra.run.smithi177.stdout:2169 punch from 0x1a5ae98 to 0x1a5b1bd, (0x325 bytes) 2019-12-16T22:46:01.938 INFO:teuthology.orchestra.run.smithi177.stdout:2170 write 0x9abd6d0 thru 0x9aca96c (0xd29d bytes) 2019-12-16T22:46:01.952 INFO:teuthology.orchestra.run.smithi177.stdout:2172 write 0x6578a75 thru 0x657a634 (0x1bc0 bytes) 2019-12-16T22:46:01.953 INFO:teuthology.orchestra.run.smithi177.stdout:2554 write 0xc18c083 thru 0xc18c2c6 (0x244 bytes) 2019-12-16T22:46:01.957 INFO:teuthology.orchestra.run.smithi177.stdout:2176 clone 17 order 24 su 8388608 sc 6 2019-12-16T22:46:01.962 INFO:teuthology.orchestra.run.smithi177.stdout:2556 punch from 0xb150945 to 0xb15f143, (0xe7fe bytes) 2019-12-16T22:46:01.962 INFO:teuthology.orchestra.run.smithi177.stdout:2558 read 0x6236793 thru 0x6238dcd (0x263b bytes) 2019-12-16T22:46:01.963 INFO:teuthology.orchestra.run.smithi177.stdout:2559 punch from 0x988c5a9 to 0x9897a30, (0xb487 bytes) 2019-12-16T22:46:01.963 INFO:teuthology.orchestra.run.smithi177.stdout:2560 read 0xaeafa9c thru 0xaeb8144 (0x86a9 bytes) 2019-12-16T22:46:01.963 INFO:teuthology.orchestra.run.smithi177.stdout:2561 read 0x8cb0d19 thru 0x8cb6fb7 (0x629f bytes) 2019-12-16T22:46:01.963 INFO:teuthology.orchestra.run.smithi177.stdout:2562 read 0x2dff4a thru 0x2ee692 (0xe749 bytes) 2019-12-16T22:46:01.968 INFO:teuthology.orchestra.run.smithi177.stdout:2226 write 0xcf5ab2d thru 0xcf610ff (0x65d3 bytes) 2019-12-16T22:46:01.973 INFO:teuthology.orchestra.run.smithi177.stdout:2227 read 0x928b256 thru 0x928c1c4 (0xf6f bytes) 2019-12-16T22:46:01.974 INFO:teuthology.orchestra.run.smithi177.stdout:2228 write 0x8e7be7d thru 0x8e89695 (0xd819 bytes) 2019-12-16T22:46:01.974 INFO:teuthology.orchestra.run.smithi177.stdout:2079 trunc from 0x741fd6 to 0x62c34dd 2019-12-16T22:46:01.994 INFO:teuthology.orchestra.run.smithi177.stdout:2229 write 0x11bf2a0 thru 0x11c9cc4 (0xaa25 bytes) 2019-12-16T22:46:01.995 INFO:teuthology.orchestra.run.smithi177.stdout:2563 write 0xd255489 thru 0xd264b79 (0xf6f1 bytes) 2019-12-16T22:46:02.000 INFO:teuthology.orchestra.run.smithi177.stdout:2080 read 0x2ab0332 thru 0x2ab09a3 (0x672 bytes) 2019-12-16T22:46:02.009 INFO:teuthology.orchestra.run.smithi177.stdout:2231 write 0x381ffc0 thru 0x382ee8c (0xeecd bytes) 2019-12-16T22:46:02.020 INFO:teuthology.orchestra.run.smithi177.stdout:2565 punch from 0x3965a73 to 0x396dbeb, (0x8178 bytes) 2019-12-16T22:46:02.020 INFO:teuthology.orchestra.run.smithi177.stdout:2566 write 0x57592eb thru 0x5766cd0 (0xd9e6 bytes) 2019-12-16T22:46:02.042 INFO:teuthology.orchestra.run.smithi177.stdout:2567 trunc from 0xd264b7a to 0xc7562b9 2019-12-16T22:46:02.056 INFO:teuthology.orchestra.run.smithi177.stdout:2232 trunc from 0xcf61100 to 0x4725351 2019-12-16T22:46:02.069 INFO:teuthology.orchestra.run.smithi177.stdout:2081 write 0xe699cd0 thru 0xe6a648e (0xc7bf bytes) 2019-12-16T22:46:02.087 INFO:teuthology.orchestra.run.smithi177.stdout:2082 write 0xce2a982 thru 0xce2ccca (0x2349 bytes) 2019-12-16T22:46:02.100 INFO:teuthology.orchestra.run.smithi177.stdout:2083 write 0xcd1783a thru 0xcd25f73 (0xe73a bytes) 2019-12-16T22:46:02.110 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.111 INFO:teuthology.orchestra.run.smithi177.stdout:2087 read 0x747388c thru 0x747ebb5 (0xb32a bytes) 2019-12-16T22:46:02.112 INFO:teuthology.orchestra.run.smithi177.stdout:2088 write 0x74d2720 thru 0x74daec8 (0x87a9 bytes) 2019-12-16T22:46:02.113 INFO:teuthology.orchestra.run.smithi177.stdout:2569 read 0x4eee7eb thru 0x4efbf9c (0xd7b2 bytes) 2019-12-16T22:46:02.113 INFO:teuthology.orchestra.run.smithi177.stdout:2570 write 0x6760d69 thru 0x6768798 (0x7a30 bytes) 2019-12-16T22:46:02.123 INFO:teuthology.orchestra.run.smithi177.stdout:2089 read 0x2e4434e thru 0x2e50e1b (0xcace bytes) 2019-12-16T22:46:02.124 INFO:teuthology.orchestra.run.smithi177.stdout:2092 punch from 0x9ff7651 to 0xa005976, (0xe325 bytes) 2019-12-16T22:46:02.124 INFO:teuthology.orchestra.run.smithi177.stdout:2093 clone 21 order 21 su 16384 sc 15 2019-12-16T22:46:02.124 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.140 INFO:teuthology.orchestra.run.smithi177.stdout:2573 trunc from 0xc7562b9 to 0x4fd8b1e 2019-12-16T22:46:02.152 INFO:teuthology.orchestra.run.smithi177.stdout:2235 write 0x83c090c thru 0x83d06e8 (0xfddd bytes) 2019-12-16T22:46:02.173 INFO:teuthology.orchestra.run.smithi177.stdout:2236 trunc from 0x83d06e9 to 0x2ca62e1 2019-12-16T22:46:02.199 INFO:teuthology.orchestra.run.smithi177.stdout:2574 write 0x9d48b82 thru 0x9d4b04c (0x24cb bytes) 2019-12-16T22:46:02.205 INFO:teuthology.orchestra.run.smithi177.stdout:2237 punch from 0x269aebb to 0x26a9275, (0xe3ba bytes) 2019-12-16T22:46:02.206 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.206 INFO:teuthology.orchestra.run.smithi177.stdout:2576 read 0xc20e6e thru 0xc29f93 (0x9126 bytes) 2019-12-16T22:46:02.208 INFO:teuthology.orchestra.run.smithi177.stdout:2578 punch from 0x1c01801 to 0x1c09ddc, (0x85db bytes) 2019-12-16T22:46:02.208 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.208 INFO:teuthology.orchestra.run.smithi177.stdout:2580 read 0x38e51e thru 0x39bc91 (0xd774 bytes) 2019-12-16T22:46:02.209 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.209 INFO:teuthology.orchestra.run.smithi177.stdout:2582 writesame 0x65c62b7 thru 0x65d4b8e data_size 0x4(0xe8d8 bytes) 2019-12-16T22:46:02.220 INFO:teuthology.orchestra.run.smithi177.stdout:2238 trunc from 0x2ca62e1 to 0xd0ce0fc 2019-12-16T22:46:02.229 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone15 from 0xb895769 (overlap 0x5233ab9) to 0x0 2019-12-16T22:46:02.231 INFO:teuthology.orchestra.run.smithi177.stdout:2583 trunc from 0x9d4b04d to 0xc032fd7 2019-12-16T22:46:02.250 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone16 from 0xac81fa8 (overlap 0x3ac4031) to 0x0 2019-12-16T22:46:02.254 INFO:teuthology.orchestra.run.smithi177.stdout:2239 writesame 0x24d3f9c thru 0x24e0332 data_size 0x17(0xc397 bytes) 2019-12-16T22:46:02.290 INFO:teuthology.orchestra.run.smithi177.stdout:2240 write 0x362da89 thru 0x3635277 (0x77ef bytes) 2019-12-16T22:46:02.295 INFO:teuthology.orchestra.run.smithi177.stdout:2584 punch from 0x29ee662 to 0x29fcd38, (0xe6d6 bytes) 2019-12-16T22:46:02.296 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.296 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.296 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.296 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.303 INFO:teuthology.orchestra.run.smithi177.stdout:2241 read 0xa328cda thru 0xa32d2d4 (0x45fb bytes) 2019-12-16T22:46:02.303 INFO:teuthology.orchestra.run.smithi177.stdout:2243 writesame 0x8fc0aae thru 0x8fc2ba9 data_size 0x2(0x20fc bytes) 2019-12-16T22:46:02.303 INFO:teuthology.orchestra.run.smithi177.stdout:2590 trunc from 0xc032fd7 to 0x7d75107 2019-12-16T22:46:02.318 INFO:teuthology.orchestra.run.smithi177.stdout:2249 write 0xbe8c54a thru 0xbe919f0 (0x54a7 bytes) 2019-12-16T22:46:02.336 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone17 from 0xc026c39 (overlap 0xbca108f) to 0xa9c421a 2019-12-16T22:46:02.338 INFO:teuthology.orchestra.run.smithi177.stdout:2251 read 0xb9bb1a0 thru 0xb9c8f7d (0xddde bytes) 2019-12-16T22:46:02.339 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.347 INFO:teuthology.orchestra.run.smithi177.stdout:2254 trunc from 0xd0ce0fc to 0x853591b 2019-12-16T22:46:02.365 INFO:teuthology.orchestra.run.smithi177.stdout:2591 trunc from 0x7d75107 to 0x9f66be6 2019-12-16T22:46:02.388 INFO:teuthology.orchestra.run.smithi177.stdout:2592 write 0x7194dc5 thru 0x71a243c (0xd678 bytes) 2019-12-16T22:46:02.388 INFO:teuthology.orchestra.run.smithi177.stdout:2255 read 0x200574d thru 0x200b1db (0x5a8f bytes) 2019-12-16T22:46:02.388 INFO:teuthology.orchestra.run.smithi177.stdout:2256 read 0x708c401 thru 0x7099977 (0xd577 bytes) 2019-12-16T22:46:02.401 INFO:teuthology.orchestra.run.smithi177.stdout:2257 trunc from 0x853591b to 0x12e93f6 2019-12-16T22:46:02.402 INFO:teuthology.orchestra.run.smithi177.stdout:2593 writesame 0x82880f9 thru 0x8294d39 data_size 0x1(0xcc41 bytes) 2019-12-16T22:46:02.442 INFO:teuthology.orchestra.run.smithi177.stdout:2594 trunc from 0x9f66be6 to 0xd29e855 2019-12-16T22:46:02.463 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.463 INFO:teuthology.orchestra.run.smithi177.stdout:2596 write 0x4a62877 thru 0x4a68a02 (0x618c bytes) 2019-12-16T22:46:02.463 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #14, image image_cluster1.client.mirror.2-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent15 2019-12-16T22:46:02.472 INFO:teuthology.orchestra.run.smithi177.stdout:2597 read 0x5eb126f thru 0x5eb25b6 (0x1348 bytes) 2019-12-16T22:46:02.472 INFO:teuthology.orchestra.run.smithi177.stdout:2598 write 0x7d0f4c8 thru 0x7d17306 (0x7e3f bytes) 2019-12-16T22:46:02.485 INFO:teuthology.orchestra.run.smithi177.stdout:2599 read 0x576b2e5 thru 0x5775614 (0xa330 bytes) 2019-12-16T22:46:02.485 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.486 INFO:teuthology.orchestra.run.smithi177.stdout:2602 punch from 0x82eff2a to 0x82ff4e8, (0xf5be bytes) 2019-12-16T22:46:02.486 INFO:teuthology.orchestra.run.smithi177.stdout:2608 read 0x827a70e thru 0x8281ac6 (0x73b9 bytes) 2019-12-16T22:46:02.491 INFO:teuthology.orchestra.run.smithi177.stdout:2258 write 0xd702b0b thru 0xd70756d (0x4a63 bytes) 2019-12-16T22:46:02.502 INFO:teuthology.orchestra.run.smithi177.stdout:1636 punch from 0x5ac3926 to 0x5acd10c, (0x97e6 bytes) 2019-12-16T22:46:02.507 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #15, image image_cluster1.client.mirror.4-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent16 2019-12-16T22:46:02.510 INFO:teuthology.orchestra.run.smithi177.stdout:2609 write 0xe41b62f thru 0xe41c6ee (0x10c0 bytes) 2019-12-16T22:46:02.518 INFO:teuthology.orchestra.run.smithi177.stdout:1639 read 0x4f73a90 thru 0x4f7a3d4 (0x6945 bytes) 2019-12-16T22:46:02.519 INFO:teuthology.orchestra.run.smithi177.stdout:1640 read 0x5763019 thru 0x576a036 (0x701e bytes) 2019-12-16T22:46:02.519 INFO:teuthology.orchestra.run.smithi177.stdout:1641 read 0x9d947c6 thru 0x9d95d46 (0x1581 bytes) 2019-12-16T22:46:02.523 INFO:teuthology.orchestra.run.smithi177.stdout:1642 trunc from 0xb895769 to 0x902549c 2019-12-16T22:46:02.526 INFO:teuthology.orchestra.run.smithi177.stdout:2611 trunc from 0xe41c6ef to 0xc14d050 2019-12-16T22:46:02.528 INFO:teuthology.orchestra.run.smithi177.stdout:2259 writesame 0xd907468 thru 0xd91321a data_size 0x1(0xbdb3 bytes) 2019-12-16T22:46:02.541 INFO:teuthology.orchestra.run.smithi177.stdout:2260 read 0x8e2b292 thru 0x8e36f23 (0xbc92 bytes) 2019-12-16T22:46:02.542 INFO:teuthology.orchestra.run.smithi177.stdout:2261 write 0xd09a06e thru 0xd0a4d0c (0xac9f bytes) 2019-12-16T22:46:02.574 INFO:teuthology.orchestra.run.smithi177.stdout:2262 trunc from 0xd91321b to 0x31f8b7d 2019-12-16T22:46:02.575 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.575 INFO:teuthology.orchestra.run.smithi177.stdout:1644 read 0x4e82250 thru 0x4e8f560 (0xd311 bytes) 2019-12-16T22:46:02.576 INFO:teuthology.orchestra.run.smithi177.stdout:1646 punch from 0x79fee75 to 0x7a06555, (0x76e0 bytes) 2019-12-16T22:46:02.577 INFO:teuthology.orchestra.run.smithi177.stdout:1647 writesame 0x5f8f6de thru 0x5f9f6d3 data_size 0x86(0xfff6 bytes) 2019-12-16T22:46:02.583 INFO:teuthology.orchestra.run.smithi177.stdout:1648 read 0x1faf748 thru 0x1fb1002 (0x18bb bytes) 2019-12-16T22:46:02.588 INFO:teuthology.orchestra.run.smithi177.stdout:1649 trunc from 0x902549c to 0xbfa0c38 2019-12-16T22:46:02.595 INFO:teuthology.orchestra.run.smithi177.stdout:2612 write 0xe204257 thru 0xe209f59 (0x5d03 bytes) 2019-12-16T22:46:02.607 INFO:teuthology.orchestra.run.smithi177.stdout:2263 punch from 0x82a1c6 to 0x8334d7, (0x9311 bytes) 2019-12-16T22:46:02.608 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.613 INFO:teuthology.orchestra.run.smithi177.stdout:2614 read 0x72f3804 thru 0x72f4369 (0xb66 bytes) 2019-12-16T22:46:02.614 INFO:teuthology.orchestra.run.smithi177.stdout:2615 punch from 0xaa298c2 to 0xaa2eed3, (0x5611 bytes) 2019-12-16T22:46:02.614 INFO:teuthology.orchestra.run.smithi177.stdout:2616 write 0x66f22af thru 0x66f4210 (0x1f62 bytes) 2019-12-16T22:46:02.617 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.618 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.618 INFO:teuthology.orchestra.run.smithi177.stdout:1652 punch from 0x57699a0 to 0x576d88b, (0x3eeb bytes) 2019-12-16T22:46:02.620 INFO:teuthology.orchestra.run.smithi177.stdout:2179 writesame 0xb48f607 thru 0xb49303c data_size 0x1(0x3a36 bytes) 2019-12-16T22:46:02.631 INFO:teuthology.orchestra.run.smithi177.stdout:2181 read 0x18d4e75 thru 0x18dcea1 (0x802d bytes) 2019-12-16T22:46:02.632 INFO:teuthology.orchestra.run.smithi177.stdout:1653 trunc from 0xbfa0c38 to 0x37dc994 2019-12-16T22:46:02.636 INFO:teuthology.orchestra.run.smithi177.stdout:2269 write 0x87e1135 thru 0x87e82a0 (0x716c bytes) 2019-12-16T22:46:02.642 INFO:teuthology.orchestra.run.smithi177.stdout:2617 trunc from 0xe209f5a to 0x7eb195d 2019-12-16T22:46:02.647 INFO:teuthology.orchestra.run.smithi177.stdout:2182 trunc from 0xb49303d to 0x5db2b51 2019-12-16T22:46:02.652 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.656 INFO:teuthology.orchestra.run.smithi177.stdout:2272 punch from 0x21117ba to 0x211efd9, (0xd81f bytes) 2019-12-16T22:46:02.657 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.657 INFO:teuthology.orchestra.run.smithi177.stdout:2275 write 0x211cb99 thru 0x212443d (0x78a5 bytes) 2019-12-16T22:46:02.695 INFO:teuthology.orchestra.run.smithi177.stdout:2276 trunc from 0x87e82a1 to 0x46e5d3 2019-12-16T22:46:02.697 INFO:teuthology.orchestra.run.smithi177.stdout:2620 write 0x4cf85d4 thru 0x4cfc663 (0x4090 bytes) 2019-12-16T22:46:02.716 INFO:teuthology.orchestra.run.smithi177.stdout:2621 writesame 0xafa842 thru 0xafbb20 data_size 0x1(0x12df bytes) 2019-12-16T22:46:02.723 INFO:teuthology.orchestra.run.smithi177.stdout:2183 read 0x4128b7c thru 0x413853e (0xf9c3 bytes) 2019-12-16T22:46:02.723 INFO:teuthology.orchestra.run.smithi177.stdout:2184 punch from 0x3b70498 to 0x3b780e6, (0x7c4e bytes) 2019-12-16T22:46:02.730 INFO:teuthology.orchestra.run.smithi177.stdout:2623 read 0x2f64a77 thru 0x2f73566 (0xeaf0 bytes) 2019-12-16T22:46:02.731 INFO:teuthology.orchestra.run.smithi177.stdout:2624 punch from 0x18a494d to 0x18b40de, (0xf791 bytes) 2019-12-16T22:46:02.731 INFO:teuthology.orchestra.run.smithi177.stdout:2625 write 0x2167458 thru 0x217544e (0xdff7 bytes) 2019-12-16T22:46:02.737 INFO:teuthology.orchestra.run.smithi177.stdout:2279 read 0x2734a8 thru 0x27f590 (0xc0e9 bytes) 2019-12-16T22:46:02.743 INFO:teuthology.orchestra.run.smithi177.stdout:2626 punch from 0x1634587 to 0x1639d2a, (0x57a3 bytes) 2019-12-16T22:46:02.744 INFO:teuthology.orchestra.run.smithi177.stdout:2628 writesame 0x4651f2f thru 0x46568be data_size 0x10(0x4990 bytes) 2019-12-16T22:46:02.747 INFO:teuthology.orchestra.run.smithi177.stdout:2185 write 0x7768757 thru 0x776c49b (0x3d45 bytes) 2019-12-16T22:46:02.752 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #16, image image_cluster1.client.mirror.3-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent17 2019-12-16T22:46:02.754 INFO:teuthology.orchestra.run.smithi177.stdout:2629 clone 16 order 19 su 8192 sc 3 2019-12-16T22:46:02.762 INFO:teuthology.orchestra.run.smithi177.stdout:1654 writesame 0xcdb83ca thru 0xcdc6dd7 data_size 0x1(0xea0e bytes) 2019-12-16T22:46:02.763 INFO:teuthology.orchestra.run.smithi177.stdout:1655 write 0x68926ab thru 0x68947c7 (0x211d bytes) 2019-12-16T22:46:02.770 INFO:teuthology.orchestra.run.smithi177.stdout:1656 write 0x5e33ed0 thru 0x5e3f9bd (0xbaee bytes) 2019-12-16T22:46:02.776 INFO:teuthology.orchestra.run.smithi177.stdout:2187 write 0x77e352b thru 0x77e7346 (0x3e1c bytes) 2019-12-16T22:46:02.776 INFO:teuthology.orchestra.run.smithi177.stdout:2281 write 0xe9ba1bd thru 0xe9c8d3f (0xeb83 bytes) 2019-12-16T22:46:02.780 INFO:teuthology.orchestra.run.smithi177.stdout:1659 punch from 0xa0bc6c1 to 0xa0caa28, (0xe367 bytes) 2019-12-16T22:46:02.780 INFO:teuthology.orchestra.run.smithi177.stdout:1660 write 0xa7f37d6 thru 0xa7f5505 (0x1d30 bytes) 2019-12-16T22:46:02.781 INFO:teuthology.orchestra.run.smithi177.stdout:2188 read 0x1c0ff98 thru 0x1c1fd41 (0xfdaa bytes) 2019-12-16T22:46:02.782 INFO:teuthology.orchestra.run.smithi177.stdout:2189 read 0x3a31bf8 thru 0x3a36cf2 (0x50fb bytes) 2019-12-16T22:46:02.783 INFO:teuthology.orchestra.run.smithi177.stdout:2191 write 0x12accb8 thru 0x12b96db (0xca24 bytes) 2019-12-16T22:46:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:1662 punch from 0x8284d8e to 0x8288eb3, (0x4125 bytes) 2019-12-16T22:46:02.788 INFO:teuthology.orchestra.run.smithi177.stdout:1663 read 0x2a30989 thru 0x2a3f8e0 (0xef58 bytes) 2019-12-16T22:46:02.789 INFO:teuthology.orchestra.run.smithi177.stdout:1664 write 0x87301ee thru 0x873fc70 (0xfa83 bytes) 2019-12-16T22:46:02.790 INFO:teuthology.orchestra.run.smithi177.stdout:2282 writesame 0x36c1324 thru 0x36c9d0e data_size 0x3(0x89eb bytes) 2019-12-16T22:46:02.802 INFO:teuthology.orchestra.run.smithi177.stdout:1667 punch from 0x571bd2d to 0x571dfbc, (0x228f bytes) 2019-12-16T22:46:02.804 INFO:teuthology.orchestra.run.smithi177.stdout:2192 punch from 0x2c21196 to 0x2c21db3, (0xc1d bytes) 2019-12-16T22:46:02.804 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.805 INFO:teuthology.orchestra.run.smithi177.stdout:2196 read 0x4b88ddc thru 0x4b8e078 (0x529d bytes) 2019-12-16T22:46:02.805 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.807 INFO:teuthology.orchestra.run.smithi177.stdout:2283 read 0xd9502 thru 0xdaeb7 (0x19b6 bytes) 2019-12-16T22:46:02.809 INFO:teuthology.orchestra.run.smithi177.stdout:2284 punch from 0x13b5324 to 0x13bba1b, (0x66f7 bytes) 2019-12-16T22:46:02.810 INFO:teuthology.orchestra.run.smithi177.stdout:2286 read 0x124182d thru 0x124ef93 (0xd767 bytes) 2019-12-16T22:46:02.810 INFO:teuthology.orchestra.run.smithi177.stdout:2287 read 0x6513d89 thru 0x65186f0 (0x4968 bytes) 2019-12-16T22:46:02.810 INFO:teuthology.orchestra.run.smithi177.stdout:2288 write 0x4eb2a4a thru 0x4eb7cf7 (0x52ae bytes) 2019-12-16T22:46:02.816 INFO:teuthology.orchestra.run.smithi177.stdout:2198 trunc from 0x77e7347 to 0xd75375f 2019-12-16T22:46:02.822 INFO:teuthology.orchestra.run.smithi177.stdout:1668 trunc from 0xcdc6dd8 to 0x3fa54db 2019-12-16T22:46:02.825 INFO:teuthology.orchestra.run.smithi177.stdout:2289 trunc from 0xe9c8d40 to 0xac01f1e 2019-12-16T22:46:02.839 INFO:teuthology.orchestra.run.smithi177.stdout:2199 writesame 0xa23ceec thru 0xa23e861 data_size 0x1(0x1976 bytes) 2019-12-16T22:46:02.849 INFO:teuthology.orchestra.run.smithi177.stdout:2200 write 0xc5103ec thru 0xc515b85 (0x579a bytes) 2019-12-16T22:46:02.856 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.863 INFO:teuthology.orchestra.run.smithi177.stdout:2201 writesame 0x2e88d71 thru 0x2e892ad data_size 0x3(0x53d bytes) 2019-12-16T22:46:02.868 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.868 INFO:teuthology.orchestra.run.smithi177.stdout:2203 read 0x3a9a57d thru 0x3a9b604 (0x1088 bytes) 2019-12-16T22:46:02.868 INFO:teuthology.orchestra.run.smithi177.stdout:2204 writesame 0xb973964 thru 0xb983719 data_size 0xf(0xfdb6 bytes) 2019-12-16T22:46:02.882 INFO:teuthology.orchestra.run.smithi177.stdout:2205 write 0x53edc19 thru 0x53f38f6 (0x5cde bytes) 2019-12-16T22:46:02.882 INFO:teuthology.orchestra.run.smithi177.stdout:1671 writesame 0x8440255 thru 0x8444771 data_size 0x1(0x451d bytes) 2019-12-16T22:46:02.883 INFO:teuthology.orchestra.run.smithi177.stdout:1672 read 0xdeda0 thru 0xe6bac (0x7e0d bytes) 2019-12-16T22:46:02.889 INFO:teuthology.orchestra.run.smithi177.stdout:2206 punch from 0x8b622f1 to 0x8b6ebe0, (0xc8ef bytes) 2019-12-16T22:46:02.889 INFO:teuthology.orchestra.run.smithi177.stdout:2207 writesame 0x3a03ae0 thru 0x3a0b8b9 data_size 0x59(0x7dda bytes) 2019-12-16T22:46:02.891 INFO:teuthology.orchestra.run.smithi177.stdout:2292 writesame 0xd9bebf7 thru 0xd9ca21c data_size 0x5(0xb626 bytes) 2019-12-16T22:46:02.896 INFO:teuthology.orchestra.run.smithi177.stdout:2293 read 0x3c6a409 thru 0x3c768dd (0xc4d5 bytes) 2019-12-16T22:46:02.896 INFO:teuthology.orchestra.run.smithi177.stdout:2294 punch from 0x170fd84 to 0x17184ac, (0x8728 bytes) 2019-12-16T22:46:02.897 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.897 INFO:teuthology.orchestra.run.smithi177.stdout:2296 write 0xa017b95 thru 0xa025be0 (0xe04c bytes) 2019-12-16T22:46:02.898 INFO:teuthology.orchestra.run.smithi177.stdout:1674 trunc from 0x8444772 to 0x1116d0d 2019-12-16T22:46:02.913 INFO:teuthology.orchestra.run.smithi177.stdout:2297 read 0x8014114 thru 0x8016701 (0x25ee bytes) 2019-12-16T22:46:02.913 INFO:teuthology.orchestra.run.smithi177.stdout:2300 write 0x8cad3b1 thru 0x8cb90e4 (0xbd34 bytes) 2019-12-16T22:46:02.929 INFO:teuthology.orchestra.run.smithi177.stdout:2301 write 0x577c81c thru 0x578538f (0x8b74 bytes) 2019-12-16T22:46:02.932 INFO:teuthology.orchestra.run.smithi177.stdout:2208 read 0x872ab86 thru 0x8734b76 (0x9ff1 bytes) 2019-12-16T22:46:02.933 INFO:teuthology.orchestra.run.smithi177.stdout:2209 writesame 0x7d85f5a thru 0x7d87978 data_size 0x3(0x1a1f bytes) 2019-12-16T22:46:02.941 INFO:teuthology.orchestra.run.smithi177.stdout:1675 punch from 0xa41611 to 0xa4e24e, (0xcc3d bytes) 2019-12-16T22:46:02.941 INFO:teuthology.orchestra.run.smithi177.stdout:1676 read 0x5a81e8 thru 0x5b13ea (0x9203 bytes) 2019-12-16T22:46:02.942 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.945 INFO:teuthology.orchestra.run.smithi177.stdout:2210 clone 18 order 18 su 4096 sc 10 2019-12-16T22:46:02.946 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:02.946 INFO:teuthology.orchestra.run.smithi177.stdout:2304 trunc from 0xd9ca21d to 0xdd594d4 2019-12-16T22:46:02.960 INFO:teuthology.orchestra.run.smithi177.stdout:1678 write 0x167358c thru 0x1676fb1 (0x3a26 bytes) 2019-12-16T22:46:02.967 INFO:teuthology.orchestra.run.smithi177.stdout:2305 read 0xa11bc6e thru 0xa1258a5 (0x9c38 bytes) 2019-12-16T22:46:02.968 INFO:teuthology.orchestra.run.smithi177.stdout:2306 read 0x575b0c8 thru 0x5760b2a (0x5a63 bytes) 2019-12-16T22:46:02.968 INFO:teuthology.orchestra.run.smithi177.stdout:2307 write 0x5a8cc11 thru 0x5a99ed3 (0xd2c3 bytes) 2019-12-16T22:46:02.968 INFO:teuthology.orchestra.run.smithi177.stdout:1679 read 0xde40cb thru 0xde8964 (0x489a bytes) 2019-12-16T22:46:02.994 INFO:teuthology.orchestra.run.smithi177.stdout:2308 writesame 0xc75ee01 thru 0xc7666c6 data_size 0x3(0x78c6 bytes) 2019-12-16T22:46:03.010 INFO:teuthology.orchestra.run.smithi177.stdout:1680 writesame 0x620e4c4 thru 0x6218d09 data_size 0x77(0xa846 bytes) 2019-12-16T22:46:03.014 INFO:teuthology.orchestra.run.smithi177.stdout:2309 read 0x97a4614 thru 0x97b0a86 (0xc473 bytes) 2019-12-16T22:46:03.014 INFO:teuthology.orchestra.run.smithi177.stdout:2310 read 0xa3a4a03 thru 0xa3ab245 (0x6843 bytes) 2019-12-16T22:46:03.016 INFO:teuthology.orchestra.run.smithi177.stdout:2311 write 0x92ff848 thru 0x9304a30 (0x51e9 bytes) 2019-12-16T22:46:03.016 INFO:teuthology.orchestra.run.smithi177.stdout:1681 writesame 0x37a64ab thru 0x37aca73 data_size 0x1(0x65c9 bytes) 2019-12-16T22:46:03.044 INFO:teuthology.orchestra.run.smithi177.stdout:1682 write 0x4ff1e00 thru 0x4ff4322 (0x2523 bytes) 2019-12-16T22:46:03.055 INFO:teuthology.orchestra.run.smithi177.stdout:1683 writesame 0x25ec916 thru 0x25fadc5 data_size 0x8(0xe4b0 bytes) 2019-12-16T22:46:03.066 INFO:teuthology.orchestra.run.smithi177.stdout:1684 read 0x4775a12 thru 0x477bb4e (0x613d bytes) 2019-12-16T22:46:03.067 INFO:teuthology.orchestra.run.smithi177.stdout:1685 read 0x107bd6c thru 0x108172c (0x59c1 bytes) 2019-12-16T22:46:03.068 INFO:teuthology.orchestra.run.smithi177.stdout:1686 read 0x21dc6ac thru 0x21e3aaa (0x73ff bytes) 2019-12-16T22:46:03.068 INFO:teuthology.orchestra.run.smithi177.stdout:1687 read 0x44cbda0 thru 0x44cda2a (0x1c8b bytes) 2019-12-16T22:46:03.069 INFO:teuthology.orchestra.run.smithi177.stdout:1689 write 0xcef976 thru 0xcf167d (0x1d08 bytes) 2019-12-16T22:46:03.075 INFO:teuthology.orchestra.run.smithi177.stdout:1690 writesame 0x600742b thru 0x6008a2a data_size 0x10(0x1600 bytes) 2019-12-16T22:46:03.076 INFO:teuthology.orchestra.run.smithi177.stdout:2313 trunc from 0xdd594d4 to 0x28e709c 2019-12-16T22:46:03.086 INFO:teuthology.orchestra.run.smithi177.stdout:1691 read 0x24cfd77 thru 0x24db8a9 (0xbb33 bytes) 2019-12-16T22:46:03.086 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.086 INFO:teuthology.orchestra.run.smithi177.stdout:1693 punch from 0x4eeba43 to 0x4eeea24, (0x2fe1 bytes) 2019-12-16T22:46:03.086 INFO:teuthology.orchestra.run.smithi177.stdout:1694 read 0x469fd99 thru 0x46ac0f6 (0xc35e bytes) 2019-12-16T22:46:03.088 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.088 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.088 INFO:teuthology.orchestra.run.smithi177.stdout:1701 punch from 0x6184ec6 to 0x618f5fe, (0xa738 bytes) 2019-12-16T22:46:03.091 INFO:teuthology.orchestra.run.smithi177.stdout:1702 trunc from 0x6218d0a to 0x8425e2f 2019-12-16T22:46:03.117 INFO:teuthology.orchestra.run.smithi177.stdout:1703 write 0x66807a6 thru 0x6685a82 (0x52dd bytes) 2019-12-16T22:46:03.120 INFO:teuthology.orchestra.run.smithi177.stdout:2314 read 0x124e0b0 thru 0x1256877 (0x87c8 bytes) 2019-12-16T22:46:03.120 INFO:teuthology.orchestra.run.smithi177.stdout:2315 read 0x13165f9 thru 0x131f381 (0x8d89 bytes) 2019-12-16T22:46:03.133 INFO:teuthology.orchestra.run.smithi177.stdout:2316 trunc from 0x28e709c to 0x8ac7fb9 2019-12-16T22:46:03.133 INFO:teuthology.orchestra.run.smithi177.stdout:1704 trunc from 0x8425e2f to 0xc0fc89d 2019-12-16T22:46:03.140 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.1-clone15 from 0x7eb195d (overlap 0x1e29434) to 0x1218c1f 2019-12-16T22:46:03.155 INFO:teuthology.orchestra.run.smithi177.stdout:1937 trunc from 0xc026c39 to 0x7967e86 2019-12-16T22:46:03.156 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.156 INFO:teuthology.orchestra.run.smithi177.stdout:2319 read 0x881409 thru 0x88d639 (0xc231 bytes) 2019-12-16T22:46:03.156 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.163 INFO:teuthology.orchestra.run.smithi177.stdout:1705 read 0x5db6d64 thru 0x5dc5f5b (0xf1f8 bytes) 2019-12-16T22:46:03.164 INFO:teuthology.orchestra.run.smithi177.stdout:2323 trunc from 0x8ac7fb9 to 0xcbe6546 2019-12-16T22:46:03.164 INFO:teuthology.orchestra.run.smithi177.stdout:1706 write 0x18c7132 thru 0x18d37a8 (0xc677 bytes) 2019-12-16T22:46:03.180 INFO:teuthology.orchestra.run.smithi177.stdout:1707 punch from 0x79fd28 to 0x7a5f4c, (0x6224 bytes) 2019-12-16T22:46:03.180 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.180 INFO:teuthology.orchestra.run.smithi177.stdout:1709 write 0x413361c thru 0x413392e (0x313 bytes) 2019-12-16T22:46:03.187 INFO:teuthology.orchestra.run.smithi177.stdout:1711 read 0x111cfa6 thru 0x1128cd7 (0xbd32 bytes) 2019-12-16T22:46:03.209 INFO:teuthology.orchestra.run.smithi177.stdout:1712 trunc from 0xc0fc89d to 0x2411f6 2019-12-16T22:46:03.227 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.227 INFO:teuthology.orchestra.run.smithi177.stdout:2326 punch from 0x6e2f2d5 to 0x6e3df5c, (0xec87 bytes) 2019-12-16T22:46:03.228 INFO:teuthology.orchestra.run.smithi177.stdout:2328 write 0x336572 thru 0x3423cd (0xbe5c bytes) 2019-12-16T22:46:03.255 INFO:teuthology.orchestra.run.smithi177.stdout:2331 read 0x4910e11 thru 0x4915338 (0x4528 bytes) 2019-12-16T22:46:03.266 INFO:teuthology.orchestra.run.smithi177.stdout:2332 trunc from 0xcbe6546 to 0x5add4b0 2019-12-16T22:46:03.270 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone17 from 0xd75375f (overlap 0x5db2b51) to 0x0 2019-12-16T22:46:03.345 INFO:teuthology.orchestra.run.smithi177.stdout:1718 trunc from 0x2411f6 to 0x75ba4e8 2019-12-16T22:46:03.355 INFO:teuthology.orchestra.run.smithi177.stdout:2334 write 0x287e4a5 thru 0x287f663 (0x11bf bytes) 2019-12-16T22:46:03.528 INFO:teuthology.orchestra.run.smithi177.stdout:2335 read 0x1b1bd43 thru 0x1b2b739 (0xf9f7 bytes) 2019-12-16T22:46:03.530 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #19, image image_cluster1.client.mirror.0-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent20 2019-12-16T22:46:03.530 INFO:teuthology.orchestra.run.smithi177.stdout:2336 write 0x4a03ea3 thru 0x4a12885 (0xe9e3 bytes) 2019-12-16T22:46:03.553 INFO:teuthology.orchestra.run.smithi177.stdout:2337 read 0x3fdcb61 thru 0x3fec1be (0xf65e bytes) 2019-12-16T22:46:03.560 INFO:teuthology.orchestra.run.smithi177.stdout:1720 writesame 0x2ebd22c thru 0x2ec0d37 data_size 0x2(0x3b0c bytes) 2019-12-16T22:46:03.563 INFO:teuthology.orchestra.run.smithi177.stdout:2338 trunc from 0x5add4b0 to 0x1526a20 2019-12-16T22:46:03.566 INFO:teuthology.orchestra.run.smithi177.stdout:1938 read 0x676d3af thru 0x677b182 (0xddd4 bytes) 2019-12-16T22:46:03.567 INFO:teuthology.orchestra.run.smithi177.stdout:1939 read 0x43d4535 thru 0x43d6b67 (0x2633 bytes) 2019-12-16T22:46:03.568 INFO:teuthology.orchestra.run.smithi177.stdout:1940 read 0x696a0da thru 0x6972b2e (0x8a55 bytes) 2019-12-16T22:46:03.569 INFO:teuthology.orchestra.run.smithi177.stdout:1721 punch from 0xe22bc3 to 0xe2cf29, (0xa366 bytes) 2019-12-16T22:46:03.570 INFO:teuthology.orchestra.run.smithi177.stdout:1722 read 0x1e56b36 thru 0x1e5e7be (0x7c89 bytes) 2019-12-16T22:46:03.570 INFO:teuthology.orchestra.run.smithi177.stdout:1941 read 0x870c1d thru 0x879dc3 (0x91a7 bytes) 2019-12-16T22:46:03.571 INFO:teuthology.orchestra.run.smithi177.stdout:1723 read 0x4175cc7 thru 0x4182acd (0xce07 bytes) 2019-12-16T22:46:03.571 INFO:teuthology.orchestra.run.smithi177.stdout:1724 write 0x6117944 thru 0x612621d (0xe8da bytes) 2019-12-16T22:46:03.571 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.571 INFO:teuthology.orchestra.run.smithi177.stdout:1944 punch from 0x3b53fa3 to 0x3b57b98, (0x3bf5 bytes) 2019-12-16T22:46:03.571 INFO:teuthology.orchestra.run.smithi177.stdout:1945 write 0x53347f8 thru 0x5342883 (0xe08c bytes) 2019-12-16T22:46:03.588 INFO:teuthology.orchestra.run.smithi177.stdout:1725 clone 17 order 25 su 2097152 sc 10 2019-12-16T22:46:03.608 INFO:teuthology.orchestra.run.smithi177.stdout:1947 write 0x847ec4b thru 0x848cbdb (0xdf91 bytes) 2019-12-16T22:46:03.615 INFO:teuthology.orchestra.run.smithi177.stdout:2094 trunc from 0xe6a648f to 0x2a8754b 2019-12-16T22:46:03.616 INFO:teuthology.orchestra.run.smithi177.stdout:1948 punch from 0x348a218 to 0x348c9d9, (0x27c1 bytes) 2019-12-16T22:46:03.616 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.616 INFO:teuthology.orchestra.run.smithi177.stdout:1952 read 0x7cfde8 thru 0x7da6f3 (0xa90c bytes) 2019-12-16T22:46:03.616 INFO:teuthology.orchestra.run.smithi177.stdout:1953 read 0x33de17d thru 0x33e93e8 (0xb26c bytes) 2019-12-16T22:46:03.617 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.618 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.618 INFO:teuthology.orchestra.run.smithi177.stdout:1957 read 0x494e696 thru 0x495321b (0x4b86 bytes) 2019-12-16T22:46:03.619 INFO:teuthology.orchestra.run.smithi177.stdout:1959 writesame 0x44caec8 thru 0x44d0f8e data_size 0x5(0x60c7 bytes) 2019-12-16T22:46:03.629 INFO:teuthology.orchestra.run.smithi177.stdout:1961 read 0x2ff9908 thru 0x300422a (0xa923 bytes) 2019-12-16T22:46:03.630 INFO:teuthology.orchestra.run.smithi177.stdout:1962 write 0x112f2e6 thru 0x1132e34 (0x3b4f bytes) 2019-12-16T22:46:03.634 INFO:teuthology.orchestra.run.smithi177.stdout:1963 punch from 0x44e12c0 to 0x44e8395, (0x70d5 bytes) 2019-12-16T22:46:03.635 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #14, image image_cluster1.client.mirror.1-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent15 2019-12-16T22:46:03.642 INFO:teuthology.orchestra.run.smithi177.stdout:2339 writesame 0xc4732e2 thru 0xc47dc74 data_size 0x1(0xa993 bytes) 2019-12-16T22:46:03.645 INFO:teuthology.orchestra.run.smithi177.stdout:2340 punch from 0x9202bac to 0x9208610, (0x5a64 bytes) 2019-12-16T22:46:03.645 INFO:teuthology.orchestra.run.smithi177.stdout:2341 read 0x87b6b64 thru 0x87bc703 (0x5ba0 bytes) 2019-12-16T22:46:03.658 INFO:teuthology.orchestra.run.smithi177.stdout:2342 trunc from 0xc47dc75 to 0x5d8fd14 2019-12-16T22:46:03.658 INFO:teuthology.orchestra.run.smithi177.stdout:1964 write 0xa8f0a44 thru 0xa8f6cd3 (0x6290 bytes) 2019-12-16T22:46:03.668 INFO:teuthology.orchestra.run.smithi177.stdout:1965 write 0x2363537 thru 0x236e487 (0xaf51 bytes) 2019-12-16T22:46:03.677 INFO:teuthology.orchestra.run.smithi177.stdout:1966 read 0x33bdf2 thru 0x34510b (0x931a bytes) 2019-12-16T22:46:03.679 INFO:teuthology.orchestra.run.smithi177.stdout:1970 read 0x7bae6cc thru 0x7bba459 (0xbd8e bytes) 2019-12-16T22:46:03.679 INFO:teuthology.orchestra.run.smithi177.stdout:1971 writesame 0x6b0618e thru 0x6b0ed6d data_size 0x30(0x8be0 bytes) 2019-12-16T22:46:03.687 INFO:teuthology.orchestra.run.smithi177.stdout:1972 punch from 0x2d7c68 to 0x2d968b, (0x1a23 bytes) 2019-12-16T22:46:03.690 INFO:teuthology.orchestra.run.smithi177.stdout:2343 write 0x3aba5c7 thru 0x3ac4e72 (0xa8ac bytes) 2019-12-16T22:46:03.693 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #16, image image_cluster1.client.mirror.4-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent17 2019-12-16T22:46:03.718 INFO:teuthology.orchestra.run.smithi177.stdout:2344 trunc from 0x5d8fd14 to 0xb450ac7 2019-12-16T22:46:03.718 INFO:teuthology.orchestra.run.smithi177.stdout:1973 write 0xc364254 thru 0xc36f067 (0xae14 bytes) 2019-12-16T22:46:03.725 INFO:teuthology.orchestra.run.smithi177.stdout:2095 trunc from 0x2a8754b to 0x7ad519f 2019-12-16T22:46:03.726 INFO:teuthology.orchestra.run.smithi177.stdout:1974 write 0x5cb0294 thru 0x5cb8f74 (0x8ce1 bytes) 2019-12-16T22:46:03.739 INFO:teuthology.orchestra.run.smithi177.stdout:2211 write 0x602fbe4 thru 0x603cec4 (0xd2e1 bytes) 2019-12-16T22:46:03.739 INFO:teuthology.orchestra.run.smithi177.stdout:1975 punch from 0x50b32f3 to 0x50b6d65, (0x3a72 bytes) 2019-12-16T22:46:03.739 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.739 INFO:teuthology.orchestra.run.smithi177.stdout:1979 read 0x9bc8ecc thru 0x9bd6654 (0xd789 bytes) 2019-12-16T22:46:03.739 INFO:teuthology.orchestra.run.smithi177.stdout:1980 write 0x477e474 thru 0x4782ebd (0x4a4a bytes) 2019-12-16T22:46:03.746 INFO:teuthology.orchestra.run.smithi177.stdout:1981 writesame 0x62378e3 thru 0x623bfa7 data_size 0x3d(0x46c5 bytes) 2019-12-16T22:46:03.747 INFO:teuthology.orchestra.run.smithi177.stdout:2346 punch from 0x1726ea5 to 0x172edce, (0x7f29 bytes) 2019-12-16T22:46:03.747 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.747 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.747 INFO:teuthology.orchestra.run.smithi177.stdout:2351 write 0x744d688 thru 0x7455e38 (0x87b1 bytes) 2019-12-16T22:46:03.756 INFO:teuthology.orchestra.run.smithi177.stdout:2098 read 0x6e831ce thru 0x6e8a6d5 (0x7508 bytes) 2019-12-16T22:46:03.756 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.757 INFO:teuthology.orchestra.run.smithi177.stdout:2100 punch from 0x24eeab to 0x24fec5, (0x101a bytes) 2019-12-16T22:46:03.757 INFO:teuthology.orchestra.run.smithi177.stdout:1982 read 0x5ca70af thru 0x5cab3b3 (0x4305 bytes) 2019-12-16T22:46:03.765 INFO:teuthology.orchestra.run.smithi177.stdout:2353 punch from 0x89036c to 0x8934c1, (0x3155 bytes) 2019-12-16T22:46:03.766 INFO:teuthology.orchestra.run.smithi177.stdout:2354 read 0x8dd8c75 thru 0x8ddbff9 (0x3385 bytes) 2019-12-16T22:46:03.766 INFO:teuthology.orchestra.run.smithi177.stdout:2356 punch from 0x5f009d to 0x5fa3c4, (0xa327 bytes) 2019-12-16T22:46:03.766 INFO:teuthology.orchestra.run.smithi177.stdout:2357 read 0xaa3d1c6 thru 0xaa453b3 (0x81ee bytes) 2019-12-16T22:46:03.766 INFO:teuthology.orchestra.run.smithi177.stdout:2360 write 0x5dc1202 thru 0x5dcd6be (0xc4bd bytes) 2019-12-16T22:46:03.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.786 INFO:teuthology.orchestra.run.smithi177.stdout:1986 write 0xccea93a thru 0xcceb69f (0xd66 bytes) 2019-12-16T22:46:03.786 INFO:teuthology.orchestra.run.smithi177.stdout:2102 write 0xa30e240 thru 0xa31afea (0xcdab bytes) 2019-12-16T22:46:03.793 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.793 INFO:teuthology.orchestra.run.smithi177.stdout:1988 punch from 0x196a3af to 0x197788e, (0xd4df bytes) 2019-12-16T22:46:03.793 INFO:teuthology.orchestra.run.smithi177.stdout:1990 read 0xb513738 thru 0xb51753e (0x3e07 bytes) 2019-12-16T22:46:03.794 INFO:teuthology.orchestra.run.smithi177.stdout:1991 punch from 0xaec298b to 0xaecb8b9, (0x8f2e bytes) 2019-12-16T22:46:03.794 INFO:teuthology.orchestra.run.smithi177.stdout:1992 read 0x328f6b2 thru 0x329d53c (0xde8b bytes) 2019-12-16T22:46:03.794 INFO:teuthology.orchestra.run.smithi177.stdout:1993 read 0x5d9cc8c thru 0x5da29e1 (0x5d56 bytes) 2019-12-16T22:46:03.797 INFO:teuthology.orchestra.run.smithi177.stdout:1994 punch from 0x6aacebc to 0x6aae2c0, (0x1404 bytes) 2019-12-16T22:46:03.797 INFO:teuthology.orchestra.run.smithi177.stdout:1995 writesame 0x3b14370 thru 0x3b1d9f2 data_size 0x1(0x9683 bytes) 2019-12-16T22:46:03.800 INFO:teuthology.orchestra.run.smithi177.stdout:2362 writesame 0xb5978b6 thru 0xb5a2087 data_size 0x1(0xa7d2 bytes) 2019-12-16T22:46:03.803 INFO:teuthology.orchestra.run.smithi177.stdout:2103 write 0x5333d79 thru 0x5339254 (0x54dc bytes) 2019-12-16T22:46:03.804 INFO:teuthology.orchestra.run.smithi177.stdout:2363 punch from 0xa9f405d to 0xaa01f2a, (0xdecd bytes) 2019-12-16T22:46:03.804 INFO:teuthology.orchestra.run.smithi177.stdout:2364 writesame 0x8444110 thru 0x8450dde data_size 0x1(0xcccf bytes) 2019-12-16T22:46:03.826 INFO:teuthology.orchestra.run.smithi177.stdout:2104 punch from 0x2a7e948 to 0x2a8893f, (0x9ff7 bytes) 2019-12-16T22:46:03.826 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.826 INFO:teuthology.orchestra.run.smithi177.stdout:2106 punch from 0x7b73fcc to 0x7b78974, (0x49a8 bytes) 2019-12-16T22:46:03.834 INFO:teuthology.orchestra.run.smithi177.stdout:2108 trunc from 0xa31afeb to 0xd22bc46 2019-12-16T22:46:03.834 INFO:teuthology.orchestra.run.smithi177.stdout:1996 read 0x3707fc thru 0x37e9cc (0xe1d1 bytes) 2019-12-16T22:46:03.835 INFO:teuthology.orchestra.run.smithi177.stdout:1998 writesame 0xbd8abf0 thru 0xbd98770 data_size 0x1(0xdb81 bytes) 2019-12-16T22:46:03.867 INFO:teuthology.orchestra.run.smithi177.stdout:2109 trunc from 0xd22bc46 to 0xa77a488 2019-12-16T22:46:03.874 INFO:teuthology.orchestra.run.smithi177.stdout:2213 read 0x56dcb20 thru 0x56dd46d (0x94e bytes) 2019-12-16T22:46:03.874 INFO:teuthology.orchestra.run.smithi177.stdout:2215 write 0xcaacfb6 thru 0xcab295a (0x59a5 bytes) 2019-12-16T22:46:03.894 INFO:teuthology.orchestra.run.smithi177.stdout:2365 write 0x7690d11 thru 0x7695f30 (0x5220 bytes) 2019-12-16T22:46:03.894 INFO:teuthology.orchestra.run.smithi177.stdout:1999 punch from 0x8c2df7e to 0x8c3dc69, (0xfceb bytes) 2019-12-16T22:46:03.895 INFO:teuthology.orchestra.run.smithi177.stdout:2000 read 0x52562e3 thru 0x525df26 (0x7c44 bytes) 2019-12-16T22:46:03.895 INFO:teuthology.orchestra.run.smithi177.stdout:2001 read 0x69c9cd2 thru 0x69d6382 (0xc6b1 bytes) 2019-12-16T22:46:03.898 INFO:teuthology.orchestra.run.smithi177.stdout:2002 read 0x5e80b83 thru 0x5e895f4 (0x8a72 bytes) 2019-12-16T22:46:03.898 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.899 INFO:teuthology.orchestra.run.smithi177.stdout:2005 write 0x3ba295c thru 0x3bb00f5 (0xd79a bytes) 2019-12-16T22:46:03.904 INFO:teuthology.orchestra.run.smithi177.stdout:2110 read 0x3b5ce thru 0x44d58 (0x978b bytes) 2019-12-16T22:46:03.905 INFO:teuthology.orchestra.run.smithi177.stdout:2367 read 0x4709807 thru 0x4719798 (0xff92 bytes) 2019-12-16T22:46:03.905 INFO:teuthology.orchestra.run.smithi177.stdout:2368 read 0x51858e thru 0x51d81d (0x5290 bytes) 2019-12-16T22:46:03.906 INFO:teuthology.orchestra.run.smithi177.stdout:2370 punch from 0x4351ccf to 0x435c75b, (0xaa8c bytes) 2019-12-16T22:46:03.906 INFO:teuthology.orchestra.run.smithi177.stdout:2371 writesame 0x8043d88 thru 0x804d9d8 data_size 0x1(0x9c51 bytes) 2019-12-16T22:46:03.908 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.908 INFO:teuthology.orchestra.run.smithi177.stdout:2112 writesame 0x1fa5c8d thru 0x1faddbf data_size 0x69(0x8133 bytes) 2019-12-16T22:46:03.910 INFO:teuthology.orchestra.run.smithi177.stdout:2006 read 0x11f02a1 thru 0x11f9aee (0x984e bytes) 2019-12-16T22:46:03.912 INFO:teuthology.orchestra.run.smithi177.stdout:2007 writesame 0x42ab174 thru 0x42b2333 data_size 0x8c(0x71c0 bytes) 2019-12-16T22:46:03.924 INFO:teuthology.orchestra.run.smithi177.stdout:2218 write 0xa820dd2 thru 0xa825666 (0x4895 bytes) 2019-12-16T22:46:03.930 INFO:teuthology.orchestra.run.smithi177.stdout:2008 write 0x1ac7fc thru 0x1b31dd (0x69e2 bytes) 2019-12-16T22:46:03.937 INFO:teuthology.orchestra.run.smithi177.stdout:2009 read 0x6b66650 thru 0x6b6f9a7 (0x9358 bytes) 2019-12-16T22:46:03.938 INFO:teuthology.orchestra.run.smithi177.stdout:2010 write 0x731d6c9 thru 0x732366d (0x5fa5 bytes) 2019-12-16T22:46:03.939 INFO:teuthology.orchestra.run.smithi177.stdout:2372 trunc from 0xb5a2088 to 0x8695fc7 2019-12-16T22:46:03.942 INFO:teuthology.orchestra.run.smithi177.stdout:2113 trunc from 0xa77a488 to 0x1dae6cb 2019-12-16T22:46:03.947 INFO:teuthology.orchestra.run.smithi177.stdout:2012 write 0xcc63887 thru 0xcc638be (0x38 bytes) 2019-12-16T22:46:03.955 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.956 INFO:teuthology.orchestra.run.smithi177.stdout:2015 read 0x41bc78 thru 0x41dc33 (0x1fbc bytes) 2019-12-16T22:46:03.956 INFO:teuthology.orchestra.run.smithi177.stdout:2017 punch from 0x6c40f60 to 0x6c49378, (0x8418 bytes) 2019-12-16T22:46:03.971 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:03.971 INFO:teuthology.orchestra.run.smithi177.stdout:2374 write 0x397c07d thru 0x3980519 (0x449d bytes) 2019-12-16T22:46:03.974 INFO:teuthology.orchestra.run.smithi177.stdout:2018 trunc from 0xcceb6a0 to 0x3a0697 2019-12-16T22:46:03.995 INFO:teuthology.orchestra.run.smithi177.stdout:2630 write 0x4df8e4b thru 0x4df95fa (0x7b0 bytes) 2019-12-16T22:46:04.047 INFO:teuthology.orchestra.run.smithi177.stdout:2375 writesame 0x95b2b9 thru 0x968665 data_size 0x51(0xd3ad bytes) 2019-12-16T22:46:04.095 INFO:teuthology.orchestra.run.smithi177.stdout:2021 punch from 0x2cba9e to 0x2d18ca, (0x5e2c bytes) 2019-12-16T22:46:04.112 INFO:teuthology.orchestra.run.smithi177.stdout:2633 punch from 0x77a5ab9 to 0x77aabc2, (0x5109 bytes) 2019-12-16T22:46:04.175 INFO:teuthology.orchestra.run.smithi177.stdout:2376 trunc from 0x8695fc7 to 0x1cb57fc 2019-12-16T22:46:04.200 INFO:teuthology.orchestra.run.smithi177.stdout:2219 read 0x9337228 thru 0x9346b86 (0xf95f bytes) 2019-12-16T22:46:04.200 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.201 INFO:teuthology.orchestra.run.smithi177.stdout:2223 write 0xa7ab657 thru 0xa7b65d5 (0xaf7f bytes) 2019-12-16T22:46:04.205 INFO:teuthology.orchestra.run.smithi177.stdout:2022 writesame 0x7056b7d thru 0x7064abb data_size 0x1(0xdf3f bytes) 2019-12-16T22:46:04.306 INFO:teuthology.orchestra.run.smithi177.stdout:2023 trunc from 0x7064abc to 0xbf29ac0 2019-12-16T22:46:04.432 INFO:teuthology.orchestra.run.smithi177.stdout:2224 write 0xa7c5dd1 thru 0xa7cf6ff (0x992f bytes) 2019-12-16T22:46:04.458 INFO:teuthology.orchestra.run.smithi177.stdout:2634 writesame 0xaa0e097 thru 0xaa1573c data_size 0x1(0x76a6 bytes) 2019-12-16T22:46:04.463 INFO:teuthology.orchestra.run.smithi177.stdout:2225 punch from 0x2554555 to 0x2561a45, (0xd4f0 bytes) 2019-12-16T22:46:04.463 INFO:teuthology.orchestra.run.smithi177.stdout:2226 write 0x315137 thru 0x320c89 (0xbb53 bytes) 2019-12-16T22:46:04.478 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.485 INFO:teuthology.orchestra.run.smithi177.stdout:2636 trunc from 0xaa1573d to 0xe44dc10 2019-12-16T22:46:04.520 INFO:teuthology.orchestra.run.smithi177.stdout:2024 read 0x8cd52e0 thru 0x8ce0065 (0xad86 bytes) 2019-12-16T22:46:04.520 INFO:teuthology.orchestra.run.smithi177.stdout:2025 punch from 0xab2f937 to 0xab31a5a, (0x2123 bytes) 2019-12-16T22:46:04.521 INFO:teuthology.orchestra.run.smithi177.stdout:2026 writesame 0x4a3efb5 thru 0x4a4a588 data_size 0x36(0xb5d4 bytes) 2019-12-16T22:46:04.550 INFO:teuthology.orchestra.run.smithi177.stdout:2027 write 0x7e63e97 thru 0x7e68916 (0x4a80 bytes) 2019-12-16T22:46:04.598 INFO:teuthology.orchestra.run.smithi177.stdout:2639 write 0x9ff95af thru 0x9fff87e (0x62d0 bytes) 2019-12-16T22:46:04.624 INFO:teuthology.orchestra.run.smithi177.stdout:2028 write 0xdae2dda thru 0xdae6b19 (0x3d40 bytes) 2019-12-16T22:46:04.624 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone16 from 0x75ba4e8 (overlap 0x2411f6) to 0x0 2019-12-16T22:46:04.653 INFO:teuthology.orchestra.run.smithi177.stdout:2029 writesame 0x1ba1d2c thru 0x1ba6784 data_size 0x1(0x4a59 bytes) 2019-12-16T22:46:04.682 INFO:teuthology.orchestra.run.smithi177.stdout:2030 read 0xc20aaa thru 0xc2b8e5 (0xae3c bytes) 2019-12-16T22:46:04.683 INFO:teuthology.orchestra.run.smithi177.stdout:2031 read 0x2b2fff2 thru 0x2b3506d (0x507c bytes) 2019-12-16T22:46:04.692 INFO:teuthology.orchestra.run.smithi177.stdout:2377 writesame 0x2b58fbd thru 0x2b662e4 data_size 0x3a(0xd328 bytes) 2019-12-16T22:46:04.692 INFO:teuthology.orchestra.run.smithi177.stdout:2640 read 0x95fc654 thru 0x95fcc9f (0x64c bytes) 2019-12-16T22:46:04.692 INFO:teuthology.orchestra.run.smithi177.stdout:2641 read 0xe2da029 thru 0xe2dea72 (0x4a4a bytes) 2019-12-16T22:46:04.692 INFO:teuthology.orchestra.run.smithi177.stdout:2643 write 0x29d220b thru 0x29ddc6b (0xba61 bytes) 2019-12-16T22:46:04.695 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.704 INFO:teuthology.orchestra.run.smithi177.stdout:2032 trunc from 0xdae6b1a to 0x31c892a 2019-12-16T22:46:04.720 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.720 INFO:teuthology.orchestra.run.smithi177.stdout:2647 read 0x8c35f74 thru 0x8c3ba29 (0x5ab6 bytes) 2019-12-16T22:46:04.720 INFO:teuthology.orchestra.run.smithi177.stdout:2648 write 0x151ab70 thru 0x15226cf (0x7b60 bytes) 2019-12-16T22:46:04.747 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.747 INFO:teuthology.orchestra.run.smithi177.stdout:2034 read 0x3a51cd thru 0x3abfac (0x6de0 bytes) 2019-12-16T22:46:04.768 INFO:teuthology.orchestra.run.smithi177.stdout:2036 trunc from 0x31c892a to 0xca6dd73 2019-12-16T22:46:04.788 INFO:teuthology.orchestra.run.smithi177.stdout:2380 write 0x73d09db thru 0x73d26e9 (0x1d0f bytes) 2019-12-16T22:46:04.789 INFO:teuthology.orchestra.run.smithi177.stdout:2381 write 0x50706f9 thru 0x507d675 (0xcf7d bytes) 2019-12-16T22:46:04.797 INFO:teuthology.orchestra.run.smithi177.stdout:2038 read 0x55ee9f3 thru 0x55fc820 (0xde2e bytes) 2019-12-16T22:46:04.798 INFO:teuthology.orchestra.run.smithi177.stdout:2651 punch from 0xf36f8c to 0xf3b41a, (0x448e bytes) 2019-12-16T22:46:04.798 INFO:teuthology.orchestra.run.smithi177.stdout:2039 writesame 0x260213b thru 0x26036cd data_size 0x7(0x1593 bytes) 2019-12-16T22:46:04.803 INFO:teuthology.orchestra.run.smithi177.stdout:2041 read 0xe1e6fe thru 0xe1eae9 (0x3ec bytes) 2019-12-16T22:46:04.804 INFO:teuthology.orchestra.run.smithi177.stdout:2043 write 0x462d7bb thru 0x4639f75 (0xc7bb bytes) 2019-12-16T22:46:04.805 INFO:teuthology.orchestra.run.smithi177.stdout:2652 trunc from 0xe44dc10 to 0xa71f727 2019-12-16T22:46:04.815 INFO:teuthology.orchestra.run.smithi177.stdout:2384 writesame 0x4796404 thru 0x479fd48 data_size 0x29(0x9945 bytes) 2019-12-16T22:46:04.827 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.827 INFO:teuthology.orchestra.run.smithi177.stdout:2388 read 0x6afb5ae thru 0x6b0488d (0x92e0 bytes) 2019-12-16T22:46:04.827 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.827 INFO:teuthology.orchestra.run.smithi177.stdout:2392 write 0x1c65a0b thru 0x1c71542 (0xbb38 bytes) 2019-12-16T22:46:04.837 INFO:teuthology.orchestra.run.smithi177.stdout:2045 trunc from 0xca6dd73 to 0x253f003 2019-12-16T22:46:04.841 INFO:teuthology.orchestra.run.smithi177.stdout:2653 write 0x434be23 thru 0x434f15e (0x333c bytes) 2019-12-16T22:46:04.847 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #15, image image_cluster1.client.mirror.2-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent16 2019-12-16T22:46:04.848 INFO:teuthology.orchestra.run.smithi177.stdout:2395 write 0x4cbb3b thru 0x4d4581 (0x8a47 bytes) 2019-12-16T22:46:04.870 INFO:teuthology.orchestra.run.smithi177.stdout:2654 write 0x4931795 thru 0x4938a9d (0x7309 bytes) 2019-12-16T22:46:04.873 INFO:teuthology.orchestra.run.smithi177.stdout:2046 read 0x15dd2a1 thru 0x15e1fb3 (0x4d13 bytes) 2019-12-16T22:46:04.874 INFO:teuthology.orchestra.run.smithi177.stdout:2396 trunc from 0x73d26ea to 0x26dfe4b 2019-12-16T22:46:04.885 INFO:teuthology.orchestra.run.smithi177.stdout:2114 trunc from 0x1dae6cb to 0xd0fd563 2019-12-16T22:46:04.886 INFO:teuthology.orchestra.run.smithi177.stdout:2047 trunc from 0x253f003 to 0x7b2ceb3 2019-12-16T22:46:04.890 INFO:teuthology.orchestra.run.smithi177.stdout:2655 write 0x5ac6d1b thru 0x5ad2281 (0xb567 bytes) 2019-12-16T22:46:04.894 INFO:teuthology.orchestra.run.smithi177.stdout:1726 trunc from 0x75ba4e8 to 0x2c8d979 2019-12-16T22:46:04.911 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.912 INFO:teuthology.orchestra.run.smithi177.stdout:2118 read 0x75cac7a thru 0x75d52e2 (0xa669 bytes) 2019-12-16T22:46:04.912 INFO:teuthology.orchestra.run.smithi177.stdout:2119 write 0xdf3c6b thru 0xdf4392 (0x728 bytes) 2019-12-16T22:46:04.912 INFO:teuthology.orchestra.run.smithi177.stdout:2048 write 0x11d8439 thru 0x11e14cb (0x9093 bytes) 2019-12-16T22:46:04.921 INFO:teuthology.orchestra.run.smithi177.stdout:2656 read 0x2a4e898 thru 0x2a5ba70 (0xd1d9 bytes) 2019-12-16T22:46:04.921 INFO:teuthology.orchestra.run.smithi177.stdout:2657 writesame 0x9adbaa7 thru 0x9ade8d6 data_size 0x8(0x2e30 bytes) 2019-12-16T22:46:04.923 INFO:teuthology.orchestra.run.smithi177.stdout:2121 trunc from 0xd0fd563 to 0xc35efdf 2019-12-16T22:46:04.923 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:04.923 INFO:teuthology.orchestra.run.smithi177.stdout:2051 read 0x385567a thru 0x3859ff4 (0x497b bytes) 2019-12-16T22:46:04.924 INFO:teuthology.orchestra.run.smithi177.stdout:2052 clone 19 order 21 su 65536 sc 7 2019-12-16T22:46:04.963 INFO:teuthology.orchestra.run.smithi177.stdout:2658 read 0x1563e8 thru 0x160c52 (0xa86b bytes) 2019-12-16T22:46:04.967 INFO:teuthology.orchestra.run.smithi177.stdout:2124 write 0x476faf7 thru 0x477d919 (0xde23 bytes) 2019-12-16T22:46:04.971 INFO:teuthology.orchestra.run.smithi177.stdout:2397 write 0xaacd769 thru 0xaad2466 (0x4cfe bytes) 2019-12-16T22:46:04.995 INFO:teuthology.orchestra.run.smithi177.stdout:2659 write 0xdfd14a7 thru 0xdfdaf0f (0x9a69 bytes) 2019-12-16T22:46:05.002 INFO:teuthology.orchestra.run.smithi177.stdout:1727 punch from 0x808517 to 0x8134b0, (0xaf99 bytes) 2019-12-16T22:46:05.008 INFO:teuthology.orchestra.run.smithi177.stdout:2398 trunc from 0xaad2467 to 0x2300e31 2019-12-16T22:46:05.013 INFO:teuthology.orchestra.run.smithi177.stdout:2660 write 0x48ecfc2 thru 0x48f4c48 (0x7c87 bytes) 2019-12-16T22:46:05.021 INFO:teuthology.orchestra.run.smithi177.stdout:2663 read 0x5dc686 thru 0x5de041 (0x19bc bytes) 2019-12-16T22:46:05.021 INFO:teuthology.orchestra.run.smithi177.stdout:2664 read 0x7ed54bb thru 0x7ed6302 (0xe48 bytes) 2019-12-16T22:46:05.022 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.022 INFO:teuthology.orchestra.run.smithi177.stdout:2666 writesame 0xa89c187 thru 0xa8a5882 data_size 0x6(0x96fc bytes) 2019-12-16T22:46:05.029 INFO:teuthology.orchestra.run.smithi177.stdout:2228 write 0x46a5e2c thru 0x46aa485 (0x465a bytes) 2019-12-16T22:46:05.029 INFO:teuthology.orchestra.run.smithi177.stdout:2125 writesame 0xcff14df thru 0xcffde4d data_size 0x1(0xc96f bytes) 2019-12-16T22:46:05.033 INFO:teuthology.orchestra.run.smithi177.stdout:2126 write 0x3231a1c thru 0x32348e6 (0x2ecb bytes) 2019-12-16T22:46:05.038 INFO:teuthology.orchestra.run.smithi177.stdout:2667 writesame 0x5190c79 thru 0x519fa97 data_size 0x1(0xee1f bytes) 2019-12-16T22:46:05.039 INFO:teuthology.orchestra.run.smithi177.stdout:1728 write 0xab32978 thru 0xab41676 (0xecff bytes) 2019-12-16T22:46:05.057 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.058 INFO:teuthology.orchestra.run.smithi177.stdout:1730 write 0x4de671d thru 0x4dee92e (0x8212 bytes) 2019-12-16T22:46:05.058 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.058 INFO:teuthology.orchestra.run.smithi177.stdout:2128 punch from 0x986b5b7 to 0x986c206, (0xc4f bytes) 2019-12-16T22:46:05.058 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.058 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.076 INFO:teuthology.orchestra.run.smithi177.stdout:2133 trunc from 0xcffde4e to 0x3f93de1 2019-12-16T22:46:05.099 INFO:teuthology.orchestra.run.smithi177.stdout:1731 trunc from 0xab41677 to 0x90698c4 2019-12-16T22:46:05.110 INFO:teuthology.orchestra.run.smithi177.stdout:2668 punch from 0x1ad79af to 0x1adfcd4, (0x8325 bytes) 2019-12-16T22:46:05.110 INFO:teuthology.orchestra.run.smithi177.stdout:2669 write 0x491f10c thru 0x492d019 (0xdf0e bytes) 2019-12-16T22:46:05.183 INFO:teuthology.orchestra.run.smithi177.stdout:2400 write 0x4967fcd thru 0x4970e8e (0x8ec2 bytes) 2019-12-16T22:46:05.211 INFO:teuthology.orchestra.run.smithi177.stdout:2135 punch from 0x1b6ea1d to 0x1b752bf, (0x68a2 bytes) 2019-12-16T22:46:05.213 INFO:teuthology.orchestra.run.smithi177.stdout:2402 write 0x14a2c1b thru 0x14b0e74 (0xe25a bytes) 2019-12-16T22:46:05.214 INFO:teuthology.orchestra.run.smithi177.stdout:2230 punch from 0xfc4687 to 0xfd38c3, (0xf23c bytes) 2019-12-16T22:46:05.214 INFO:teuthology.orchestra.run.smithi177.stdout:2232 read 0xc1e95b6 thru 0xc1eb68a (0x20d5 bytes) 2019-12-16T22:46:05.216 INFO:teuthology.orchestra.run.smithi177.stdout:2234 read 0xce336c3 thru 0xce36672 (0x2fb0 bytes) 2019-12-16T22:46:05.217 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.217 INFO:teuthology.orchestra.run.smithi177.stdout:2236 write 0x5b4bb81 thru 0x5b4c13a (0x5ba bytes) 2019-12-16T22:46:05.220 INFO:teuthology.orchestra.run.smithi177.stdout:2671 writesame 0xe162ebd thru 0xe163b21 data_size 0x1(0xc65 bytes) 2019-12-16T22:46:05.225 INFO:teuthology.orchestra.run.smithi177.stdout:2674 read 0xbf85e9a thru 0xbf93842 (0xd9a9 bytes) 2019-12-16T22:46:05.226 INFO:teuthology.orchestra.run.smithi177.stdout:2675 write 0x9987b70 thru 0x9995e20 (0xe2b1 bytes) 2019-12-16T22:46:05.243 INFO:teuthology.orchestra.run.smithi177.stdout:2403 read 0x1255910 thru 0x125bebb (0x65ac bytes) 2019-12-16T22:46:05.255 INFO:teuthology.orchestra.run.smithi177.stdout:1733 write 0xe80872a thru 0xe81783b (0xf112 bytes) 2019-12-16T22:46:05.255 INFO:teuthology.orchestra.run.smithi177.stdout:2136 write 0x90dbd25 thru 0x90e7a5c (0xbd38 bytes) 2019-12-16T22:46:05.258 INFO:teuthology.orchestra.run.smithi177.stdout:2676 writesame 0x7eca8c5 thru 0x7ed67e8 data_size 0x1a(0xbf24 bytes) 2019-12-16T22:46:05.265 INFO:teuthology.orchestra.run.smithi177.stdout:1735 write 0xa5754b6 thru 0xa57947d (0x3fc8 bytes) 2019-12-16T22:46:05.280 INFO:teuthology.orchestra.run.smithi177.stdout:2137 read 0x3206669 thru 0x32127e2 (0xc17a bytes) 2019-12-16T22:46:05.283 INFO:teuthology.orchestra.run.smithi177.stdout:2237 write 0xc5d9b32 thru 0xc5e29aa (0x8e79 bytes) 2019-12-16T22:46:05.289 INFO:teuthology.orchestra.run.smithi177.stdout:2678 read 0x73bb05 thru 0x741e08 (0x6304 bytes) 2019-12-16T22:46:05.290 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.290 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.290 INFO:teuthology.orchestra.run.smithi177.stdout:2681 read 0xa4167ca thru 0xa41f42a (0x8c61 bytes) 2019-12-16T22:46:05.291 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.291 INFO:teuthology.orchestra.run.smithi177.stdout:2683 write 0x757edda thru 0x7580825 (0x1a4c bytes) 2019-12-16T22:46:05.291 INFO:teuthology.orchestra.run.smithi177.stdout:2405 writesame 0xc2a0b61 thru 0xc2aeac9 data_size 0x1(0xdf69 bytes) 2019-12-16T22:46:05.292 INFO:teuthology.orchestra.run.smithi177.stdout:2140 trunc from 0x90e7a5d to 0x43d5088 2019-12-16T22:46:05.295 INFO:teuthology.orchestra.run.smithi177.stdout:2406 trunc from 0xc2aeaca to 0xcede3f6 2019-12-16T22:46:05.299 INFO:teuthology.orchestra.run.smithi177.stdout:1736 trunc from 0xe81783c to 0x1ef024a 2019-12-16T22:46:05.318 INFO:teuthology.orchestra.run.smithi177.stdout:2684 write 0xda3b426 thru 0xda496d6 (0xe2b1 bytes) 2019-12-16T22:46:05.337 INFO:teuthology.orchestra.run.smithi177.stdout:2407 punch from 0x1c800d7 to 0x1c8a5c2, (0xa4eb bytes) 2019-12-16T22:46:05.337 INFO:teuthology.orchestra.run.smithi177.stdout:2409 write 0x927337c thru 0x927ef0f (0xbb94 bytes) 2019-12-16T22:46:05.349 INFO:teuthology.orchestra.run.smithi177.stdout:2412 write 0x27c6daf thru 0x27d3ac8 (0xcd1a bytes) 2019-12-16T22:46:05.362 INFO:teuthology.orchestra.run.smithi177.stdout:2685 trunc from 0xe163b22 to 0x7bf45fb 2019-12-16T22:46:05.362 INFO:teuthology.orchestra.run.smithi177.stdout:2413 read 0x79700b9 thru 0x7973537 (0x347f bytes) 2019-12-16T22:46:05.362 INFO:teuthology.orchestra.run.smithi177.stdout:2414 read 0x7586091 thru 0x75866f5 (0x665 bytes) 2019-12-16T22:46:05.365 INFO:teuthology.orchestra.run.smithi177.stdout:1739 trunc from 0x1ef024a to 0x9657189 2019-12-16T22:46:05.377 INFO:teuthology.orchestra.run.smithi177.stdout:2141 writesame 0x9a0457d thru 0x9a0ea33 data_size 0x1(0xa4b7 bytes) 2019-12-16T22:46:05.380 INFO:teuthology.orchestra.run.smithi177.stdout:2415 trunc from 0xcede3f6 to 0x3477b90 2019-12-16T22:46:05.386 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.387 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.387 INFO:teuthology.orchestra.run.smithi177.stdout:2145 writesame 0x589ad3a thru 0x58a7c40 data_size 0x1(0xcf07 bytes) 2019-12-16T22:46:05.415 INFO:teuthology.orchestra.run.smithi177.stdout:1740 write 0x3f5bb8a thru 0x3f5f96f (0x3de6 bytes) 2019-12-16T22:46:05.419 INFO:teuthology.orchestra.run.smithi177.stdout:2146 writesame 0x68f933f thru 0x6900120 data_size 0x3a(0x6de2 bytes) 2019-12-16T22:46:05.444 INFO:teuthology.orchestra.run.smithi177.stdout:2147 read 0x8d5a072 thru 0x8d5f593 (0x5522 bytes) 2019-12-16T22:46:05.451 INFO:teuthology.orchestra.run.smithi177.stdout:2416 writesame 0x1f07edc thru 0x1f0e594 data_size 0x1(0x66b9 bytes) 2019-12-16T22:46:05.453 INFO:teuthology.orchestra.run.smithi177.stdout:2686 writesame 0x6993670 thru 0x69a1c7a data_size 0x2f(0xe60b bytes) 2019-12-16T22:46:05.458 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone18 from 0x7b2ceb3 (overlap 0x3a0697) to 0x1735d6 2019-12-16T22:46:05.468 INFO:teuthology.orchestra.run.smithi177.stdout:2238 read 0x962bd5a thru 0x9639fa7 (0xe24e bytes) 2019-12-16T22:46:05.468 INFO:teuthology.orchestra.run.smithi177.stdout:2239 write 0xcb8ecee thru 0xcb9d6ef (0xea02 bytes) 2019-12-16T22:46:05.472 INFO:teuthology.orchestra.run.smithi177.stdout:1743 writesame 0xe2107db thru 0xe218f52 data_size 0x55(0x8778 bytes) 2019-12-16T22:46:05.485 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.486 INFO:teuthology.orchestra.run.smithi177.stdout:1748 punch from 0xb902042 to 0xb90bc38, (0x9bf6 bytes) 2019-12-16T22:46:05.486 INFO:teuthology.orchestra.run.smithi177.stdout:1749 write 0x2e30e1 thru 0x2e8336 (0x5256 bytes) 2019-12-16T22:46:05.486 INFO:teuthology.orchestra.run.smithi177.stdout:2420 trunc from 0x3477b90 to 0xd3c29df 2019-12-16T22:46:05.491 INFO:teuthology.orchestra.run.smithi177.stdout:2687 trunc from 0x7bf45fb to 0xbd1e9a6 2019-12-16T22:46:05.502 INFO:teuthology.orchestra.run.smithi177.stdout:1750 writesame 0x72e2588 thru 0x72edc2d data_size 0x3(0xb6a6 bytes) 2019-12-16T22:46:05.504 INFO:teuthology.orchestra.run.smithi177.stdout:2148 write 0xbd4db61 thru 0xbd59869 (0xbd09 bytes) 2019-12-16T22:46:05.506 INFO:teuthology.orchestra.run.smithi177.stdout:2240 punch from 0x626c9f1 to 0x626da44, (0x1053 bytes) 2019-12-16T22:46:05.519 INFO:teuthology.orchestra.run.smithi177.stdout:1751 write 0x423adf2 thru 0x42410c1 (0x62d0 bytes) 2019-12-16T22:46:05.529 INFO:teuthology.orchestra.run.smithi177.stdout:2421 write 0x1caf8e6 thru 0x1cbb27e (0xb999 bytes) 2019-12-16T22:46:05.530 INFO:teuthology.orchestra.run.smithi177.stdout:2688 read 0x7920f32 thru 0x79254dd (0x45ac bytes) 2019-12-16T22:46:05.533 INFO:teuthology.orchestra.run.smithi177.stdout:1752 trunc from 0xe218f53 to 0xc97d37e 2019-12-16T22:46:05.540 INFO:teuthology.orchestra.run.smithi177.stdout:2424 read 0x1524260 thru 0x152f780 (0xb521 bytes) 2019-12-16T22:46:05.540 INFO:teuthology.orchestra.run.smithi177.stdout:2149 writesame 0x30b6036 thru 0x30c5d9b data_size 0x41(0xfd66 bytes) 2019-12-16T22:46:05.541 INFO:teuthology.orchestra.run.smithi177.stdout:2425 write 0x4393e63 thru 0x439b422 (0x75c0 bytes) 2019-12-16T22:46:05.542 INFO:teuthology.orchestra.run.smithi177.stdout:2241 write 0xe6a4f01 thru 0xe6b32d4 (0xe3d4 bytes) 2019-12-16T22:46:05.561 INFO:teuthology.orchestra.run.smithi177.stdout:2150 write 0x5aedca8 thru 0x5af8b7b (0xaed4 bytes) 2019-12-16T22:46:05.568 INFO:teuthology.orchestra.run.smithi177.stdout:2426 read 0x2e2e849 thru 0x2e30352 (0x1b0a bytes) 2019-12-16T22:46:05.568 INFO:teuthology.orchestra.run.smithi177.stdout:2427 read 0x8c7f63b thru 0x8c804be (0xe84 bytes) 2019-12-16T22:46:05.568 INFO:teuthology.orchestra.run.smithi177.stdout:2430 read 0x415c4fa thru 0x41672c3 (0xadca bytes) 2019-12-16T22:46:05.570 INFO:teuthology.orchestra.run.smithi177.stdout:2689 write 0xd9591e6 thru 0xd95b2de (0x20f9 bytes) 2019-12-16T22:46:05.570 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.570 INFO:teuthology.orchestra.run.smithi177.stdout:2432 read 0x2f21a50 thru 0x2f239c3 (0x1f74 bytes) 2019-12-16T22:46:05.580 INFO:teuthology.orchestra.run.smithi177.stdout:1753 punch from 0x43e2d83 to 0x43e3c78, (0xef5 bytes) 2019-12-16T22:46:05.580 INFO:teuthology.orchestra.run.smithi177.stdout:1754 punch from 0x6733d6d to 0x673691a, (0x2bad bytes) 2019-12-16T22:46:05.580 INFO:teuthology.orchestra.run.smithi177.stdout:1755 writesame 0x8c22be8 thru 0x8c2fc4d data_size 0x19(0xd066 bytes) 2019-12-16T22:46:05.581 INFO:teuthology.orchestra.run.smithi177.stdout:2152 read 0x1342441 thru 0x135031e (0xdede bytes) 2019-12-16T22:46:05.584 INFO:teuthology.orchestra.run.smithi177.stdout:2153 punch from 0x3be7b8 to 0x3c5c94, (0x74dc bytes) 2019-12-16T22:46:05.585 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.598 INFO:teuthology.orchestra.run.smithi177.stdout:1756 write 0x797558d thru 0x7978b06 (0x357a bytes) 2019-12-16T22:46:05.598 INFO:teuthology.orchestra.run.smithi177.stdout:2433 trunc from 0xd3c29df to 0x3323839 2019-12-16T22:46:05.600 INFO:teuthology.orchestra.run.smithi177.stdout:2242 punch from 0xcfb097 to 0xd03627, (0x8590 bytes) 2019-12-16T22:46:05.600 INFO:teuthology.orchestra.run.smithi177.stdout:2244 clone 19 order 23 su 4194304 sc 8 2019-12-16T22:46:05.602 INFO:teuthology.orchestra.run.smithi177.stdout:1757 writesame 0x8a71fb3 thru 0x8a7ffc6 data_size 0x2(0xe014 bytes) 2019-12-16T22:46:05.621 INFO:teuthology.orchestra.run.smithi177.stdout:2155 write 0xeaa8a65 thru 0xeaaa799 (0x1d35 bytes) 2019-12-16T22:46:05.626 INFO:teuthology.orchestra.run.smithi177.stdout:2690 trunc from 0xd95b2df to 0x153a18c 2019-12-16T22:46:05.637 INFO:teuthology.orchestra.run.smithi177.stdout:2156 write 0x9a7c22b thru 0x9a84fee (0x8dc4 bytes) 2019-12-16T22:46:05.657 INFO:teuthology.orchestra.run.smithi177.stdout:2157 punch from 0xe0422c to 0xe05093, (0xe67 bytes) 2019-12-16T22:46:05.662 INFO:teuthology.orchestra.run.smithi177.stdout:2159 trunc from 0xeaaa79a to 0xb7cb595 2019-12-16T22:46:05.664 INFO:teuthology.orchestra.run.smithi177.stdout:2434 punch from 0xd0fa24 to 0xd19aa8, (0xa084 bytes) 2019-12-16T22:46:05.665 INFO:teuthology.orchestra.run.smithi177.stdout:2435 trunc from 0x3323839 to 0x2c2cc29 2019-12-16T22:46:05.666 INFO:teuthology.orchestra.run.smithi177.stdout:1758 write 0xdf3e60e thru 0xdf44a5a (0x644d bytes) 2019-12-16T22:46:05.671 INFO:teuthology.orchestra.run.smithi177.stdout:1759 write 0x8a28dc2 thru 0x8a37caa (0xeee9 bytes) 2019-12-16T22:46:05.682 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.682 INFO:teuthology.orchestra.run.smithi177.stdout:1760 writesame 0x64fce83 thru 0x650459a data_size 0x8(0x7718 bytes) 2019-12-16T22:46:05.687 INFO:teuthology.orchestra.run.smithi177.stdout:2437 punch from 0x9d5c52 to 0x9e50ed, (0xf49b bytes) 2019-12-16T22:46:05.688 INFO:teuthology.orchestra.run.smithi177.stdout:1761 punch from 0xd88acec to 0xd89380d, (0x8b21 bytes) 2019-12-16T22:46:05.688 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.688 INFO:teuthology.orchestra.run.smithi177.stdout:1763 read 0x3a3dda thru 0x3aaa91 (0x6cb8 bytes) 2019-12-16T22:46:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:1764 trunc from 0xdf44a5b to 0x9e6296e 2019-12-16T22:46:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:2161 punch from 0x11b1045 to 0x11bdadf, (0xca9a bytes) 2019-12-16T22:46:05.701 INFO:teuthology.orchestra.run.smithi177.stdout:2163 write 0x7def9ae thru 0x7df1694 (0x1ce7 bytes) 2019-12-16T22:46:05.721 INFO:teuthology.orchestra.run.smithi177.stdout:2692 writesame 0xd1f6698 thru 0xd205532 data_size 0x21(0xee9b bytes) 2019-12-16T22:46:05.723 INFO:teuthology.orchestra.run.smithi177.stdout:2695 read 0x70fcb11 thru 0x71068ee (0x9dde bytes) 2019-12-16T22:46:05.723 INFO:teuthology.orchestra.run.smithi177.stdout:2696 read 0xc1faea7 thru 0xc206818 (0xb972 bytes) 2019-12-16T22:46:05.723 INFO:teuthology.orchestra.run.smithi177.stdout:2697 write 0xb3cae4d thru 0xb3d99e0 (0xeb94 bytes) 2019-12-16T22:46:05.727 INFO:teuthology.orchestra.run.smithi177.stdout:1765 write 0x122ce1f thru 0x12383b0 (0xb592 bytes) 2019-12-16T22:46:05.727 INFO:teuthology.orchestra.run.smithi177.stdout:2164 trunc from 0xb7cb595 to 0x29d2879 2019-12-16T22:46:05.732 INFO:teuthology.orchestra.run.smithi177.stdout:2439 writesame 0xb78e464 thru 0xb79d513 data_size 0x8(0xf0b0 bytes) 2019-12-16T22:46:05.737 INFO:teuthology.orchestra.run.smithi177.stdout:1768 punch from 0x6c52ca9 to 0x6c5a1fc, (0x7553 bytes) 2019-12-16T22:46:05.738 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.738 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.739 INFO:teuthology.orchestra.run.smithi177.stdout:2443 write 0x62f62d5 thru 0x63006fe (0xa42a bytes) 2019-12-16T22:46:05.748 INFO:teuthology.orchestra.run.smithi177.stdout:2698 trunc from 0xd205533 to 0x8a0731b 2019-12-16T22:46:05.758 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.759 INFO:teuthology.orchestra.run.smithi177.stdout:2445 write 0x9bd118e thru 0x9bdecf7 (0xdb6a bytes) 2019-12-16T22:46:05.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.776 INFO:teuthology.orchestra.run.smithi177.stdout:2448 clone 16 order 18 su 8192 sc 12 2019-12-16T22:46:05.777 INFO:teuthology.orchestra.run.smithi177.stdout:1769 writesame 0xb11d415 thru 0xb11d759 data_size 0x9(0x345 bytes) 2019-12-16T22:46:05.785 INFO:teuthology.orchestra.run.smithi177.stdout:2165 punch from 0x55cc52 to 0x5617d9, (0x4b87 bytes) 2019-12-16T22:46:05.788 INFO:teuthology.orchestra.run.smithi177.stdout:1771 trunc from 0xb11d75a to 0xe000525 2019-12-16T22:46:05.801 INFO:teuthology.orchestra.run.smithi177.stdout:2699 trunc from 0x8a0731b to 0xd2997ae 2019-12-16T22:46:05.805 INFO:teuthology.orchestra.run.smithi177.stdout:1772 writesame 0xb3eee7e thru 0xb3f9779 data_size 0x69(0xa8fc bytes) 2019-12-16T22:46:05.809 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #17, image image_cluster1.client.mirror.3-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent18 2019-12-16T22:46:05.810 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.810 INFO:teuthology.orchestra.run.smithi177.stdout:1775 read 0x1c00b93 thru 0x1c0e365 (0xd7d3 bytes) 2019-12-16T22:46:05.810 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.811 INFO:teuthology.orchestra.run.smithi177.stdout:1778 read 0x6998a02 thru 0x699bfbf (0x35be bytes) 2019-12-16T22:46:05.817 INFO:teuthology.orchestra.run.smithi177.stdout:2700 read 0x56e621a thru 0x56f1b6f (0xb956 bytes) 2019-12-16T22:46:05.818 INFO:teuthology.orchestra.run.smithi177.stdout:2701 write 0x5c6d53d thru 0x5c72b46 (0x560a bytes) 2019-12-16T22:46:05.819 INFO:teuthology.orchestra.run.smithi177.stdout:1779 trunc from 0xe000525 to 0x8f8bb6a 2019-12-16T22:46:05.821 INFO:teuthology.orchestra.run.smithi177.stdout:2166 write 0x9b34e77 thru 0x9b3a735 (0x58bf bytes) 2019-12-16T22:46:05.843 INFO:teuthology.orchestra.run.smithi177.stdout:2702 read 0x42b9067 thru 0x42b9ed6 (0xe70 bytes) 2019-12-16T22:46:05.843 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.843 INFO:teuthology.orchestra.run.smithi177.stdout:2706 read 0x6bff884 thru 0x6c007ae (0xf2b bytes) 2019-12-16T22:46:05.843 INFO:teuthology.orchestra.run.smithi177.stdout:2707 writesame 0x7191efe thru 0x7195629 data_size 0x42(0x372c bytes) 2019-12-16T22:46:05.853 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:2709 punch from 0x1878d35 to 0x187ea21, (0x5cec bytes) 2019-12-16T22:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:2719 read 0x2452130 thru 0x245c729 (0xa5fa bytes) 2019-12-16T22:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:2720 read 0x9e2e029 thru 0x9e35c1c (0x7bf4 bytes) 2019-12-16T22:46:05.854 INFO:teuthology.orchestra.run.smithi177.stdout:2721 read 0x3ce02df thru 0x3cee709 (0xe42b bytes) 2019-12-16T22:46:05.855 INFO:teuthology.orchestra.run.smithi177.stdout:2722 read 0x6928100 thru 0x6934cb7 (0xcbb8 bytes) 2019-12-16T22:46:05.855 INFO:teuthology.orchestra.run.smithi177.stdout:2725 read 0x54b7afd thru 0x54bdf2b (0x642f bytes) 2019-12-16T22:46:05.855 INFO:teuthology.orchestra.run.smithi177.stdout:2726 read 0x7c6e42c thru 0x7c79238 (0xae0d bytes) 2019-12-16T22:46:05.855 INFO:teuthology.orchestra.run.smithi177.stdout:2727 write 0x57640e5 thru 0x576edf3 (0xad0f bytes) 2019-12-16T22:46:05.865 INFO:teuthology.orchestra.run.smithi177.stdout:2728 read 0x9c20945 thru 0x9c2a564 (0x9c20 bytes) 2019-12-16T22:46:05.870 INFO:teuthology.orchestra.run.smithi177.stdout:2168 write 0xecdfcf7 thru 0xecea5d4 (0xa8de bytes) 2019-12-16T22:46:05.885 INFO:teuthology.orchestra.run.smithi177.stdout:2169 writesame 0x5295ef4 thru 0x52a1786 data_size 0x1(0xb893 bytes) 2019-12-16T22:46:05.885 INFO:teuthology.orchestra.run.smithi177.stdout:2729 trunc from 0xd2997ae to 0x531690d 2019-12-16T22:46:05.895 INFO:teuthology.orchestra.run.smithi177.stdout:1780 writesame 0xde27847 thru 0xde2cce7 data_size 0x7(0x54a1 bytes) 2019-12-16T22:46:05.907 INFO:teuthology.orchestra.run.smithi177.stdout:1781 read 0xabb6a8 thru 0xac0b75 (0x54ce bytes) 2019-12-16T22:46:05.910 INFO:teuthology.orchestra.run.smithi177.stdout:1783 punch from 0x9e7d9ae to 0x9e8749a, (0x9aec bytes) 2019-12-16T22:46:05.910 INFO:teuthology.orchestra.run.smithi177.stdout:1785 writesame 0x9995408 thru 0x9996b8c data_size 0x9(0x1785 bytes) 2019-12-16T22:46:05.915 INFO:teuthology.orchestra.run.smithi177.stdout:2170 write 0xac3d8c6 thru 0xac49a24 (0xc15f bytes) 2019-12-16T22:46:05.933 INFO:teuthology.orchestra.run.smithi177.stdout:2174 writesame 0x84832ad thru 0x84841c2 data_size 0x1(0xf16 bytes) 2019-12-16T22:46:05.941 INFO:teuthology.orchestra.run.smithi177.stdout:2175 writesame 0x79129cb thru 0x791460a data_size 0x20(0x1c40 bytes) 2019-12-16T22:46:05.943 INFO:teuthology.orchestra.run.smithi177.stdout:2730 trunc from 0x531690d to 0x6f56589 2019-12-16T22:46:05.945 INFO:teuthology.orchestra.run.smithi177.stdout:1786 trunc from 0xde2cce8 to 0x11412b5 2019-12-16T22:46:05.956 INFO:teuthology.orchestra.run.smithi177.stdout:2176 write 0xc62b280 thru 0xc63a429 (0xf1aa bytes) 2019-12-16T22:46:05.971 INFO:teuthology.orchestra.run.smithi177.stdout:2731 punch from 0x3ed5a84 to 0x3edb4db, (0x5a57 bytes) 2019-12-16T22:46:05.971 INFO:teuthology.orchestra.run.smithi177.stdout:2732 read 0x429e896 thru 0x42a5c07 (0x7372 bytes) 2019-12-16T22:46:05.977 INFO:teuthology.orchestra.run.smithi177.stdout:2177 clone 22 order 25 su 4194304 sc 7 2019-12-16T22:46:05.983 INFO:teuthology.orchestra.run.smithi177.stdout:1787 read 0xb651a6 thru 0xb6a39d (0x51f8 bytes) 2019-12-16T22:46:05.984 INFO:teuthology.orchestra.run.smithi177.stdout:1790 punch from 0x50f5f to 0x52b12, (0x1bb3 bytes) 2019-12-16T22:46:05.987 INFO:teuthology.orchestra.run.smithi177.stdout:1793 trunc from 0x11412b5 to 0x19ab7d 2019-12-16T22:46:05.998 INFO:teuthology.orchestra.run.smithi177.stdout:2734 writesame 0xc91428c thru 0xc91ce3b data_size 0x50(0x8bb0 bytes) 2019-12-16T22:46:06.000 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.000 INFO:teuthology.orchestra.run.smithi177.stdout:2737 read 0xaf6a5d7 thru 0xaf7097d (0x63a7 bytes) 2019-12-16T22:46:06.001 INFO:teuthology.orchestra.run.smithi177.stdout:2738 read 0x666b277 thru 0x666d935 (0x26bf bytes) 2019-12-16T22:46:06.001 INFO:teuthology.orchestra.run.smithi177.stdout:2741 write 0x75f6e26 thru 0x75ff6f1 (0x88cc bytes) 2019-12-16T22:46:06.018 INFO:teuthology.orchestra.run.smithi177.stdout:2742 write 0x196d0a3 thru 0x197555f (0x84bd bytes) 2019-12-16T22:46:06.033 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.033 INFO:teuthology.orchestra.run.smithi177.stdout:2744 write 0x90dcde4 thru 0x90e9d26 (0xcf43 bytes) 2019-12-16T22:46:06.053 INFO:teuthology.orchestra.run.smithi177.stdout:2745 write 0xb09501c thru 0xb09cb18 (0x7afd bytes) 2019-12-16T22:46:06.053 INFO:teuthology.orchestra.run.smithi177.stdout:1794 read 0x96b50 thru 0x97523 (0x9d4 bytes) 2019-12-16T22:46:06.054 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.054 INFO:teuthology.orchestra.run.smithi177.stdout:1796 read 0x526ee thru 0x532e3 (0xbf6 bytes) 2019-12-16T22:46:06.057 INFO:teuthology.orchestra.run.smithi177.stdout:1797 trunc from 0x19ab7d to 0xbfc044 2019-12-16T22:46:06.067 INFO:teuthology.orchestra.run.smithi177.stdout:2746 read 0xc7f3d24 thru 0xc801aff (0xdddc bytes) 2019-12-16T22:46:06.068 INFO:teuthology.orchestra.run.smithi177.stdout:2747 punch from 0x9ef1ea1 to 0x9ef8ecf, (0x702e bytes) 2019-12-16T22:46:06.068 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.068 INFO:teuthology.orchestra.run.smithi177.stdout:2749 read 0x85cbf34 thru 0x85ce479 (0x2546 bytes) 2019-12-16T22:46:06.068 INFO:teuthology.orchestra.run.smithi177.stdout:2750 read 0x4a7ae9a thru 0x4a8114c (0x62b3 bytes) 2019-12-16T22:46:06.068 INFO:teuthology.orchestra.run.smithi177.stdout:2751 read 0x56478e2 thru 0x5652a4f (0xb16e bytes) 2019-12-16T22:46:06.069 INFO:teuthology.orchestra.run.smithi177.stdout:2753 write 0x1a3b021 thru 0x1a45b2c (0xab0c bytes) 2019-12-16T22:46:06.112 INFO:teuthology.orchestra.run.smithi177.stdout:2754 writesame 0xb4f24ab thru 0xb4f60b0 data_size 0x6(0x3c06 bytes) 2019-12-16T22:46:06.130 INFO:teuthology.orchestra.run.smithi177.stdout:2755 read 0x446a582 thru 0x446dcaa (0x3729 bytes) 2019-12-16T22:46:06.130 INFO:teuthology.orchestra.run.smithi177.stdout:2756 write 0xb0ad0cc thru 0xb0af4f5 (0x242a bytes) 2019-12-16T22:46:06.148 INFO:teuthology.orchestra.run.smithi177.stdout:2758 punch from 0xa0b05bb to 0xa0b7749, (0x718e bytes) 2019-12-16T22:46:06.149 INFO:teuthology.orchestra.run.smithi177.stdout:2759 punch from 0x5be6972 to 0x5be9b47, (0x31d5 bytes) 2019-12-16T22:46:06.149 INFO:teuthology.orchestra.run.smithi177.stdout:2760 trunc from 0xc91ce3c to 0xbe1eb22 2019-12-16T22:46:06.149 INFO:teuthology.orchestra.run.smithi177.stdout:1800 writesame 0x6314ef6 thru 0x6320699 data_size 0x49(0xb7a4 bytes) 2019-12-16T22:46:06.149 INFO:teuthology.orchestra.run.smithi177.stdout:1801 read 0x3fbcd6b thru 0x3fc3cbd (0x6f53 bytes) 2019-12-16T22:46:06.175 INFO:teuthology.orchestra.run.smithi177.stdout:2761 write 0xc1b91af thru 0xc1c6afe (0xd950 bytes) 2019-12-16T22:46:06.177 INFO:teuthology.orchestra.run.smithi177.stdout:1803 writesame 0xed2e207 thru 0xed34b9b data_size 0x1(0x6995 bytes) 2019-12-16T22:46:06.191 INFO:teuthology.orchestra.run.smithi177.stdout:2762 read 0xbae02b9 thru 0xbaee30e (0xe056 bytes) 2019-12-16T22:46:06.191 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.191 INFO:teuthology.orchestra.run.smithi177.stdout:2764 read 0x8ad38ae thru 0x8add7a4 (0x9ef7 bytes) 2019-12-16T22:46:06.192 INFO:teuthology.orchestra.run.smithi177.stdout:2765 flatten 2019-12-16T22:46:06.201 INFO:teuthology.orchestra.run.smithi177.stdout:2053 read 0x3430888 thru 0x3430f3f (0x6b8 bytes) 2019-12-16T22:46:06.202 INFO:teuthology.orchestra.run.smithi177.stdout:1804 trunc from 0xed34b9c to 0x2a98a52 2019-12-16T22:46:06.210 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.0-clone21 2019-12-16T22:46:06.237 INFO:teuthology.orchestra.run.smithi177.stdout:2054 read 0x7ab0459 thru 0x7abb9f8 (0xb5a0 bytes) 2019-12-16T22:46:06.248 INFO:teuthology.orchestra.run.smithi177.stdout:2055 trunc from 0x7b2ceb3 to 0xcdfa3ee 2019-12-16T22:46:06.272 INFO:teuthology.orchestra.run.smithi177.stdout:1805 read 0x2269646 thru 0x2273fc5 (0xa980 bytes) 2019-12-16T22:46:06.272 INFO:teuthology.orchestra.run.smithi177.stdout:1807 punch from 0x7fae46 to 0x7ff96c, (0x4b26 bytes) 2019-12-16T22:46:06.272 INFO:teuthology.orchestra.run.smithi177.stdout:1808 read 0x56a041 thru 0x56d7df (0x379f bytes) 2019-12-16T22:46:06.293 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.293 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.293 INFO:teuthology.orchestra.run.smithi177.stdout:2058 write 0x99658f3 thru 0x99734bd (0xdbcb bytes) 2019-12-16T22:46:06.299 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone15 from 0xb79d514 (overlap 0x46e5d3) to 0x2a89e5 2019-12-16T22:46:06.308 INFO:teuthology.orchestra.run.smithi177.stdout:2059 writesame 0x5781af0 thru 0x5786cac data_size 0x5d(0x51bd bytes) 2019-12-16T22:46:06.324 INFO:teuthology.orchestra.run.smithi177.stdout:1809 writesame 0xb0a6b12 thru 0xb0b1cc4 data_size 0x1(0xb1b3 bytes) 2019-12-16T22:46:06.330 INFO:teuthology.orchestra.run.smithi177.stdout:2060 read 0x5d5c016 thru 0x5d5d1e2 (0x11cd bytes) 2019-12-16T22:46:06.331 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.332 INFO:teuthology.orchestra.run.smithi177.stdout:2063 punch from 0x541f84b to 0x542861b, (0x8dd0 bytes) 2019-12-16T22:46:06.332 INFO:teuthology.orchestra.run.smithi177.stdout:2065 punch from 0xa62dc2b to 0xa631d52, (0x4127 bytes) 2019-12-16T22:46:06.332 INFO:teuthology.orchestra.run.smithi177.stdout:2066 write 0x5bbac5b thru 0x5bc3572 (0x8918 bytes) 2019-12-16T22:46:06.345 INFO:teuthology.orchestra.run.smithi177.stdout:1810 trunc from 0xb0b1cc5 to 0x6d0f35b 2019-12-16T22:46:06.369 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.370 INFO:teuthology.orchestra.run.smithi177.stdout:2069 trunc from 0xcdfa3ee to 0xc185f2d 2019-12-16T22:46:06.408 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone18 from 0xe6b32d5 (overlap 0xd75375f) to 0xac42c4c 2019-12-16T22:46:06.412 INFO:teuthology.orchestra.run.smithi177.stdout:1811 read 0x149168d thru 0x1494903 (0x3277 bytes) 2019-12-16T22:46:06.413 INFO:teuthology.orchestra.run.smithi177.stdout:1812 punch from 0x51c7c93 to 0x51ce5a2, (0x690f bytes) 2019-12-16T22:46:06.447 INFO:teuthology.orchestra.run.smithi177.stdout:2070 read 0x295a671 thru 0x296381c (0x91ac bytes) 2019-12-16T22:46:06.449 INFO:teuthology.orchestra.run.smithi177.stdout:2071 writesame 0x6561153 thru 0x656e93d data_size 0x4b(0xd7eb bytes) 2019-12-16T22:46:06.462 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #20, image image_cluster1.client.mirror.0-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent21 2019-12-16T22:46:06.499 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.499 INFO:teuthology.orchestra.run.smithi177.stdout:2075 write 0xba18d06 thru 0xba1b78c (0x2a87 bytes) 2019-12-16T22:46:06.499 INFO:teuthology.orchestra.run.smithi177.stdout:2076 write 0x74d339c thru 0x74d9310 (0x5f75 bytes) 2019-12-16T22:46:06.523 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.523 INFO:teuthology.orchestra.run.smithi177.stdout:2078 read 0x4f4cdb6 thru 0x4f4e687 (0x18d2 bytes) 2019-12-16T22:46:06.524 INFO:teuthology.orchestra.run.smithi177.stdout:1813 write 0xdb6a2c4 thru 0xdb79c66 (0xf9a3 bytes) 2019-12-16T22:46:06.545 INFO:teuthology.orchestra.run.smithi177.stdout:2079 trunc from 0xc185f2d to 0x2980bd 2019-12-16T22:46:06.552 INFO:teuthology.orchestra.run.smithi177.stdout:1815 write 0xb99067c thru 0xb99c8ee (0xc273 bytes) 2019-12-16T22:46:06.569 INFO:teuthology.orchestra.run.smithi177.stdout:1816 write 0x556cbc5 thru 0x556f67c (0x2ab8 bytes) 2019-12-16T22:46:06.582 INFO:teuthology.orchestra.run.smithi177.stdout:1817 write 0x221d9f5 thru 0x222254c (0x4b58 bytes) 2019-12-16T22:46:06.600 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.600 INFO:teuthology.orchestra.run.smithi177.stdout:1819 write 0x36a4c2d thru 0x36ac96b (0x7d3f bytes) 2019-12-16T22:46:06.612 INFO:teuthology.orchestra.run.smithi177.stdout:1820 read 0x6b30bb4 thru 0x6b38777 (0x7bc4 bytes) 2019-12-16T22:46:06.612 INFO:teuthology.orchestra.run.smithi177.stdout:1825 punch from 0x2c811c4 to 0x2c91188, (0xffc4 bytes) 2019-12-16T22:46:06.612 INFO:teuthology.orchestra.run.smithi177.stdout:1826 writesame 0xc623355 thru 0xc624ef2 data_size 0xa(0x1b9e bytes) 2019-12-16T22:46:06.620 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:06.618+0000 7f884a7b2700 -1 reset not still connected to 0x560112682000 2019-12-16T22:46:06.624 INFO:teuthology.orchestra.run.smithi177.stdout:1828 punch from 0x6cc7b91 to 0x6ccd8ae, (0x5d1d bytes) 2019-12-16T22:46:06.624 INFO:teuthology.orchestra.run.smithi177.stdout:1829 read 0x6f3e3d5 thru 0x6f45fdd (0x7c09 bytes) 2019-12-16T22:46:06.625 INFO:teuthology.orchestra.run.smithi177.stdout:1831 write 0x1cf5a81 thru 0x1d04626 (0xeba6 bytes) 2019-12-16T22:46:06.632 INFO:teuthology.orchestra.run.smithi177.stdout:2768 write 0x7cb9461 thru 0x7cc84d5 (0xf075 bytes) 2019-12-16T22:46:06.646 INFO:teuthology.orchestra.run.smithi177.stdout:1832 writesame 0xb783dc1 thru 0xb790f20 data_size 0x64(0xd160 bytes) 2019-12-16T22:46:06.654 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #14, image image_cluster1.client.mirror.5-clone14 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent15 2019-12-16T22:46:06.656 INFO:teuthology.orchestra.run.smithi177.stdout:1833 read 0xa824280 thru 0xa8334f2 (0xf273 bytes) 2019-12-16T22:46:06.657 INFO:teuthology.orchestra.run.smithi177.stdout:1834 writesame 0xa057f02 thru 0xa059e85 data_size 0x2(0x1f84 bytes) 2019-12-16T22:46:06.661 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.661 INFO:teuthology.orchestra.run.smithi177.stdout:2770 punch from 0x22111db to 0x22114de, (0x303 bytes) 2019-12-16T22:46:06.661 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.661 INFO:teuthology.orchestra.run.smithi177.stdout:2773 read 0x3f1cea8 thru 0x3f244b3 (0x760c bytes) 2019-12-16T22:46:06.665 INFO:teuthology.orchestra.run.smithi177.stdout:1835 read 0x6eb5c59 thru 0x6eb6e74 (0x121c bytes) 2019-12-16T22:46:06.665 INFO:teuthology.orchestra.run.smithi177.stdout:1838 punch from 0x8b2936e to 0x8b31a3d, (0x86cf bytes) 2019-12-16T22:46:06.665 INFO:teuthology.orchestra.run.smithi177.stdout:1842 write 0x76fa1aa thru 0x7709ad9 (0xf930 bytes) 2019-12-16T22:46:06.681 INFO:teuthology.orchestra.run.smithi177.stdout:2774 trunc from 0xc1c6aff to 0x59cc73 2019-12-16T22:46:06.683 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.703 INFO:teuthology.orchestra.run.smithi177.stdout:1843 trunc from 0xdb79c67 to 0x107cced 2019-12-16T22:46:06.752 INFO:teuthology.orchestra.run.smithi177.stdout:2081 writesame 0xea01088 thru 0xea05822 data_size 0x1(0x479b bytes) 2019-12-16T22:46:06.752 INFO:teuthology.orchestra.run.smithi177.stdout:2449 write 0x3b2050 thru 0x3b7081 (0x5032 bytes) 2019-12-16T22:46:06.756 INFO:teuthology.orchestra.run.smithi177.stdout:2082 write 0x9241474 thru 0x9243549 (0x20d6 bytes) 2019-12-16T22:46:06.760 INFO:teuthology.orchestra.run.smithi177.stdout:1846 punch from 0xe65a97 to 0xe6c3f8, (0x6961 bytes) 2019-12-16T22:46:06.760 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.771 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.772 INFO:teuthology.orchestra.run.smithi177.stdout:2088 writesame 0x3b15e38 thru 0x3b1de5e data_size 0x1(0x8027 bytes) 2019-12-16T22:46:06.813 INFO:teuthology.orchestra.run.smithi177.stdout:2089 trunc from 0xea05823 to 0xc65c1c3 2019-12-16T22:46:06.814 INFO:teuthology.orchestra.run.smithi177.stdout:1848 write 0x996e048 thru 0x9979f7e (0xbf37 bytes) 2019-12-16T22:46:06.834 INFO:teuthology.orchestra.run.smithi177.stdout:1849 read 0x91d82d1 thru 0x91e6f25 (0xec55 bytes) 2019-12-16T22:46:06.835 INFO:teuthology.orchestra.run.smithi177.stdout:1850 punch from 0x336b981 to 0x337114d, (0x57cc bytes) 2019-12-16T22:46:06.835 INFO:teuthology.orchestra.run.smithi177.stdout:1851 read 0x948a885 thru 0x949a018 (0xf794 bytes) 2019-12-16T22:46:06.835 INFO:teuthology.orchestra.run.smithi177.stdout:1852 read 0x560510c thru 0x5608ab2 (0x39a7 bytes) 2019-12-16T22:46:06.835 INFO:teuthology.orchestra.run.smithi177.stdout:1854 punch from 0x798662f to 0x7988133, (0x1b04 bytes) 2019-12-16T22:46:06.843 INFO:teuthology.orchestra.run.smithi177.stdout:2775 writesame 0xe1d56f0 thru 0xe1d88cc data_size 0x25(0x31dd bytes) 2019-12-16T22:46:06.845 INFO:teuthology.orchestra.run.smithi177.stdout:2776 write 0x1bf472c thru 0x1bfc9d2 (0x82a7 bytes) 2019-12-16T22:46:06.857 INFO:teuthology.orchestra.run.smithi177.stdout:2450 punch from 0x969c92a to 0x96ab76c, (0xee42 bytes) 2019-12-16T22:46:06.859 INFO:teuthology.orchestra.run.smithi177.stdout:2451 trunc from 0xb79d514 to 0x951469b 2019-12-16T22:46:06.875 INFO:teuthology.orchestra.run.smithi177.stdout:2779 write 0xd341b43 thru 0xd34f9d5 (0xde93 bytes) 2019-12-16T22:46:06.879 INFO:teuthology.orchestra.run.smithi177.stdout:1855 writesame 0xbdef614 thru 0xbdf7e69 data_size 0x15(0x8856 bytes) 2019-12-16T22:46:06.884 INFO:teuthology.orchestra.run.smithi177.stdout:1856 read 0x8558a8 thru 0x85f618 (0x9d71 bytes) 2019-12-16T22:46:06.885 INFO:teuthology.orchestra.run.smithi177.stdout:1857 write 0xae662ff thru 0xae6d64f (0x7351 bytes) 2019-12-16T22:46:06.885 INFO:teuthology.orchestra.run.smithi177.stdout:2091 trunc from 0xc65c1c3 to 0x27914d8 2019-12-16T22:46:06.909 INFO:teuthology.orchestra.run.smithi177.stdout:1858 trunc from 0xbdf7e6a to 0xb719662 2019-12-16T22:46:06.911 INFO:teuthology.orchestra.run.smithi177.stdout:2782 writesame 0xd2b7a0c thru 0xd2bc4ed data_size 0x47(0x4ae2 bytes) 2019-12-16T22:46:06.916 INFO:teuthology.orchestra.run.smithi177.stdout:2178 read 0x402f9d6 thru 0x40333ff (0x3a2a bytes) 2019-12-16T22:46:06.933 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.933 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.933 INFO:teuthology.orchestra.run.smithi177.stdout:2096 read 0x14b099f thru 0x14bcd94 (0xc3f6 bytes) 2019-12-16T22:46:06.934 INFO:teuthology.orchestra.run.smithi177.stdout:2098 write 0x1a17e62 thru 0x1a19c82 (0x1e21 bytes) 2019-12-16T22:46:06.943 INFO:teuthology.orchestra.run.smithi177.stdout:1859 write 0x7ddf447 thru 0x7deac1e (0xb7d8 bytes) 2019-12-16T22:46:06.951 INFO:teuthology.orchestra.run.smithi177.stdout:2100 trunc from 0x27914d8 to 0x499bba4 2019-12-16T22:46:06.958 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.958 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.958 INFO:teuthology.orchestra.run.smithi177.stdout:1863 read 0x1726291 thru 0x17360c9 (0xfe39 bytes) 2019-12-16T22:46:06.967 INFO:teuthology.orchestra.run.smithi177.stdout:2452 writesame 0x54142b1 thru 0x541ebcd data_size 0x1(0xa91d bytes) 2019-12-16T22:46:06.967 INFO:teuthology.orchestra.run.smithi177.stdout:2179 trunc from 0xecea5d5 to 0x3732279 2019-12-16T22:46:06.968 INFO:teuthology.orchestra.run.smithi177.stdout:2784 writesame 0xe9930f4 thru 0xe999769 data_size 0x56(0x6676 bytes) 2019-12-16T22:46:06.971 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:06.972 INFO:teuthology.orchestra.run.smithi177.stdout:2786 write 0x2087360 thru 0x20953da (0xe07b bytes) 2019-12-16T22:46:06.977 INFO:teuthology.orchestra.run.smithi177.stdout:1864 trunc from 0xb719662 to 0x259aeeb 2019-12-16T22:46:06.999 INFO:teuthology.orchestra.run.smithi177.stdout:2101 writesame 0x8c7d8 thru 0x91a3d data_size 0x35(0x5266 bytes) 2019-12-16T22:46:07.030 INFO:teuthology.orchestra.run.smithi177.stdout:2103 read 0xb8931b thru 0xb94211 (0xaef7 bytes) 2019-12-16T22:46:07.030 INFO:teuthology.orchestra.run.smithi177.stdout:2105 read 0x3d55bba thru 0x3d64d38 (0xf17f bytes) 2019-12-16T22:46:07.039 INFO:teuthology.orchestra.run.smithi177.stdout:2106 trunc from 0x499bba4 to 0xd08ce2 2019-12-16T22:46:07.053 INFO:teuthology.orchestra.run.smithi177.stdout:2787 punch from 0xc8e0516 to 0xc8ea6d3, (0xa1bd bytes) 2019-12-16T22:46:07.061 INFO:teuthology.orchestra.run.smithi177.stdout:2453 write 0x3f9d754 thru 0x3fa59fe (0x82ab bytes) 2019-12-16T22:46:07.072 INFO:teuthology.orchestra.run.smithi177.stdout:2790 trunc from 0xe99976a to 0x28e48ab 2019-12-16T22:46:07.109 INFO:teuthology.orchestra.run.smithi177.stdout:2456 read 0x7924744 thru 0x7929479 (0x4d36 bytes) 2019-12-16T22:46:07.110 INFO:teuthology.orchestra.run.smithi177.stdout:2457 punch from 0x1774086 to 0x177d468, (0x93e2 bytes) 2019-12-16T22:46:07.110 INFO:teuthology.orchestra.run.smithi177.stdout:2459 read 0x94d772f thru 0x94d8969 (0x123b bytes) 2019-12-16T22:46:07.110 INFO:teuthology.orchestra.run.smithi177.stdout:2460 read 0x6194742 thru 0x61a199b (0xd25a bytes) 2019-12-16T22:46:07.120 INFO:teuthology.orchestra.run.smithi177.stdout:1865 write 0x5ab79da thru 0x5abd163 (0x578a bytes) 2019-12-16T22:46:07.125 INFO:teuthology.orchestra.run.smithi177.stdout:2107 punch from 0xa446bd to 0xa49b6d, (0x54b0 bytes) 2019-12-16T22:46:07.126 INFO:teuthology.orchestra.run.smithi177.stdout:2109 punch from 0xff100 to 0x1004a2, (0x13a2 bytes) 2019-12-16T22:46:07.126 INFO:teuthology.orchestra.run.smithi177.stdout:2111 read 0xdd86 thru 0xf8b4 (0x1b2f bytes) 2019-12-16T22:46:07.126 INFO:teuthology.orchestra.run.smithi177.stdout:2112 read 0x7bb25d thru 0x7c94d0 (0xe274 bytes) 2019-12-16T22:46:07.128 INFO:teuthology.orchestra.run.smithi177.stdout:2113 read 0xf3d19 thru 0xfbaa2 (0x7d8a bytes) 2019-12-16T22:46:07.130 INFO:teuthology.orchestra.run.smithi177.stdout:2114 write 0x612093 thru 0x62153f (0xf4ad bytes) 2019-12-16T22:46:07.135 INFO:teuthology.orchestra.run.smithi177.stdout:1867 punch from 0x3160189 to 0x31690f5, (0x8f6c bytes) 2019-12-16T22:46:07.137 INFO:teuthology.orchestra.run.smithi177.stdout:1868 read 0x5169ef9 thru 0x51788f7 (0xe9ff bytes) 2019-12-16T22:46:07.138 INFO:teuthology.orchestra.run.smithi177.stdout:1870 read 0x1fbf824 thru 0x1fc3ad2 (0x42af bytes) 2019-12-16T22:46:07.142 INFO:teuthology.orchestra.run.smithi177.stdout:2115 punch from 0xc2fcbe to 0xc31d8d, (0x20cf bytes) 2019-12-16T22:46:07.143 INFO:teuthology.orchestra.run.smithi177.stdout:2180 write 0x7479009 thru 0x748583b (0xc833 bytes) 2019-12-16T22:46:07.154 INFO:teuthology.orchestra.run.smithi177.stdout:2461 write 0xc360857 thru 0xc367b6f (0x7319 bytes) 2019-12-16T22:46:07.179 INFO:teuthology.orchestra.run.smithi177.stdout:1871 write 0x69c007b thru 0x69c3fe1 (0x3f67 bytes) 2019-12-16T22:46:07.183 INFO:teuthology.orchestra.run.smithi177.stdout:2462 writesame 0x32e5797 thru 0x32ef317 data_size 0x2f(0x9b81 bytes) 2019-12-16T22:46:07.186 INFO:teuthology.orchestra.run.smithi177.stdout:1872 write 0x1b948e9 thru 0x1b9a5b6 (0x5cce bytes) 2019-12-16T22:46:07.189 INFO:teuthology.orchestra.run.smithi177.stdout:2116 writesame 0x45eed96 thru 0x45fa6f7 data_size 0x3d(0xb962 bytes) 2019-12-16T22:46:07.189 INFO:teuthology.orchestra.run.smithi177.stdout:2792 writesame 0xe2d4c8f thru 0xe2da265 data_size 0x19(0x55d7 bytes) 2019-12-16T22:46:07.193 INFO:teuthology.orchestra.run.smithi177.stdout:2117 write 0x21eb4dc thru 0x21ed45a (0x1f7f bytes) 2019-12-16T22:46:07.224 INFO:teuthology.orchestra.run.smithi177.stdout:2794 write 0x5731225 thru 0x573decb (0xcca7 bytes) 2019-12-16T22:46:07.226 INFO:teuthology.orchestra.run.smithi177.stdout:2181 write 0xbe7e7c1 thru 0xbe850e1 (0x6921 bytes) 2019-12-16T22:46:07.226 INFO:teuthology.orchestra.run.smithi177.stdout:2182 read 0xb08ce63 thru 0xb091df2 (0x4f90 bytes) 2019-12-16T22:46:07.226 INFO:teuthology.orchestra.run.smithi177.stdout:2183 write 0x3e318ff thru 0x3e3d834 (0xbf36 bytes) 2019-12-16T22:46:07.226 INFO:teuthology.orchestra.run.smithi177.stdout:1873 read 0x45d7fbe thru 0x45e2941 (0xa984 bytes) 2019-12-16T22:46:07.226 INFO:teuthology.orchestra.run.smithi177.stdout:1874 read 0x25f1d49 thru 0x25fe51c (0xc7d4 bytes) 2019-12-16T22:46:07.227 INFO:teuthology.orchestra.run.smithi177.stdout:1876 read 0x264dff7 thru 0x2657f7f (0x9f89 bytes) 2019-12-16T22:46:07.227 INFO:teuthology.orchestra.run.smithi177.stdout:1879 punch from 0x20dff43 to 0x20eeb1a, (0xebd7 bytes) 2019-12-16T22:46:07.227 INFO:teuthology.orchestra.run.smithi177.stdout:2118 trunc from 0x45fa6f8 to 0x80376cf 2019-12-16T22:46:07.259 INFO:teuthology.orchestra.run.smithi177.stdout:2188 write 0xebf951b thru 0xec006a5 (0x718b bytes) 2019-12-16T22:46:07.260 INFO:teuthology.orchestra.run.smithi177.stdout:2464 write 0xa88550b thru 0xa8905af (0xb0a5 bytes) 2019-12-16T22:46:07.268 INFO:teuthology.orchestra.run.smithi177.stdout:2796 writesame 0xb765815 thru 0xb771289 data_size 0x7(0xba75 bytes) 2019-12-16T22:46:07.280 INFO:teuthology.orchestra.run.smithi177.stdout:2189 write 0xbba2275 thru 0xbbaf3eb (0xd177 bytes) 2019-12-16T22:46:07.287 INFO:teuthology.orchestra.run.smithi177.stdout:1880 write 0xc846426 thru 0xc8558e8 (0xf4c3 bytes) 2019-12-16T22:46:07.288 INFO:teuthology.orchestra.run.smithi177.stdout:2797 write 0x5e3d7eb thru 0x5e3f35a (0x1b70 bytes) 2019-12-16T22:46:07.299 INFO:teuthology.orchestra.run.smithi177.stdout:1881 read 0xd24bf thru 0xd6136 (0x3c78 bytes) 2019-12-16T22:46:07.299 INFO:teuthology.orchestra.run.smithi177.stdout:1883 read 0x4f95ec3 thru 0x4f96026 (0x164 bytes) 2019-12-16T22:46:07.300 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.300 INFO:teuthology.orchestra.run.smithi177.stdout:1885 read 0x5113415 thru 0x51138c4 (0x4b0 bytes) 2019-12-16T22:46:07.300 INFO:teuthology.orchestra.run.smithi177.stdout:1886 write 0x749965e thru 0x749f6e7 (0x608a bytes) 2019-12-16T22:46:07.309 INFO:teuthology.orchestra.run.smithi177.stdout:2190 trunc from 0xec006a6 to 0x87df20f 2019-12-16T22:46:07.311 INFO:teuthology.orchestra.run.smithi177.stdout:2798 writesame 0x5d2fce4 thru 0x5d3c472 data_size 0x1(0xc78f bytes) 2019-12-16T22:46:07.315 INFO:teuthology.orchestra.run.smithi177.stdout:2120 write 0x9c3996b thru 0x9c3a36e (0xa04 bytes) 2019-12-16T22:46:07.316 INFO:teuthology.orchestra.run.smithi177.stdout:1887 trunc from 0xc8558e9 to 0xa4a46e7 2019-12-16T22:46:07.318 INFO:teuthology.orchestra.run.smithi177.stdout:2466 trunc from 0xc367b70 to 0x4025a13 2019-12-16T22:46:07.348 INFO:teuthology.orchestra.run.smithi177.stdout:2800 write 0x40c67dd thru 0x40cfcd0 (0x94f4 bytes) 2019-12-16T22:46:07.357 INFO:teuthology.orchestra.run.smithi177.stdout:2121 writesame 0x29c496e thru 0x29d44df data_size 0x29(0xfb72 bytes) 2019-12-16T22:46:07.375 INFO:teuthology.orchestra.run.smithi177.stdout:2122 read 0x4ee0919 thru 0x4eea566 (0x9c4e bytes) 2019-12-16T22:46:07.376 INFO:teuthology.orchestra.run.smithi177.stdout:2123 read 0x13161ac thru 0x13180e1 (0x1f36 bytes) 2019-12-16T22:46:07.387 INFO:teuthology.orchestra.run.smithi177.stdout:2191 writesame 0x2cafe43 thru 0x2cb92d8 data_size 0xe(0x9496 bytes) 2019-12-16T22:46:07.388 INFO:teuthology.orchestra.run.smithi177.stdout:2801 read 0x117e201 thru 0x1184a05 (0x6805 bytes) 2019-12-16T22:46:07.388 INFO:teuthology.orchestra.run.smithi177.stdout:2803 write 0xb9e6790 thru 0xb9f4d16 (0xe587 bytes) 2019-12-16T22:46:07.399 INFO:teuthology.orchestra.run.smithi177.stdout:2192 read 0x6282351 thru 0x628e7d1 (0xc481 bytes) 2019-12-16T22:46:07.399 INFO:teuthology.orchestra.run.smithi177.stdout:2193 read 0x10421e2 thru 0x104b9a8 (0x97c7 bytes) 2019-12-16T22:46:07.399 INFO:teuthology.orchestra.run.smithi177.stdout:2194 read 0x2658eae thru 0x265bbb3 (0x2d06 bytes) 2019-12-16T22:46:07.399 INFO:teuthology.orchestra.run.smithi177.stdout:2195 read 0x18f6a32 thru 0x18f95b5 (0x2b84 bytes) 2019-12-16T22:46:07.400 INFO:teuthology.orchestra.run.smithi177.stdout:2196 punch from 0x3a1c00d to 0x3a24b9e, (0x8b91 bytes) 2019-12-16T22:46:07.405 INFO:teuthology.orchestra.run.smithi177.stdout:2197 trunc from 0x87df20f to 0x5cecc7b 2019-12-16T22:46:07.410 INFO:teuthology.orchestra.run.smithi177.stdout:1888 trunc from 0xa4a46e7 to 0x8a2f883 2019-12-16T22:46:07.412 INFO:teuthology.orchestra.run.smithi177.stdout:2804 writesame 0x74a0aca thru 0x74ac262 data_size 0x1(0xb799 bytes) 2019-12-16T22:46:07.427 INFO:teuthology.orchestra.run.smithi177.stdout:2125 write 0xbd7efb5 thru 0xbd847f4 (0x5840 bytes) 2019-12-16T22:46:07.443 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:07.442+0000 7f85ca542700 -1 reset not still connected to 0x559a13d92c30 2019-12-16T22:46:07.445 INFO:teuthology.orchestra.run.smithi177.stdout:2126 writesame 0xad54702 thru 0xad582fc data_size 0x25(0x3bfb bytes) 2019-12-16T22:46:07.448 INFO:teuthology.orchestra.run.smithi177.stdout:2198 punch from 0x2cf729c to 0x2cf9462, (0x21c6 bytes) 2019-12-16T22:46:07.448 INFO:teuthology.orchestra.run.smithi177.stdout:2199 punch from 0x31d6893 to 0x31e1900, (0xb06d bytes) 2019-12-16T22:46:07.448 INFO:teuthology.orchestra.run.smithi177.stdout:2200 read 0x55546e5 thru 0x555c655 (0x7f71 bytes) 2019-12-16T22:46:07.458 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.463 INFO:teuthology.orchestra.run.smithi177.stdout:2806 read 0x8900e08 thru 0x8907161 (0x635a bytes) 2019-12-16T22:46:07.463 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.464 INFO:teuthology.orchestra.run.smithi177.stdout:2808 read 0x1df140d thru 0x1df5104 (0x3cf8 bytes) 2019-12-16T22:46:07.464 INFO:teuthology.orchestra.run.smithi177.stdout:2809 write 0x90c1060 thru 0x90c57d0 (0x4771 bytes) 2019-12-16T22:46:07.465 INFO:teuthology.orchestra.run.smithi177.stdout:2205 trunc from 0x5cecc7b to 0x816dced 2019-12-16T22:46:07.465 INFO:teuthology.orchestra.run.smithi177.stdout:1889 writesame 0x4bc9d86 thru 0x4bd8941 data_size 0xbc(0xebbc bytes) 2019-12-16T22:46:07.472 INFO:teuthology.orchestra.run.smithi177.stdout:1891 punch from 0x40ce6a4 to 0x40d5a4f, (0x73ab bytes) 2019-12-16T22:46:07.473 INFO:teuthology.orchestra.run.smithi177.stdout:1893 write 0x7fb00f4 thru 0x7fb5dd2 (0x5cdf bytes) 2019-12-16T22:46:07.475 INFO:teuthology.orchestra.run.smithi177.stdout:2467 write 0x6c27e8e thru 0x6c36ec1 (0xf034 bytes) 2019-12-16T22:46:07.480 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:07.478+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557465388e10 finish: resending after timeout 2019-12-16T22:46:07.481 INFO:teuthology.orchestra.run.smithi177.stdout:1895 read 0x6a02d85 thru 0x6a04ab1 (0x1d2d bytes) 2019-12-16T22:46:07.482 INFO:teuthology.orchestra.run.smithi177.stdout:1897 write 0x61c1032 thru 0x61c9dd6 (0x8da5 bytes) 2019-12-16T22:46:07.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:07.478+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557464da6960 finish: resending after timeout 2019-12-16T22:46:07.483 INFO:teuthology.orchestra.run.smithi177.stdout:2127 trunc from 0xbd847f5 to 0x392434 2019-12-16T22:46:07.488 INFO:teuthology.orchestra.run.smithi177.stdout:2810 read 0x3c9aca4 thru 0x3ca3d95 (0x90f2 bytes) 2019-12-16T22:46:07.489 INFO:teuthology.orchestra.run.smithi177.stdout:2206 write 0x226911f thru 0x226ded6 (0x4db8 bytes) 2019-12-16T22:46:07.492 INFO:teuthology.orchestra.run.smithi177.stdout:1898 read 0x129c3ab thru 0x129e293 (0x1ee9 bytes) 2019-12-16T22:46:07.536 INFO:teuthology.orchestra.run.smithi177.stdout:2811 write 0xec79de6 thru 0xec84c89 (0xaea4 bytes) 2019-12-16T22:46:07.536 INFO:teuthology.orchestra.run.smithi177.stdout:2468 punch from 0x342c6ea to 0x34373a8, (0xacbe bytes) 2019-12-16T22:46:07.542 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.543 INFO:teuthology.orchestra.run.smithi177.stdout:2129 punch from 0x1da611 to 0x1dc051, (0x1a40 bytes) 2019-12-16T22:46:07.545 INFO:teuthology.orchestra.run.smithi177.stdout:2208 writesame 0xa16e51c thru 0xa17708a data_size 0xb(0x8b6f bytes) 2019-12-16T22:46:07.546 INFO:teuthology.orchestra.run.smithi177.stdout:1899 write 0xa008e12 thru 0xa00e8bb (0x5aaa bytes) 2019-12-16T22:46:07.549 INFO:teuthology.orchestra.run.smithi177.stdout:2469 trunc from 0x6c36ec2 to 0xd1bb9a 2019-12-16T22:46:07.554 INFO:teuthology.orchestra.run.smithi177.stdout:1900 write 0x27b500d thru 0x27b74f7 (0x24eb bytes) 2019-12-16T22:46:07.555 INFO:teuthology.orchestra.run.smithi177.stdout:2209 punch from 0x83f70c7 to 0x83fb102, (0x403b bytes) 2019-12-16T22:46:07.555 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.555 INFO:teuthology.orchestra.run.smithi177.stdout:2213 read 0x892342c thru 0x892e6ad (0xb282 bytes) 2019-12-16T22:46:07.557 INFO:teuthology.orchestra.run.smithi177.stdout:2812 write 0x24f067e thru 0x24ff5fd (0xef80 bytes) 2019-12-16T22:46:07.572 INFO:teuthology.orchestra.run.smithi177.stdout:1901 clone 18 order 24 su 4194304 sc 2 2019-12-16T22:46:07.596 INFO:teuthology.orchestra.run.smithi177.stdout:2813 read 0xc1c29c7 thru 0xc1cf8ad (0xcee7 bytes) 2019-12-16T22:46:07.597 INFO:teuthology.orchestra.run.smithi177.stdout:2814 read 0x8b0712f thru 0x8b101cb (0x909d bytes) 2019-12-16T22:46:07.597 INFO:teuthology.orchestra.run.smithi177.stdout:2815 write 0x94c1546 thru 0x94c8abe (0x7579 bytes) 2019-12-16T22:46:07.600 INFO:teuthology.orchestra.run.smithi177.stdout:2131 writesame 0x699dddf thru 0x69a4a2d data_size 0x7(0x6c4f bytes) 2019-12-16T22:46:07.604 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.604 INFO:teuthology.orchestra.run.smithi177.stdout:2134 read 0x45fae27 thru 0x4604a43 (0x9c1d bytes) 2019-12-16T22:46:07.604 INFO:teuthology.orchestra.run.smithi177.stdout:2136 punch from 0x3320056 to 0x33207aa, (0x754 bytes) 2019-12-16T22:46:07.613 INFO:teuthology.orchestra.run.smithi177.stdout:2214 write 0xb16c396 thru 0xb16dbb4 (0x181f bytes) 2019-12-16T22:46:07.631 INFO:teuthology.orchestra.run.smithi177.stdout:2215 punch from 0x2c2796d to 0x2c344aa, (0xcb3d bytes) 2019-12-16T22:46:07.631 INFO:teuthology.orchestra.run.smithi177.stdout:2216 read 0xf728be thru 0xf8004b (0xd78e bytes) 2019-12-16T22:46:07.632 INFO:teuthology.orchestra.run.smithi177.stdout:2218 write 0x96d8990 thru 0x96da555 (0x1bc6 bytes) 2019-12-16T22:46:07.645 INFO:teuthology.orchestra.run.smithi177.stdout:2219 read 0x1cbd454 thru 0x1ccc0c8 (0xec75 bytes) 2019-12-16T22:46:07.646 INFO:teuthology.orchestra.run.smithi177.stdout:2220 write 0xb0e8aa8 thru 0xb0f3cb1 (0xb20a bytes) 2019-12-16T22:46:07.660 INFO:teuthology.orchestra.run.smithi177.stdout:2221 writesame 0x109bfad thru 0x10a897d data_size 0x1(0xc9d1 bytes) 2019-12-16T22:46:07.678 INFO:teuthology.orchestra.run.smithi177.stdout:2137 write 0xe563dd7 thru 0xe571bab (0xddd5 bytes) 2019-12-16T22:46:07.702 INFO:teuthology.orchestra.run.smithi177.stdout:2818 punch from 0x56148b to 0x56f340, (0xdeb5 bytes) 2019-12-16T22:46:07.702 INFO:teuthology.orchestra.run.smithi177.stdout:2819 write 0xebdfba6 thru 0xebe407c (0x44d7 bytes) 2019-12-16T22:46:07.717 INFO:teuthology.orchestra.run.smithi177.stdout:2139 punch from 0x43b8524 to 0x43bc972, (0x444e bytes) 2019-12-16T22:46:07.718 INFO:teuthology.orchestra.run.smithi177.stdout:2821 writesame 0xcbe2216 thru 0xcbe9a57 data_size 0x15(0x7842 bytes) 2019-12-16T22:46:07.743 INFO:teuthology.orchestra.run.smithi177.stdout:2471 read 0x348a68 thru 0x35172d (0x8cc6 bytes) 2019-12-16T22:46:07.743 INFO:teuthology.orchestra.run.smithi177.stdout:2472 read 0x39c045 thru 0x3a39fb (0x79b7 bytes) 2019-12-16T22:46:07.743 INFO:teuthology.orchestra.run.smithi177.stdout:2140 trunc from 0xe571bac to 0x71a2d93 2019-12-16T22:46:07.743 INFO:teuthology.orchestra.run.smithi177.stdout:2823 punch from 0x4b373e8 to 0x4b3ca88, (0x56a0 bytes) 2019-12-16T22:46:07.743 INFO:teuthology.orchestra.run.smithi177.stdout:2826 write 0xa490659 thru 0xa490760 (0x108 bytes) 2019-12-16T22:46:07.754 INFO:teuthology.orchestra.run.smithi177.stdout:2828 write 0x30f9a0e thru 0x30f9b43 (0x136 bytes) 2019-12-16T22:46:07.768 INFO:teuthology.orchestra.run.smithi177.stdout:2829 punch from 0xb126e4a to 0xb12ba6c, (0x4c22 bytes) 2019-12-16T22:46:07.769 INFO:teuthology.orchestra.run.smithi177.stdout:2831 write 0x36b01df thru 0x36bda28 (0xd84a bytes) 2019-12-16T22:46:07.769 INFO:teuthology.orchestra.run.smithi177.stdout:2222 writesame 0xec510b0 thru 0xec5875a data_size 0x1(0x76ab bytes) 2019-12-16T22:46:07.775 INFO:teuthology.orchestra.run.smithi177.stdout:2223 read 0xdfb2662 thru 0xdfb744c (0x4deb bytes) 2019-12-16T22:46:07.776 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.776 INFO:teuthology.orchestra.run.smithi177.stdout:2224 writesame 0x63cc6b3 thru 0x63dc60d data_size 0x1(0xff5b bytes) 2019-12-16T22:46:07.783 INFO:teuthology.orchestra.run.smithi177.stdout:2473 writesame 0x9bcd32b thru 0x9bda973 data_size 0x1(0xd649 bytes) 2019-12-16T22:46:07.797 INFO:teuthology.orchestra.run.smithi177.stdout:2832 read 0xe882022 thru 0xe888052 (0x6031 bytes) 2019-12-16T22:46:07.798 INFO:teuthology.orchestra.run.smithi177.stdout:2833 read 0x292cc8d thru 0x2937cb2 (0xb026 bytes) 2019-12-16T22:46:07.811 INFO:teuthology.orchestra.run.smithi177.stdout:2834 trunc from 0xec84c8a to 0x69923a3 2019-12-16T22:46:07.842 INFO:teuthology.orchestra.run.smithi177.stdout:2225 read 0xaa3aa16 thru 0xaa3d665 (0x2c50 bytes) 2019-12-16T22:46:07.842 INFO:teuthology.orchestra.run.smithi177.stdout:2226 punch from 0x6f23bcd to 0x6f2fe53, (0xc286 bytes) 2019-12-16T22:46:07.843 INFO:teuthology.orchestra.run.smithi177.stdout:2227 read 0xea4c134 thru 0xea526d7 (0x65a4 bytes) 2019-12-16T22:46:07.843 INFO:teuthology.orchestra.run.smithi177.stdout:2228 read 0x7661838 thru 0x766e4d5 (0xcc9e bytes) 2019-12-16T22:46:07.843 INFO:teuthology.orchestra.run.smithi177.stdout:2229 read 0x7c7453b thru 0x7c789ca (0x4490 bytes) 2019-12-16T22:46:07.844 INFO:teuthology.orchestra.run.smithi177.stdout:2230 writesame 0x1356e1f thru 0x135f6c5 data_size 0x45(0x88a7 bytes) 2019-12-16T22:46:07.850 INFO:teuthology.orchestra.run.smithi177.stdout:2232 write 0xb8b3b1b thru 0xb8c3605 (0xfaeb bytes) 2019-12-16T22:46:07.850 INFO:teuthology.orchestra.run.smithi177.stdout:2142 writesame 0xbe25420 thru 0xbe30944 data_size 0x1(0xb525 bytes) 2019-12-16T22:46:07.858 INFO:teuthology.orchestra.run.smithi177.stdout:2474 writesame 0xaf8f6d2 thru 0xaf8ff6d data_size 0x4(0x89c bytes) 2019-12-16T22:46:07.858 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.858 INFO:teuthology.orchestra.run.smithi177.stdout:2144 read 0x1f09e44 thru 0x1f1440a (0xa5c7 bytes) 2019-12-16T22:46:07.858 INFO:teuthology.orchestra.run.smithi177.stdout:2145 write 0x83520ab thru 0x83528dc (0x832 bytes) 2019-12-16T22:46:07.859 INFO:teuthology.orchestra.run.smithi177.stdout:2233 trunc from 0xec5875b to 0xdf6b0bc 2019-12-16T22:46:07.863 INFO:teuthology.orchestra.run.smithi177.stdout:2475 punch from 0x1afc7b9 to 0x1afcfa6, (0x7ed bytes) 2019-12-16T22:46:07.863 INFO:teuthology.orchestra.run.smithi177.stdout:2476 writesame 0x50c9c0c thru 0x50cae2b data_size 0x28(0x1220 bytes) 2019-12-16T22:46:07.876 INFO:teuthology.orchestra.run.smithi177.stdout:2146 punch from 0x2368c3d to 0x237031c, (0x76df bytes) 2019-12-16T22:46:07.877 INFO:teuthology.orchestra.run.smithi177.stdout:2147 writesame 0x9172246 thru 0x9181cd7 data_size 0x3(0xfa92 bytes) 2019-12-16T22:46:07.884 INFO:teuthology.orchestra.run.smithi177.stdout:2477 read 0x67a5688 thru 0x67a6204 (0xb7d bytes) 2019-12-16T22:46:07.898 INFO:teuthology.orchestra.run.smithi177.stdout:2478 trunc from 0xaf8ff6e to 0x23bdf3d 2019-12-16T22:46:07.902 INFO:teuthology.orchestra.run.smithi177.stdout:2148 writesame 0x6ecf059 thru 0x6ed0567 data_size 0x3(0x150f bytes) 2019-12-16T22:46:07.908 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:07.912 INFO:teuthology.orchestra.run.smithi177.stdout:2835 punch from 0x5e89723 to 0x5e96d93, (0xd670 bytes) 2019-12-16T22:46:07.918 INFO:teuthology.orchestra.run.smithi177.stdout:2149 write 0x7bb322c thru 0x7bbc595 (0x936a bytes) 2019-12-16T22:46:07.919 INFO:teuthology.orchestra.run.smithi177.stdout:2235 trunc from 0xdf6b0bc to 0x85c3d2c 2019-12-16T22:46:07.936 INFO:teuthology.orchestra.run.smithi177.stdout:2152 write 0x9a4e959 thru 0x9a4fc28 (0x12d0 bytes) 2019-12-16T22:46:07.951 INFO:teuthology.orchestra.run.smithi177.stdout:2479 punch from 0x202253b to 0x20259b1, (0x3476 bytes) 2019-12-16T22:46:07.954 INFO:teuthology.orchestra.run.smithi177.stdout:2153 write 0x2903309 thru 0x2908052 (0x4d4a bytes) 2019-12-16T22:46:07.960 INFO:teuthology.orchestra.run.smithi177.stdout:2838 write 0x8173002 thru 0x817bcde (0x8cdd bytes) 2019-12-16T22:46:07.965 INFO:teuthology.orchestra.run.smithi177.stdout:2236 write 0x45d6f17 thru 0x45e3a3e (0xcb28 bytes) 2019-12-16T22:46:07.994 INFO:teuthology.orchestra.run.smithi177.stdout:2157 trunc from 0xbe30945 to 0x7afd5b 2019-12-16T22:46:07.999 INFO:teuthology.orchestra.run.smithi177.stdout:2238 write 0x7e9cd5 thru 0x7f542d (0xb759 bytes) 2019-12-16T22:46:08.013 INFO:teuthology.orchestra.run.smithi177.stdout:2239 write 0x81ee958 thru 0x81f1d66 (0x340f bytes) 2019-12-16T22:46:08.017 INFO:teuthology.orchestra.run.smithi177.stdout:2840 write 0x8c0c31 thru 0x8c67c8 (0x5b98 bytes) 2019-12-16T22:46:08.033 INFO:teuthology.orchestra.run.smithi177.stdout:2480 writesame 0x523d3d5 thru 0x524140c data_size 0x3c(0x4038 bytes) 2019-12-16T22:46:08.034 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.034 INFO:teuthology.orchestra.run.smithi177.stdout:2243 writesame 0x4b46119 thru 0x4b50eed data_size 0x1(0xadd5 bytes) 2019-12-16T22:46:08.053 INFO:teuthology.orchestra.run.smithi177.stdout:2481 trunc from 0x524140d to 0x9ecd78f 2019-12-16T22:46:08.076 INFO:teuthology.orchestra.run.smithi177.stdout:2842 punch from 0x71b014e to 0x71b934e, (0x9200 bytes) 2019-12-16T22:46:08.077 INFO:teuthology.orchestra.run.smithi177.stdout:2846 write 0x16230c6 thru 0x162bd95 (0x8cd0 bytes) 2019-12-16T22:46:08.082 INFO:teuthology.orchestra.run.smithi177.stdout:2244 punch from 0x7a308c1 to 0x7a337d8, (0x2f17 bytes) 2019-12-16T22:46:08.120 INFO:teuthology.orchestra.run.smithi177.stdout:2847 punch from 0x4f417ed to 0x4f43912, (0x2125 bytes) 2019-12-16T22:46:08.120 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.120 INFO:teuthology.orchestra.run.smithi177.stdout:2849 read 0x1b9c7be thru 0x1ba495a (0x819d bytes) 2019-12-16T22:46:08.122 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.122 INFO:teuthology.orchestra.run.smithi177.stdout:2851 write 0x53a1f40 thru 0x53a2771 (0x832 bytes) 2019-12-16T22:46:08.131 INFO:teuthology.orchestra.run.smithi177.stdout:2160 read 0x6540e3 thru 0x6562bf (0x21dd bytes) 2019-12-16T22:46:08.135 INFO:teuthology.orchestra.run.smithi177.stdout:2245 writesame 0x9237a61 thru 0x9244527 data_size 0x25(0xcac7 bytes) 2019-12-16T22:46:08.136 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.136 INFO:teuthology.orchestra.run.smithi177.stdout:2162 read 0x390cee thru 0x394cf7 (0x400a bytes) 2019-12-16T22:46:08.138 INFO:teuthology.orchestra.run.smithi177.stdout:2852 read 0x309ceaa thru 0x30a5687 (0x87de bytes) 2019-12-16T22:46:08.144 INFO:teuthology.orchestra.run.smithi177.stdout:2247 writesame 0x69f4553 thru 0x69fb527 data_size 0x3(0x6fd5 bytes) 2019-12-16T22:46:08.155 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.155 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.155 INFO:teuthology.orchestra.run.smithi177.stdout:2250 writesame 0x26049b4 thru 0x261033c data_size 0x1(0xb989 bytes) 2019-12-16T22:46:08.168 INFO:teuthology.orchestra.run.smithi177.stdout:2853 trunc from 0x817bcdf to 0x11900b3 2019-12-16T22:46:08.201 INFO:teuthology.orchestra.run.smithi177.stdout:2251 punch from 0x83dbdb2 to 0x83e7b19, (0xbd67 bytes) 2019-12-16T22:46:08.202 INFO:teuthology.orchestra.run.smithi177.stdout:2253 read 0x832fb6 thru 0x83f54e (0xc599 bytes) 2019-12-16T22:46:08.203 INFO:teuthology.orchestra.run.smithi177.stdout:2254 read 0x1bbd633 thru 0x1bbe941 (0x130f bytes) 2019-12-16T22:46:08.219 INFO:teuthology.orchestra.run.smithi177.stdout:2482 write 0xe89b1cd thru 0xe89ecb0 (0x3ae4 bytes) 2019-12-16T22:46:08.238 INFO:teuthology.orchestra.run.smithi177.stdout:2163 write 0x8b6edb9 thru 0x8b7b7a3 (0xc9eb bytes) 2019-12-16T22:46:08.263 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.265 INFO:teuthology.orchestra.run.smithi177.stdout:2483 trunc from 0xe89ecb1 to 0x3a8461a 2019-12-16T22:46:08.266 INFO:teuthology.orchestra.run.smithi177.stdout:2854 read 0xe03668 thru 0xe1202e (0xe9c7 bytes) 2019-12-16T22:46:08.266 INFO:teuthology.orchestra.run.smithi177.stdout:2856 read 0x507610 thru 0x516b8e (0xf57f bytes) 2019-12-16T22:46:08.267 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.268 INFO:teuthology.orchestra.run.smithi177.stdout:2859 punch from 0x10785e0 to 0x107fcd0, (0x76f0 bytes) 2019-12-16T22:46:08.268 INFO:teuthology.orchestra.run.smithi177.stdout:2256 write 0xb054856 thru 0xb0558f7 (0x10a2 bytes) 2019-12-16T22:46:08.277 INFO:teuthology.orchestra.run.smithi177.stdout:2257 write 0x5a53740 thru 0x5a5ef8a (0xb84b bytes) 2019-12-16T22:46:08.292 INFO:teuthology.orchestra.run.smithi177.stdout:2258 punch from 0x781f257 to 0x78227b7, (0x3560 bytes) 2019-12-16T22:46:08.292 INFO:teuthology.orchestra.run.smithi177.stdout:2259 punch from 0x26b1ffe to 0x26b6999, (0x499b bytes) 2019-12-16T22:46:08.292 INFO:teuthology.orchestra.run.smithi177.stdout:2261 writesame 0x70a5023 thru 0x70aa8d1 data_size 0x1(0x58af bytes) 2019-12-16T22:46:08.317 INFO:teuthology.orchestra.run.smithi177.stdout:2861 write 0x193466f thru 0x193cbfd (0x858f bytes) 2019-12-16T22:46:08.320 INFO:teuthology.orchestra.run.smithi177.stdout:2165 writesame 0xca09196 thru 0xca0c447 data_size 0x3f(0x32b2 bytes) 2019-12-16T22:46:08.324 INFO:teuthology.orchestra.run.smithi177.stdout:2262 trunc from 0xb0558f8 to 0x57f0a49 2019-12-16T22:46:08.333 INFO:teuthology.orchestra.run.smithi177.stdout:2166 trunc from 0xca0c448 to 0x7d63526 2019-12-16T22:46:08.356 INFO:teuthology.orchestra.run.smithi177.stdout:2862 read 0x2a33ab thru 0x2ae26c (0xaec2 bytes) 2019-12-16T22:46:08.356 INFO:teuthology.orchestra.run.smithi177.stdout:2484 read 0x3a761e9 thru 0x3a7c3d1 (0x61e9 bytes) 2019-12-16T22:46:08.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.354+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3ad8a6970 2019-12-16T22:46:08.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.354+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3ad8a6e50 2019-12-16T22:46:08.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.354+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3ad8a7740 2019-12-16T22:46:08.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.354+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e6340 2019-12-16T22:46:08.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.354+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e68f0 2019-12-16T22:46:08.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.354+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e6c30 2019-12-16T22:46:08.363 INFO:teuthology.orchestra.run.smithi177.stdout:2863 read 0x16e0977 thru 0x16ed149 (0xc7d3 bytes) 2019-12-16T22:46:08.363 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e7a00 2019-12-16T22:46:08.363 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e7fb0 2019-12-16T22:46:08.364 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e8cb0 2019-12-16T22:46:08.364 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e8d80 2019-12-16T22:46:08.364 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e9e90 2019-12-16T22:46:08.364 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1562340 2019-12-16T22:46:08.364 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1565e90 2019-12-16T22:46:08.364 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19465b0 2019-12-16T22:46:08.364 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1947860 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1947fb0 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1948490 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19490c0 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1aeec30 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1aefa00 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1aeffb0 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1af1260 2019-12-16T22:46:08.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1af1b50 2019-12-16T22:46:08.366 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1af1c20 2019-12-16T22:46:08.366 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2873330 2019-12-16T22:46:08.366 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2a2f0c0 2019-12-16T22:46:08.366 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T22:46:08.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2a2f9b0 2019-12-16T22:46:08.366 INFO:teuthology.orchestra.run.smithi177.stdout:2485 trunc from 0x3a8461a to 0x7315752 2019-12-16T22:46:08.369 INFO:teuthology.orchestra.run.smithi177.stdout:2864 trunc from 0x193cbfe to 0x6d1bf21 2019-12-16T22:46:08.375 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone17 from 0xa00e8bc (overlap 0x19ab7d) to 0x148930 2019-12-16T22:46:08.378 INFO:teuthology.orchestra.run.smithi177.stdout:2264 read 0x162a661 thru 0x16352b8 (0xac58 bytes) 2019-12-16T22:46:08.379 INFO:teuthology.orchestra.run.smithi177.stdout:2266 read 0x2416c2a thru 0x242393b (0xcd12 bytes) 2019-12-16T22:46:08.380 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.392 INFO:teuthology.orchestra.run.smithi177.stdout:2167 read 0x2cc297b thru 0x2cc51dd (0x2863 bytes) 2019-12-16T22:46:08.392 INFO:teuthology.orchestra.run.smithi177.stdout:2168 read 0x3ee8fa2 thru 0x3ef1151 (0x81b0 bytes) 2019-12-16T22:46:08.401 INFO:teuthology.orchestra.run.smithi177.stdout:2170 trunc from 0x7d63526 to 0x26d1c3f 2019-12-16T22:46:08.407 INFO:teuthology.orchestra.run.smithi177.stdout:2486 trunc from 0x7315752 to 0x1aac0ea 2019-12-16T22:46:08.427 INFO:teuthology.orchestra.run.smithi177.stdout:2268 write 0x886135b thru 0x886bd78 (0xaa1e bytes) 2019-12-16T22:46:08.457 INFO:teuthology.orchestra.run.smithi177.stdout:2865 write 0xa0abe2a thru 0xa0b09ca (0x4ba1 bytes) 2019-12-16T22:46:08.482 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x560118708820 2019-12-16T22:46:08.483 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011a55e340 2019-12-16T22:46:08.483 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:46:08.483 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011c5f3860 2019-12-16T22:46:08.483 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011ce14dd0 2019-12-16T22:46:08.483 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011ce167d0 2019-12-16T22:46:08.483 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474490 2019-12-16T22:46:08.483 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474b10 2019-12-16T22:46:08.485 INFO:teuthology.orchestra.run.smithi177.stdout:2270 write 0x906f842 thru 0x90704c4 (0xc83 bytes) 2019-12-16T22:46:08.485 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:08.482+0000 7f884a7b2700 -1 reset not still connected to 0x56011fa3f4d0 2019-12-16T22:46:08.495 INFO:teuthology.orchestra.run.smithi177.stdout:2487 write 0x48d47b0 thru 0x48d5a03 (0x1254 bytes) 2019-12-16T22:46:08.495 INFO:teuthology.orchestra.run.smithi177.stdout:2866 write 0x76b2f20 thru 0x76bb9cc (0x8aad bytes) 2019-12-16T22:46:08.500 INFO:teuthology.orchestra.run.smithi177.stdout:2272 trunc from 0x90704c5 to 0x5c1b67b 2019-12-16T22:46:08.508 INFO:teuthology.orchestra.run.smithi177.stdout:2488 clone 17 order 18 su 1024 sc 15 2019-12-16T22:46:08.509 INFO:teuthology.orchestra.run.smithi177.stdout:2171 write 0xcf672bf thru 0xcf6e8a6 (0x75e8 bytes) 2019-12-16T22:46:08.524 INFO:teuthology.orchestra.run.smithi177.stdout:2867 punch from 0x7c0afad to 0x7c1482c, (0x987f bytes) 2019-12-16T22:46:08.524 INFO:teuthology.orchestra.run.smithi177.stdout:2869 punch from 0x235e1ab to 0x2368535, (0xa38a bytes) 2019-12-16T22:46:08.528 INFO:teuthology.orchestra.run.smithi177.stdout:2172 punch from 0xcee9a7c to 0xcef563d, (0xbbc1 bytes) 2019-12-16T22:46:08.528 INFO:teuthology.orchestra.run.smithi177.stdout:2173 read 0x824f9b3 thru 0x825e490 (0xeade bytes) 2019-12-16T22:46:08.528 INFO:teuthology.orchestra.run.smithi177.stdout:2176 write 0xb9825e6 thru 0xb98a665 (0x8080 bytes) 2019-12-16T22:46:08.534 INFO:teuthology.orchestra.run.smithi177.stdout:2870 trunc from 0xa0b09cb to 0x4162559 2019-12-16T22:46:08.537 INFO:teuthology.orchestra.run.smithi177.stdout:2177 punch from 0x6170d0 to 0x61a391, (0x32c1 bytes) 2019-12-16T22:46:08.538 INFO:teuthology.orchestra.run.smithi177.stdout:2178 punch from 0xa5a1388 to 0xa5a297d, (0x15f5 bytes) 2019-12-16T22:46:08.538 INFO:teuthology.orchestra.run.smithi177.stdout:2179 write 0x145356f thru 0x145c5df (0x9071 bytes) 2019-12-16T22:46:08.551 INFO:teuthology.orchestra.run.smithi177.stdout:2180 punch from 0x46aa157 to 0x46b3c79, (0x9b22 bytes) 2019-12-16T22:46:08.551 INFO:teuthology.orchestra.run.smithi177.stdout:2181 writesame 0xb0fbde4 thru 0xb10095a data_size 0x1(0x4b77 bytes) 2019-12-16T22:46:08.571 INFO:teuthology.orchestra.run.smithi177.stdout:2182 read 0x1fffbd thru 0x203bf5 (0x3c39 bytes) 2019-12-16T22:46:08.571 INFO:teuthology.orchestra.run.smithi177.stdout:2183 write 0x63ae3e2 thru 0x63bc36f (0xdf8e bytes) 2019-12-16T22:46:08.575 INFO:teuthology.orchestra.run.smithi177.stdout:2273 write 0xb580866 thru 0xb58a66b (0x9e06 bytes) 2019-12-16T22:46:08.586 INFO:teuthology.orchestra.run.smithi177.stdout:2184 writesame 0x37386df thru 0x3739444 data_size 0x7(0xd66 bytes) 2019-12-16T22:46:08.595 INFO:teuthology.orchestra.run.smithi177.stdout:2275 trunc from 0xb58a66c to 0x4c56b3e 2019-12-16T22:46:08.611 INFO:teuthology.orchestra.run.smithi177.stdout:2186 trunc from 0xcf6e8a7 to 0x25f079b 2019-12-16T22:46:08.627 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #16, image image_cluster1.client.mirror.2-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent17 2019-12-16T22:46:08.643 INFO:teuthology.orchestra.run.smithi177.stdout:2276 write 0x54a6937 thru 0x54b64fe (0xfbc8 bytes) 2019-12-16T22:46:08.655 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.656 INFO:teuthology.orchestra.run.smithi177.stdout:1904 read 0x3aef7 thru 0x41503 (0x660d bytes) 2019-12-16T22:46:08.671 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #17, image image_cluster1.client.mirror.4-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent18 2019-12-16T22:46:08.672 INFO:teuthology.orchestra.run.smithi177.stdout:1906 read 0x7a72a5 thru 0x7aabc4 (0x3920 bytes) 2019-12-16T22:46:08.672 INFO:teuthology.orchestra.run.smithi177.stdout:1908 write 0x9bd12f0 thru 0x9bde08a (0xcd9b bytes) 2019-12-16T22:46:08.676 INFO:teuthology.orchestra.run.smithi177.stdout:2188 writesame 0x8ac38d6 thru 0x8ac99e0 data_size 0x27(0x610b bytes) 2019-12-16T22:46:08.702 INFO:teuthology.orchestra.run.smithi177.stdout:2277 write 0x6e118e6 thru 0x6e1f14d (0xd868 bytes) 2019-12-16T22:46:08.703 INFO:teuthology.orchestra.run.smithi177.stdout:2278 read 0x1f87424 thru 0x1f90d42 (0x991f bytes) 2019-12-16T22:46:08.703 INFO:teuthology.orchestra.run.smithi177.stdout:2279 trunc from 0x6e1f14e to 0x71b7032 2019-12-16T22:46:08.703 INFO:teuthology.orchestra.run.smithi177.stdout:2190 trunc from 0x8ac99e1 to 0x3bdca20 2019-12-16T22:46:08.703 INFO:teuthology.orchestra.run.smithi177.stdout:1909 trunc from 0xa00e8bc to 0x67b4478 2019-12-16T22:46:08.703 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.706 INFO:teuthology.orchestra.run.smithi177.stdout:2280 punch from 0x5838a00 to 0x5847076, (0xe676 bytes) 2019-12-16T22:46:08.706 INFO:teuthology.orchestra.run.smithi177.stdout:2246 trunc from 0xe6b32d5 to 0xb1b2939 2019-12-16T22:46:08.717 INFO:teuthology.orchestra.run.smithi177.stdout:2192 write 0x334f3 thru 0x3bb7f (0x868d bytes) 2019-12-16T22:46:08.719 INFO:teuthology.orchestra.run.smithi177.stdout:2281 trunc from 0x71b7032 to 0xcfb3df 2019-12-16T22:46:08.734 INFO:teuthology.orchestra.run.smithi177.stdout:1911 punch from 0x2b32e9c to 0x2b3fa66, (0xcbca bytes) 2019-12-16T22:46:08.748 INFO:teuthology.orchestra.run.smithi177.stdout:1913 trunc from 0x67b4478 to 0x7ac8cc 2019-12-16T22:46:08.751 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.751 INFO:teuthology.orchestra.run.smithi177.stdout:2284 write 0x6fd9ca thru 0x6fe532 (0xb69 bytes) 2019-12-16T22:46:08.760 INFO:teuthology.orchestra.run.smithi177.stdout:2193 write 0x9a7f3b8 thru 0x9a837ea (0x4433 bytes) 2019-12-16T22:46:08.792 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.792 INFO:teuthology.orchestra.run.smithi177.stdout:2196 read 0x250bebb thru 0x251557f (0x96c5 bytes) 2019-12-16T22:46:08.792 INFO:teuthology.orchestra.run.smithi177.stdout:2197 read 0x31d9a1f thru 0x31e4305 (0xa8e7 bytes) 2019-12-16T22:46:08.792 INFO:teuthology.orchestra.run.smithi177.stdout:2198 write 0x1cdac50 thru 0x1cdd415 (0x27c6 bytes) 2019-12-16T22:46:08.796 INFO:teuthology.orchestra.run.smithi177.stdout:2871 trunc from 0x4162559 to 0xdf2a235 2019-12-16T22:46:08.800 INFO:teuthology.orchestra.run.smithi177.stdout:2285 write 0x140953c thru 0x1414db6 (0xb87b bytes) 2019-12-16T22:46:08.806 INFO:teuthology.orchestra.run.smithi177.stdout:1914 punch from 0x5f6bb0 to 0x601896, (0xace6 bytes) 2019-12-16T22:46:08.806 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.806 INFO:teuthology.orchestra.run.smithi177.stdout:1916 punch from 0x37403b to 0x3834f1, (0xf4b6 bytes) 2019-12-16T22:46:08.807 INFO:teuthology.orchestra.run.smithi177.stdout:1917 punch from 0x18667d to 0x19357d, (0xcf00 bytes) 2019-12-16T22:46:08.832 INFO:teuthology.orchestra.run.smithi177.stdout:1920 write 0x346756f thru 0x3475676 (0xe108 bytes) 2019-12-16T22:46:08.856 INFO:teuthology.orchestra.run.smithi177.stdout:2200 write 0xb0cf42f thru 0xb0d2915 (0x34e7 bytes) 2019-12-16T22:46:08.867 INFO:teuthology.orchestra.run.smithi177.stdout:2201 punch from 0x60064e2 to 0x60111de, (0xacfc bytes) 2019-12-16T22:46:08.868 INFO:teuthology.orchestra.run.smithi177.stdout:2202 read 0x1c9bbe9 thru 0x1c9c545 (0x95d bytes) 2019-12-16T22:46:08.868 INFO:teuthology.orchestra.run.smithi177.stdout:2204 read 0x777747c thru 0x7779bcc (0x2751 bytes) 2019-12-16T22:46:08.868 INFO:teuthology.orchestra.run.smithi177.stdout:2206 writesame 0x6460d2 thru 0x64d0bd data_size 0x4c(0x6fec bytes) 2019-12-16T22:46:08.874 INFO:teuthology.orchestra.run.smithi177.stdout:2286 write 0xaeffdca thru 0xaf0c765 (0xc99c bytes) 2019-12-16T22:46:08.874 INFO:teuthology.orchestra.run.smithi177.stdout:2207 writesame 0x735f75a thru 0x736cfaa data_size 0x3f(0xd851 bytes) 2019-12-16T22:46:08.877 INFO:teuthology.orchestra.run.smithi177.stdout:1921 write 0x39b89be thru 0x39c2a7e (0xa0c1 bytes) 2019-12-16T22:46:08.884 INFO:teuthology.orchestra.run.smithi177.stdout:2873 read 0x5968b05 thru 0x596ba5e (0x2f5a bytes) 2019-12-16T22:46:08.885 INFO:teuthology.orchestra.run.smithi177.stdout:2874 writesame 0x489c5d8 thru 0x48a83e3 data_size 0x2(0xbe0c bytes) 2019-12-16T22:46:08.887 INFO:teuthology.orchestra.run.smithi177.stdout:2287 writesame 0x8608749 thru 0x8614e33 data_size 0x1(0xc6eb bytes) 2019-12-16T22:46:08.890 INFO:teuthology.orchestra.run.smithi177.stdout:1922 trunc from 0x39c2a7f to 0x3cf87f5 2019-12-16T22:46:08.894 INFO:teuthology.orchestra.run.smithi177.stdout:2208 write 0x45675bf thru 0x457465c (0xd09e bytes) 2019-12-16T22:46:08.923 INFO:teuthology.orchestra.run.smithi177.stdout:2875 read 0x4a48dd3 thru 0x4a535c0 (0xa7ee bytes) 2019-12-16T22:46:08.924 INFO:teuthology.orchestra.run.smithi177.stdout:2876 write 0x526b3bc thru 0x526dc91 (0x28d6 bytes) 2019-12-16T22:46:08.926 INFO:teuthology.orchestra.run.smithi177.stdout:2209 read 0x738bee2 thru 0x73908c7 (0x49e6 bytes) 2019-12-16T22:46:08.926 INFO:teuthology.orchestra.run.smithi177.stdout:2210 writesame 0x4b7d67c thru 0x4b7ee32 data_size 0x1(0x17b7 bytes) 2019-12-16T22:46:08.936 INFO:teuthology.orchestra.run.smithi177.stdout:2288 read 0x9f44b19 thru 0x9f4da28 (0x8f10 bytes) 2019-12-16T22:46:08.937 INFO:teuthology.orchestra.run.smithi177.stdout:2289 punch from 0x4d09ad9 to 0x4d0ddb6, (0x42dd bytes) 2019-12-16T22:46:08.937 INFO:teuthology.orchestra.run.smithi177.stdout:2290 punch from 0x298c387 to 0x298edfc, (0x2a75 bytes) 2019-12-16T22:46:08.938 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.938 INFO:teuthology.orchestra.run.smithi177.stdout:2292 write 0x621eb09 thru 0x6224526 (0x5a1e bytes) 2019-12-16T22:46:08.939 INFO:teuthology.orchestra.run.smithi177.stdout:2879 read 0xad3225e thru 0xad41ade (0xf881 bytes) 2019-12-16T22:46:08.939 INFO:teuthology.orchestra.run.smithi177.stdout:2880 write 0x2002384 thru 0x200ba8f (0x970c bytes) 2019-12-16T22:46:08.942 INFO:teuthology.orchestra.run.smithi177.stdout:2211 write 0x9dfb53b thru 0x9e00483 (0x4f49 bytes) 2019-12-16T22:46:08.952 INFO:teuthology.orchestra.run.smithi177.stdout:2213 writesame 0x6b1fcb8 thru 0x6b2caab data_size 0xe(0xcdf4 bytes) 2019-12-16T22:46:08.952 INFO:teuthology.orchestra.run.smithi177.stdout:2295 read 0x95fe66a thru 0x9606573 (0x7f0a bytes) 2019-12-16T22:46:08.953 INFO:teuthology.orchestra.run.smithi177.stdout:2298 writesame 0xa684152 thru 0xa692657 data_size 0x41(0xe506 bytes) 2019-12-16T22:46:08.960 INFO:teuthology.orchestra.run.smithi177.stdout:2881 punch from 0x8f569d9 to 0x8f59adc, (0x3103 bytes) 2019-12-16T22:46:08.963 INFO:teuthology.orchestra.run.smithi177.stdout:2301 read 0x59eb0a9 thru 0x59ec797 (0x16ef bytes) 2019-12-16T22:46:08.964 INFO:teuthology.orchestra.run.smithi177.stdout:2882 trunc from 0xdf2a235 to 0xcc12d3f 2019-12-16T22:46:08.964 INFO:teuthology.orchestra.run.smithi177.stdout:2302 write 0x70aa71c thru 0x70ba26a (0xfb4f bytes) 2019-12-16T22:46:08.966 INFO:teuthology.orchestra.run.smithi177.stdout:2214 read 0x7541f2d thru 0x754e754 (0xc828 bytes) 2019-12-16T22:46:08.972 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:08.973 INFO:teuthology.orchestra.run.smithi177.stdout:2304 read 0x81abe3 thru 0x81b232 (0x650 bytes) 2019-12-16T22:46:08.995 INFO:teuthology.orchestra.run.smithi177.stdout:2883 read 0x45ae554 thru 0x45b5732 (0x71df bytes) 2019-12-16T22:46:08.995 INFO:teuthology.orchestra.run.smithi177.stdout:2884 punch from 0x2afee28 to 0x2b07d18, (0x8ef0 bytes) 2019-12-16T22:46:08.996 INFO:teuthology.orchestra.run.smithi177.stdout:2885 punch from 0xbe2cd44 to 0xbe3bc40, (0xeefc bytes) 2019-12-16T22:46:08.996 INFO:teuthology.orchestra.run.smithi177.stdout:2886 writesame 0x8c2408b thru 0x8c2f727 data_size 0x1(0xb69d bytes) 2019-12-16T22:46:08.996 INFO:teuthology.orchestra.run.smithi177.stdout:2215 write 0xca002d9 thru 0xca04c56 (0x497e bytes) 2019-12-16T22:46:08.997 INFO:teuthology.orchestra.run.smithi177.stdout:1924 write 0xa83c6b5 thru 0xa847db6 (0xb702 bytes) 2019-12-16T22:46:09.006 INFO:teuthology.orchestra.run.smithi177.stdout:2216 write 0x9bb8c50 thru 0x9bc18c5 (0x8c76 bytes) 2019-12-16T22:46:09.010 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:09.010 INFO:teuthology.orchestra.run.smithi177.stdout:1928 read 0x743317 thru 0x74441f (0x1109 bytes) 2019-12-16T22:46:09.011 INFO:teuthology.orchestra.run.smithi177.stdout:1929 read 0x297cfc5 thru 0x2989d12 (0xcd4e bytes) 2019-12-16T22:46:09.012 INFO:teuthology.orchestra.run.smithi177.stdout:1930 punch from 0x75ed4e2 to 0x75f0dfd, (0x391b bytes) 2019-12-16T22:46:09.012 INFO:teuthology.orchestra.run.smithi177.stdout:1931 writesame 0x3659e93 thru 0x365c763 data_size 0x2b(0x28d1 bytes) 2019-12-16T22:46:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:1932 punch from 0x6b0d178 to 0x6b19f76, (0xcdfe bytes) 2019-12-16T22:46:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:1934 read 0x4d8ff65 thru 0x4d9657a (0x6616 bytes) 2019-12-16T22:46:09.026 INFO:teuthology.orchestra.run.smithi177.stdout:1935 clone 19 order 23 su 65536 sc 10 2019-12-16T22:46:09.029 INFO:teuthology.orchestra.run.smithi177.stdout:2305 writesame 0xdb69c81 thru 0xdb72afc data_size 0x16(0x8e7c bytes) 2019-12-16T22:46:09.029 INFO:teuthology.orchestra.run.smithi177.stdout:2218 write 0x8f14e18 thru 0x8f21b9a (0xcd83 bytes) 2019-12-16T22:46:09.031 INFO:teuthology.orchestra.run.smithi177.stdout:2888 read 0x6c7d724 thru 0x6c8b474 (0xdd51 bytes) 2019-12-16T22:46:09.032 INFO:teuthology.orchestra.run.smithi177.stdout:2889 write 0x18b45b6 thru 0x18c2672 (0xe0bd bytes) 2019-12-16T22:46:09.041 INFO:teuthology.orchestra.run.smithi177.stdout:2306 write 0xa2766b8 thru 0xa27cbce (0x6517 bytes) 2019-12-16T22:46:09.049 INFO:teuthology.orchestra.run.smithi177.stdout:2890 punch from 0xb6d3ef9 to 0xb6d8e21, (0x4f28 bytes) 2019-12-16T22:46:09.049 INFO:teuthology.orchestra.run.smithi177.stdout:2892 punch from 0x71ea14e to 0x71f9af4, (0xf9a6 bytes) 2019-12-16T22:46:09.050 INFO:teuthology.orchestra.run.smithi177.stdout:2893 punch from 0x50f709a to 0x50f8358, (0x12be bytes) 2019-12-16T22:46:09.050 INFO:teuthology.orchestra.run.smithi177.stdout:2894 writesame 0xf9e505 thru 0xf9f696 data_size 0xd(0x1192 bytes) 2019-12-16T22:46:09.052 INFO:teuthology.orchestra.run.smithi177.stdout:2307 punch from 0x6e76306 to 0x6e7a140, (0x3e3a bytes) 2019-12-16T22:46:09.052 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:09.052 INFO:teuthology.orchestra.run.smithi177.stdout:2310 read 0x4fc5592 thru 0x4fd0d4e (0xb7bd bytes) 2019-12-16T22:46:09.053 INFO:teuthology.orchestra.run.smithi177.stdout:2311 writesame 0xcacc12c thru 0xcacc6f0 data_size 0x1(0x5c5 bytes) 2019-12-16T22:46:09.053 INFO:teuthology.orchestra.run.smithi177.stdout:2219 read 0x927817a thru 0x9281c0c (0x9a93 bytes) 2019-12-16T22:46:09.054 INFO:teuthology.orchestra.run.smithi177.stdout:2221 writesame 0x354a60f thru 0x3550d77 data_size 0x1(0x6769 bytes) 2019-12-16T22:46:09.062 INFO:teuthology.orchestra.run.smithi177.stdout:2312 read 0x63bedaf thru 0x63c0a46 (0x1c98 bytes) 2019-12-16T22:46:09.062 INFO:teuthology.orchestra.run.smithi177.stdout:2896 write 0x4d94114 thru 0x4d97ae1 (0x39ce bytes) 2019-12-16T22:46:09.063 INFO:teuthology.orchestra.run.smithi177.stdout:2313 write 0x22ea877 thru 0x22eee77 (0x4601 bytes) 2019-12-16T22:46:09.086 INFO:teuthology.orchestra.run.smithi177.stdout:2223 writesame 0x4b0f51d thru 0x4b17b95 data_size 0x87(0x8679 bytes) 2019-12-16T22:46:09.136 INFO:teuthology.orchestra.run.smithi177.stdout:2315 write 0x134684d thru 0x135130d (0xaac1 bytes) 2019-12-16T22:46:09.142 INFO:teuthology.orchestra.run.smithi177.stdout:2225 read 0x9725d4e thru 0x9727e06 (0x20b9 bytes) 2019-12-16T22:46:09.142 INFO:teuthology.orchestra.run.smithi177.stdout:2226 writesame 0x937a6ff thru 0x937ac45 data_size 0x1(0x547 bytes) 2019-12-16T22:46:09.155 INFO:teuthology.orchestra.run.smithi177.stdout:2897 read 0x2ab217a thru 0x2ab7b01 (0x5988 bytes) 2019-12-16T22:46:09.155 INFO:teuthology.orchestra.run.smithi177.stdout:2899 write 0xbf6543a thru 0xbf70d6c (0xb933 bytes) 2019-12-16T22:46:09.158 INFO:teuthology.orchestra.run.smithi177.stdout:2228 trunc from 0xca04c57 to 0xe414344 2019-12-16T22:46:09.173 INFO:teuthology.orchestra.run.smithi177.stdout:2317 read 0x8c93aa7 thru 0x8c95e99 (0x23f3 bytes) 2019-12-16T22:46:09.175 INFO:teuthology.orchestra.run.smithi177.stdout:2318 read 0x91ce5bd thru 0x91dd26a (0xecae bytes) 2019-12-16T22:46:09.176 INFO:teuthology.orchestra.run.smithi177.stdout:2320 read 0x95f4f4f thru 0x95fd838 (0x88ea bytes) 2019-12-16T22:46:09.203 INFO:teuthology.orchestra.run.smithi177.stdout:2321 trunc from 0xdb72afd to 0x2dcb006 2019-12-16T22:46:09.217 INFO:teuthology.orchestra.run.smithi177.stdout:2900 trunc from 0xcc12d3f to 0x3fe9257 2019-12-16T22:46:09.218 INFO:teuthology.orchestra.run.smithi177.stdout:2229 read 0x82eea80 thru 0x82fd529 (0xeaaa bytes) 2019-12-16T22:46:09.218 INFO:teuthology.orchestra.run.smithi177.stdout:2231 writesame 0x7eda12d thru 0x7edf7e5 data_size 0x1(0x56b9 bytes) 2019-12-16T22:46:09.246 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:09.246 INFO:teuthology.orchestra.run.smithi177.stdout:2233 writesame 0x77b61d0 thru 0x77bfa48 data_size 0x3(0x9879 bytes) 2019-12-16T22:46:09.257 INFO:teuthology.orchestra.run.smithi177.stdout:2322 read 0x1c57f56 thru 0x1c57f9a (0x45 bytes) 2019-12-16T22:46:09.265 INFO:teuthology.orchestra.run.smithi177.stdout:2235 clone 20 order 24 su 524288 sc 3 2019-12-16T22:46:09.278 INFO:teuthology.orchestra.run.smithi177.stdout:2323 trunc from 0x2dcb006 to 0xea507df 2019-12-16T22:46:09.513 INFO:teuthology.orchestra.run.smithi177.stdout:2324 punch from 0xd153613 to 0xd1557c3, (0x21b0 bytes) 2019-12-16T22:46:09.514 INFO:teuthology.orchestra.run.smithi177.stdout:2325 read 0x5d9da54 thru 0x5d9f890 (0x1e3d bytes) 2019-12-16T22:46:09.514 INFO:teuthology.orchestra.run.smithi177.stdout:2327 read 0x52e4f5a thru 0x52e6459 (0x1500 bytes) 2019-12-16T22:46:09.515 INFO:teuthology.orchestra.run.smithi177.stdout:2328 write 0x567bea5 thru 0x567c8b9 (0xa15 bytes) 2019-12-16T22:46:09.518 INFO:teuthology.orchestra.run.smithi177.stdout:2901 write 0x8cd7e35 thru 0x8ce5756 (0xd922 bytes) 2019-12-16T22:46:09.540 INFO:teuthology.orchestra.run.smithi177.stdout:2902 read 0x37d06f7 thru 0x37d3ec6 (0x37d0 bytes) 2019-12-16T22:46:09.540 INFO:teuthology.orchestra.run.smithi177.stdout:2903 punch from 0x5faf523 to 0x5fbcdb0, (0xd88d bytes) 2019-12-16T22:46:09.541 INFO:teuthology.orchestra.run.smithi177.stdout:2904 punch from 0x42991fe to 0x42a49d5, (0xb7d7 bytes) 2019-12-16T22:46:09.545 INFO:teuthology.orchestra.run.smithi177.stdout:2330 trunc from 0xea507df to 0x71aee37 2019-12-16T22:46:09.582 INFO:teuthology.orchestra.run.smithi177.stdout:2905 writesame 0xe6005cf thru 0xe60c67b data_size 0x5(0xc0ad bytes) 2019-12-16T22:46:09.583 INFO:teuthology.orchestra.run.smithi177.stdout:2331 trunc from 0x71aee37 to 0x6b25734 2019-12-16T22:46:09.587 INFO:teuthology.orchestra.run.smithi177.stdout:2906 write 0xc1253e0 thru 0xc12be77 (0x6a98 bytes) 2019-12-16T22:46:09.598 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone18 from 0xa847db7 (overlap 0x7ac8cc) to 0xc4747 2019-12-16T22:46:09.598 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone16 from 0x48d5a04 (overlap 0xd1bb9a) to 0x0 2019-12-16T22:46:09.619 INFO:teuthology.orchestra.run.smithi177.stdout:2333 read 0x42a18b6 thru 0x42af34c (0xda97 bytes) 2019-12-16T22:46:09.622 INFO:teuthology.orchestra.run.smithi177.stdout:2334 write 0x55e7875 thru 0x55ece92 (0x561e bytes) 2019-12-16T22:46:09.626 INFO:teuthology.orchestra.run.smithi177.stdout:2336 read 0x27351e2 thru 0x273c67f (0x749e bytes) 2019-12-16T22:46:09.626 INFO:teuthology.orchestra.run.smithi177.stdout:2337 read 0x2105043 thru 0x210862a (0x35e8 bytes) 2019-12-16T22:46:09.627 INFO:teuthology.orchestra.run.smithi177.stdout:2339 read 0x5d63e6 thru 0x5dde2d (0x7a48 bytes) 2019-12-16T22:46:09.627 INFO:teuthology.orchestra.run.smithi177.stdout:2908 trunc from 0xe60c67c to 0x6f0de1e 2019-12-16T22:46:09.629 INFO:teuthology.orchestra.run.smithi177.stdout:2247 trunc from 0xb1b2939 to 0xa687225 2019-12-16T22:46:09.672 INFO:teuthology.orchestra.run.smithi177.stdout:2340 writesame 0xa49ee03 thru 0xa4a66db data_size 0x1(0x78d9 bytes) 2019-12-16T22:46:09.677 INFO:teuthology.orchestra.run.smithi177.stdout:2342 read 0x2012fc3 thru 0x201db5d (0xab9b bytes) 2019-12-16T22:46:09.678 INFO:teuthology.orchestra.run.smithi177.stdout:2343 write 0x288a345 thru 0x2890fea (0x6ca6 bytes) 2019-12-16T22:46:09.695 INFO:teuthology.orchestra.run.smithi177.stdout:2344 write 0x184643d thru 0x184978b (0x334f bytes) 2019-12-16T22:46:09.720 INFO:teuthology.orchestra.run.smithi177.stdout:2345 clone 23 order 18 su 2048 sc 6 2019-12-16T22:46:09.833 INFO:teuthology.orchestra.run.smithi177.stdout:2909 read 0x5f850f thru 0x6056ef (0xd1e1 bytes) 2019-12-16T22:46:09.847 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #17, image image_cluster1.client.mirror.2-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent18 2019-12-16T22:46:09.869 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:09.869 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:09.898 INFO:teuthology.orchestra.run.smithi177.stdout:1936 read 0x42e2b36 thru 0x42ea460 (0x792b bytes) 2019-12-16T22:46:09.937 INFO:teuthology.orchestra.run.smithi177.stdout:1937 read 0x9158f0 thru 0x9243bc (0xeacd bytes) 2019-12-16T22:46:09.944 INFO:teuthology.orchestra.run.smithi177.stdout:1938 trunc from 0xa847db7 to 0x71e5988 2019-12-16T22:46:09.961 INFO:teuthology.orchestra.run.smithi177.stdout:2913 writesame 0xa826d11 thru 0xa82d2eb data_size 0x19(0x65db bytes) 2019-12-16T22:46:09.965 INFO:teuthology.orchestra.run.smithi177.stdout:2914 punch from 0x5b96d4 to 0x5b9f32, (0x85e bytes) 2019-12-16T22:46:09.965 INFO:teuthology.orchestra.run.smithi177.stdout:2915 writesame 0xa11f489 thru 0xa125932 data_size 0xf(0x64aa bytes) 2019-12-16T22:46:09.988 INFO:teuthology.orchestra.run.smithi177.stdout:2916 read 0x1fae86d thru 0x1fb442a (0x5bbe bytes) 2019-12-16T22:46:10.011 INFO:teuthology.orchestra.run.smithi177.stdout:1939 trunc from 0x71e5988 to 0x810f075 2019-12-16T22:46:10.052 INFO:teuthology.orchestra.run.smithi177.stdout:2917 write 0xb0e57ef thru 0xb0ec949 (0x715b bytes) 2019-12-16T22:46:10.099 INFO:teuthology.orchestra.run.smithi177.stdout:1941 write 0xe6154a8 thru 0xe620bd8 (0xb731 bytes) 2019-12-16T22:46:10.125 INFO:teuthology.orchestra.run.smithi177.stdout:1942 punch from 0xd943a41 to 0xd94f0a5, (0xb664 bytes) 2019-12-16T22:46:10.126 INFO:teuthology.orchestra.run.smithi177.stdout:1943 write 0x59f5aa thru 0x5a284a (0x32a1 bytes) 2019-12-16T22:46:10.148 INFO:teuthology.orchestra.run.smithi177.stdout:2919 trunc from 0xb0ec94a to 0xccfbf7b 2019-12-16T22:46:10.168 INFO:teuthology.orchestra.run.smithi177.stdout:1945 trunc from 0xe620bd9 to 0xa4fc5bc 2019-12-16T22:46:10.172 INFO:teuthology.orchestra.run.smithi177.stdout:2920 writesame 0xb41d155 thru 0xb425c51 data_size 0x17(0x8afd bytes) 2019-12-16T22:46:10.196 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.197 INFO:teuthology.orchestra.run.smithi177.stdout:2923 write 0x67ae0ac thru 0x67b31de (0x5133 bytes) 2019-12-16T22:46:10.206 INFO:teuthology.orchestra.run.smithi177.stdout:1946 punch from 0x3f3f2ad to 0x3f432ea, (0x403d bytes) 2019-12-16T22:46:10.207 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.207 INFO:teuthology.orchestra.run.smithi177.stdout:1948 read 0x5b680a6 thru 0x5b6a7fe (0x2759 bytes) 2019-12-16T22:46:10.208 INFO:teuthology.orchestra.run.smithi177.stdout:1949 punch from 0x102ff3a to 0x103b802, (0xb8c8 bytes) 2019-12-16T22:46:10.208 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.208 INFO:teuthology.orchestra.run.smithi177.stdout:1952 punch from 0x3bf330d to 0x3bfb0e5, (0x7dd8 bytes) 2019-12-16T22:46:10.219 INFO:teuthology.orchestra.run.smithi177.stdout:1953 trunc from 0xa4fc5bc to 0x4e79697 2019-12-16T22:46:10.220 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.221 INFO:teuthology.orchestra.run.smithi177.stdout:2927 writesame 0x7e748e4 thru 0x7e7dd73 data_size 0x8(0x9490 bytes) 2019-12-16T22:46:10.279 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone22 from 0xa4a66dc (overlap 0xcfb3df) to 0x3e4f8f 2019-12-16T22:46:10.291 INFO:teuthology.orchestra.run.smithi177.stdout:2929 read 0x4b35991 thru 0x4b41632 (0xbca2 bytes) 2019-12-16T22:46:10.291 INFO:teuthology.orchestra.run.smithi177.stdout:2930 writesame 0xad64c1c thru 0xad6cfbc data_size 0x1(0x83a1 bytes) 2019-12-16T22:46:10.355 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.356 INFO:teuthology.orchestra.run.smithi177.stdout:2932 read 0x7f8ef0c thru 0x7f96782 (0x7877 bytes) 2019-12-16T22:46:10.358 INFO:teuthology.orchestra.run.smithi177.stdout:2933 trunc from 0xccfbf7b to 0xe4231c8 2019-12-16T22:46:10.401 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #15, image image_cluster1.client.mirror.5-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent16 2019-12-16T22:46:10.409 INFO:teuthology.orchestra.run.smithi177.stdout:2934 write 0xc49be5e thru 0xc4a9381 (0xd524 bytes) 2019-12-16T22:46:10.439 INFO:teuthology.orchestra.run.smithi177.stdout:2936 read 0x904d123 thru 0x9058661 (0xb53f bytes) 2019-12-16T22:46:10.440 INFO:teuthology.orchestra.run.smithi177.stdout:2937 read 0xde0eeeb thru 0xde1e0b1 (0xf1c7 bytes) 2019-12-16T22:46:10.440 INFO:teuthology.orchestra.run.smithi177.stdout:2938 write 0xee6cb5 thru 0xef5c20 (0xef6c bytes) 2019-12-16T22:46:10.580 INFO:teuthology.orchestra.run.smithi177.stdout:1954 read 0x2f95de0 thru 0x2fa461a (0xe83b bytes) 2019-12-16T22:46:10.580 INFO:teuthology.orchestra.run.smithi177.stdout:2939 write 0x2db62ae thru 0x2db7fa5 (0x1cf8 bytes) 2019-12-16T22:46:10.587 INFO:teuthology.orchestra.run.smithi177.stdout:2940 write 0x98dd344 thru 0x98e7a43 (0xa700 bytes) 2019-12-16T22:46:10.596 INFO:teuthology.orchestra.run.smithi177.stdout:1956 trunc from 0x4e79697 to 0x9f9aff8 2019-12-16T22:46:10.601 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #21, image image_cluster1.client.mirror.0-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent22 2019-12-16T22:46:10.609 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone19 from 0xe414344 (overlap 0x2980bd) to 0x2133ca 2019-12-16T22:46:10.618 INFO:teuthology.orchestra.run.smithi177.stdout:1957 punch from 0x846291b to 0x8468eaa, (0x658f bytes) 2019-12-16T22:46:10.629 INFO:teuthology.orchestra.run.smithi177.stdout:2941 punch from 0x373a86c to 0x373dd29, (0x34bd bytes) 2019-12-16T22:46:10.644 INFO:teuthology.orchestra.run.smithi177.stdout:2942 trunc from 0xe4231c8 to 0x8395e66 2019-12-16T22:46:10.661 INFO:teuthology.orchestra.run.smithi177.stdout:1958 writesame 0xca2179a thru 0xca2eba5 data_size 0x52(0xd40c bytes) 2019-12-16T22:46:10.665 INFO:teuthology.orchestra.run.smithi177.stdout:2489 write 0xbf266a6 thru 0xbf2b34f (0x4caa bytes) 2019-12-16T22:46:10.675 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.709 INFO:teuthology.orchestra.run.smithi177.stdout:1961 write 0xda0ab94 thru 0xda1867d (0xdaea bytes) 2019-12-16T22:46:10.718 INFO:teuthology.orchestra.run.smithi177.stdout:2943 trunc from 0x8395e66 to 0x4e118c8 2019-12-16T22:46:10.723 INFO:teuthology.orchestra.run.smithi177.stdout:1962 read 0x6c20d71 thru 0x6c2a843 (0x9ad3 bytes) 2019-12-16T22:46:10.723 INFO:teuthology.orchestra.run.smithi177.stdout:1963 punch from 0x80e9f1f to 0x80f0709, (0x67ea bytes) 2019-12-16T22:46:10.724 INFO:teuthology.orchestra.run.smithi177.stdout:1964 write 0xb58fd8b thru 0xb594027 (0x429d bytes) 2019-12-16T22:46:10.741 INFO:teuthology.orchestra.run.smithi177.stdout:1965 punch from 0x803b5a0 to 0x804449b, (0x8efb bytes) 2019-12-16T22:46:10.741 INFO:teuthology.orchestra.run.smithi177.stdout:1966 punch from 0x3ab543e to 0x3ab8171, (0x2d33 bytes) 2019-12-16T22:46:10.741 INFO:teuthology.orchestra.run.smithi177.stdout:1967 punch from 0x13debb1 to 0x13e1b9a, (0x2fe9 bytes) 2019-12-16T22:46:10.741 INFO:teuthology.orchestra.run.smithi177.stdout:1968 write 0xa621020 thru 0xa62915a (0x813b bytes) 2019-12-16T22:46:10.750 INFO:teuthology.orchestra.run.smithi177.stdout:2490 trunc from 0xbf2b350 to 0x2c5ee41 2019-12-16T22:46:10.758 INFO:teuthology.orchestra.run.smithi177.stdout:1969 read 0xb15e094 thru 0xb16c608 (0xe575 bytes) 2019-12-16T22:46:10.759 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.759 INFO:teuthology.orchestra.run.smithi177.stdout:1972 write 0xc111a98 thru 0xc114744 (0x2cad bytes) 2019-12-16T22:46:10.782 INFO:teuthology.orchestra.run.smithi177.stdout:2944 punch from 0x29b833b to 0x29bfc93, (0x7958 bytes) 2019-12-16T22:46:10.782 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.783 INFO:teuthology.orchestra.run.smithi177.stdout:2948 read 0x2e098c1 thru 0x2e16dfa (0xd53a bytes) 2019-12-16T22:46:10.783 INFO:teuthology.orchestra.run.smithi177.stdout:2949 read 0x2e65446 thru 0x2e697b0 (0x436b bytes) 2019-12-16T22:46:10.784 INFO:teuthology.orchestra.run.smithi177.stdout:2950 punch from 0x125e3d3 to 0x126d2d4, (0xef01 bytes) 2019-12-16T22:46:10.795 INFO:teuthology.orchestra.run.smithi177.stdout:1973 write 0xe040d09 thru 0xe04de0d (0xd105 bytes) 2019-12-16T22:46:10.802 INFO:teuthology.orchestra.run.smithi177.stdout:1975 read 0x2fde945 thru 0x2fe23ef (0x3aab bytes) 2019-12-16T22:46:10.802 INFO:teuthology.orchestra.run.smithi177.stdout:1976 punch from 0x7b4e3df to 0x7b5c9cb, (0xe5ec bytes) 2019-12-16T22:46:10.802 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.803 INFO:teuthology.orchestra.run.smithi177.stdout:1978 write 0xa59c417 thru 0xa59c9dc (0x5c6 bytes) 2019-12-16T22:46:10.807 INFO:teuthology.orchestra.run.smithi177.stdout:1979 read 0xc748683 thru 0xc74d0c6 (0x4a44 bytes) 2019-12-16T22:46:10.808 INFO:teuthology.orchestra.run.smithi177.stdout:1982 write 0x32a7ba3 thru 0x32aa864 (0x2cc2 bytes) 2019-12-16T22:46:10.808 INFO:teuthology.orchestra.run.smithi177.stdout:2952 write 0x58c57b2 thru 0x58d003c (0xa88b bytes) 2019-12-16T22:46:10.850 INFO:teuthology.orchestra.run.smithi177.stdout:2953 read 0x139d7fb thru 0x13abd69 (0xe56f bytes) 2019-12-16T22:46:10.850 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.851 INFO:teuthology.orchestra.run.smithi177.stdout:2955 write 0x84d5c6 thru 0x8585c8 (0xb003 bytes) 2019-12-16T22:46:10.854 INFO:teuthology.orchestra.run.smithi177.stdout:2491 read 0x9139ee thru 0x91a969 (0x6f7c bytes) 2019-12-16T22:46:10.860 INFO:teuthology.orchestra.run.smithi177.stdout:2493 punch from 0x8ec5da to 0x8f64e7, (0x9f0d bytes) 2019-12-16T22:46:10.861 INFO:teuthology.orchestra.run.smithi177.stdout:2957 punch from 0x458b419 to 0x4594fcd, (0x9bb4 bytes) 2019-12-16T22:46:10.899 INFO:teuthology.orchestra.run.smithi177.stdout:2958 writesame 0xcc20e7e thru 0xcc2768d data_size 0x4a(0x6810 bytes) 2019-12-16T22:46:10.900 INFO:teuthology.orchestra.run.smithi177.stdout:2495 write 0xe4edef0 thru 0xe4fce00 (0xef11 bytes) 2019-12-16T22:46:10.902 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.903 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.903 INFO:teuthology.orchestra.run.smithi177.stdout:2962 write 0x3a86467 thru 0x3a925a9 (0xc143 bytes) 2019-12-16T22:46:10.923 INFO:teuthology.orchestra.run.smithi177.stdout:2964 write 0xacc1f79 thru 0xacca1b0 (0x8238 bytes) 2019-12-16T22:46:10.936 INFO:teuthology.orchestra.run.smithi177.stdout:2965 writesame 0xa243f5e thru 0xa24d70a data_size 0x2b(0x97ad bytes) 2019-12-16T22:46:10.950 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:10.950 INFO:teuthology.orchestra.run.smithi177.stdout:2967 read 0x29de4c2 thru 0x29e4971 (0x64b0 bytes) 2019-12-16T22:46:10.950 INFO:teuthology.orchestra.run.smithi177.stdout:2968 write 0x818df61 thru 0x8190c1d (0x2cbd bytes) 2019-12-16T22:46:10.967 INFO:teuthology.orchestra.run.smithi177.stdout:2969 trunc from 0xcc2768e to 0xb5d853c 2019-12-16T22:46:10.991 INFO:teuthology.orchestra.run.smithi177.stdout:1985 write 0x4400af7 thru 0x440bbe3 (0xb0ed bytes) 2019-12-16T22:46:11.000 INFO:teuthology.orchestra.run.smithi177.stdout:1986 write 0x7d5dfb4 thru 0x7d66d1d (0x8d6a bytes) 2019-12-16T22:46:11.017 INFO:teuthology.orchestra.run.smithi177.stdout:1987 clone 20 order 20 su 65536 sc 4 2019-12-16T22:46:11.030 INFO:teuthology.orchestra.run.smithi177.stdout:2971 trunc from 0xb5d853c to 0x565bf9f 2019-12-16T22:46:11.046 INFO:teuthology.orchestra.run.smithi177.stdout:2497 read 0xa11b0a4 thru 0xa11e0cb (0x3028 bytes) 2019-12-16T22:46:11.061 INFO:teuthology.orchestra.run.smithi177.stdout:2498 trunc from 0xe4fce01 to 0x70367f9 2019-12-16T22:46:11.063 INFO:teuthology.orchestra.run.smithi177.stdout:2973 read 0x5204a4e thru 0x520adf9 (0x63ac bytes) 2019-12-16T22:46:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:2976 punch from 0x1957384 to 0x195e7d2, (0x744e bytes) 2019-12-16T22:46:11.064 INFO:teuthology.orchestra.run.smithi177.stdout:2978 read 0x4812c75 thru 0x481a63e (0x79ca bytes) 2019-12-16T22:46:11.077 INFO:teuthology.orchestra.run.smithi177.stdout:2248 clone 20 order 18 su 16384 sc 13 2019-12-16T22:46:11.094 INFO:teuthology.orchestra.run.smithi177.stdout:2979 writesame 0x8d52eff thru 0x8d610b1 data_size 0x1(0xe1b3 bytes) 2019-12-16T22:46:11.118 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #18, image image_cluster1.client.mirror.3-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent19 2019-12-16T22:46:11.120 INFO:teuthology.orchestra.run.smithi177.stdout:2980 write 0xce951b3 thru 0xcea2444 (0xd292 bytes) 2019-12-16T22:46:11.145 INFO:teuthology.orchestra.run.smithi177.stdout:2982 trunc from 0xcea2445 to 0x9fa8593 2019-12-16T22:46:11.155 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.156 INFO:teuthology.orchestra.run.smithi177.stdout:2239 read 0x34debd8 thru 0x34e7392 (0x87bb bytes) 2019-12-16T22:46:11.156 INFO:teuthology.orchestra.run.smithi177.stdout:2346 punch from 0x83bc52 to 0x843a31, (0x7ddf bytes) 2019-12-16T22:46:11.171 INFO:teuthology.orchestra.run.smithi177.stdout:2983 write 0xb7ea82 thru 0xb87593 (0x8b12 bytes) 2019-12-16T22:46:11.172 INFO:teuthology.orchestra.run.smithi177.stdout:2240 read 0x4d3e939 thru 0x4d448ac (0x5f74 bytes) 2019-12-16T22:46:11.173 INFO:teuthology.orchestra.run.smithi177.stdout:2347 punch from 0x8fdc94c to 0x8fdf254, (0x2908 bytes) 2019-12-16T22:46:11.173 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.173 INFO:teuthology.orchestra.run.smithi177.stdout:2349 read 0x6f55de9 thru 0x6f6277f (0xc997 bytes) 2019-12-16T22:46:11.174 INFO:teuthology.orchestra.run.smithi177.stdout:2241 write 0x8868209 thru 0x88709d0 (0x87c8 bytes) 2019-12-16T22:46:11.177 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.177 INFO:teuthology.orchestra.run.smithi177.stdout:2353 writesame 0x5016da9 thru 0x501aaa7 data_size 0xf(0x3cff bytes) 2019-12-16T22:46:11.197 INFO:teuthology.orchestra.run.smithi177.stdout:2984 write 0x4fb70c3 thru 0x4fb715c (0x9a bytes) 2019-12-16T22:46:11.210 INFO:teuthology.orchestra.run.smithi177.stdout:2243 trunc from 0xe414344 to 0x9d8196e 2019-12-16T22:46:11.217 INFO:teuthology.orchestra.run.smithi177.stdout:2985 trunc from 0x9fa8593 to 0x3d2fe61 2019-12-16T22:46:11.290 INFO:teuthology.orchestra.run.smithi177.stdout:2499 write 0xba1a8a2 thru 0xba24e8d (0xa5ec bytes) 2019-12-16T22:46:11.298 INFO:teuthology.orchestra.run.smithi177.stdout:2986 write 0x8f46617 thru 0x8f4ffb9 (0x99a3 bytes) 2019-12-16T22:46:11.304 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.2-clone19 2019-12-16T22:46:11.324 INFO:teuthology.orchestra.run.smithi177.stdout:2987 clone 17 order 22 su 16384 sc 11 2019-12-16T22:46:11.325 INFO:teuthology.orchestra.run.smithi177.stdout:2354 punch from 0x6ff28f5 to 0x6ff633a, (0x3a45 bytes) 2019-12-16T22:46:11.332 INFO:teuthology.orchestra.run.smithi177.stdout:2245 write 0xce132ef thru 0xce18195 (0x4ea7 bytes) 2019-12-16T22:46:11.348 INFO:teuthology.orchestra.run.smithi177.stdout:2246 trunc from 0xce18196 to 0xd0f5fac 2019-12-16T22:46:11.364 INFO:teuthology.orchestra.run.smithi177.stdout:2500 writesame 0x9e4200 thru 0x9e5146 data_size 0x1(0xf47 bytes) 2019-12-16T22:46:11.367 INFO:teuthology.orchestra.run.smithi177.stdout:2356 write 0xaefcb48 thru 0xaf023d1 (0x588a bytes) 2019-12-16T22:46:11.434 INFO:teuthology.orchestra.run.smithi177.stdout:2357 read 0x2ab682d thru 0x2ab8e27 (0x25fb bytes) 2019-12-16T22:46:11.437 INFO:teuthology.orchestra.run.smithi177.stdout:2358 writesame 0x4a55920 thru 0x4a563e5 data_size 0x7(0xac6 bytes) 2019-12-16T22:46:11.459 INFO:teuthology.orchestra.run.smithi177.stdout:2247 write 0xe2adf60 thru 0xe2b91c6 (0xb267 bytes) 2019-12-16T22:46:11.476 INFO:teuthology.orchestra.run.smithi177.stdout:2249 writesame 0x24e0169 thru 0x24ece56 data_size 0x22(0xccee bytes) 2019-12-16T22:46:11.515 INFO:teuthology.orchestra.run.smithi177.stdout:2250 read 0xa518e86 thru 0xa52440b (0xb586 bytes) 2019-12-16T22:46:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:2252 punch from 0xe0717f7 to 0xe076523, (0x4d2c bytes) 2019-12-16T22:46:11.516 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.517 INFO:teuthology.orchestra.run.smithi177.stdout:2256 writesame 0xdf7d7bf thru 0xdf8d32e data_size 0x6(0xfb70 bytes) 2019-12-16T22:46:11.531 INFO:teuthology.orchestra.run.smithi177.stdout:2258 write 0xa2f19ea thru 0xa2f778d (0x5da4 bytes) 2019-12-16T22:46:11.535 INFO:teuthology.orchestra.run.smithi177.stdout:2501 trunc from 0xba24e8e to 0x9755100 2019-12-16T22:46:11.536 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.536 INFO:teuthology.orchestra.run.smithi177.stdout:2261 write 0xba6eb7f thru 0xba75e7c (0x72fe bytes) 2019-12-16T22:46:11.537 INFO:teuthology.orchestra.run.smithi177.stdout:2359 trunc from 0xaf023d2 to 0x7c6213c 2019-12-16T22:46:11.541 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.541 INFO:teuthology.orchestra.run.smithi177.stdout:2264 write 0x42df64c thru 0x42e77f9 (0x81ae bytes) 2019-12-16T22:46:11.559 INFO:teuthology.orchestra.run.smithi177.stdout:2267 write 0x80978c0 thru 0x809935c (0x1a9d bytes) 2019-12-16T22:46:11.566 INFO:teuthology.orchestra.run.smithi177.stdout:2268 write 0x54eb2d8 thru 0x54f2f0f (0x7c38 bytes) 2019-12-16T22:46:11.577 INFO:teuthology.orchestra.run.smithi177.stdout:2269 write 0x959afc4 thru 0x95aa113 (0xf150 bytes) 2019-12-16T22:46:11.590 INFO:teuthology.orchestra.run.smithi177.stdout:2270 write 0x8646487 thru 0x86562e6 (0xfe60 bytes) 2019-12-16T22:46:11.592 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.613 INFO:teuthology.orchestra.run.smithi177.stdout:2272 write 0x314a5b2 thru 0x31508ea (0x6339 bytes) 2019-12-16T22:46:11.622 INFO:teuthology.orchestra.run.smithi177.stdout:2505 writesame 0xb8f5d16 thru 0xb900ab3 data_size 0x47(0xad9e bytes) 2019-12-16T22:46:11.626 INFO:teuthology.orchestra.run.smithi177.stdout:2273 write 0xc4786aa thru 0xc47b166 (0x2abd bytes) 2019-12-16T22:46:11.632 INFO:teuthology.orchestra.run.smithi177.stdout:2275 writesame 0x4342171 thru 0x434da65 data_size 0x3(0xb8f5 bytes) 2019-12-16T22:46:11.636 INFO:teuthology.orchestra.run.smithi177.stdout:2507 trunc from 0xb900ab4 to 0x6900434 2019-12-16T22:46:11.645 INFO:teuthology.orchestra.run.smithi177.stdout:2276 write 0xb50efe4 thru 0xb516031 (0x704e bytes) 2019-12-16T22:46:11.651 INFO:teuthology.orchestra.run.smithi177.stdout:2277 write 0x696750 thru 0x6a663d (0xfeee bytes) 2019-12-16T22:46:11.661 INFO:teuthology.orchestra.run.smithi177.stdout:2278 writesame 0x5d70364 thru 0x5d75990 data_size 0x1(0x562d bytes) 2019-12-16T22:46:11.672 INFO:teuthology.orchestra.run.smithi177.stdout:2509 read 0x4c215e4 thru 0x4c2cbfe (0xb61b bytes) 2019-12-16T22:46:11.673 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.673 INFO:teuthology.orchestra.run.smithi177.stdout:2513 read 0x2bdb2eb thru 0x2bddaa3 (0x27b9 bytes) 2019-12-16T22:46:11.693 INFO:teuthology.orchestra.run.smithi177.stdout:2279 writesame 0xb349866 thru 0xb35569d data_size 0xc(0xbe38 bytes) 2019-12-16T22:46:11.699 INFO:teuthology.orchestra.run.smithi177.stdout:2280 writesame 0x880b375 thru 0x881ac33 data_size 0xb(0xf8bf bytes) 2019-12-16T22:46:11.709 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.710 INFO:teuthology.orchestra.run.smithi177.stdout:2283 write 0x8beaa69 thru 0x8bf623c (0xb7d4 bytes) 2019-12-16T22:46:11.713 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.720 INFO:teuthology.orchestra.run.smithi177.stdout:2516 writesame 0xdf77445 thru 0xdf87319 data_size 0x1(0xfed5 bytes) 2019-12-16T22:46:11.723 INFO:teuthology.orchestra.run.smithi177.stdout:2362 trunc from 0x7c6213c to 0xcac0328 2019-12-16T22:46:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:2284 read 0xc5ef410 thru 0xc5f2bb5 (0x37a6 bytes) 2019-12-16T22:46:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:2517 write 0xd1d6930 thru 0xd1dc652 (0x5d23 bytes) 2019-12-16T22:46:11.724 INFO:teuthology.orchestra.run.smithi177.stdout:2286 read 0xc0dbcb9 thru 0xc0e91e7 (0xd52f bytes) 2019-12-16T22:46:11.726 INFO:teuthology.orchestra.run.smithi177.stdout:2288 write 0x709fd2e thru 0x70a076b (0xa3e bytes) 2019-12-16T22:46:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:2289 read 0x750e186 thru 0x751c1c0 (0xe03b bytes) 2019-12-16T22:46:11.734 INFO:teuthology.orchestra.run.smithi177.stdout:2290 write 0x2366bfa thru 0x236adfc (0x4203 bytes) 2019-12-16T22:46:11.743 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:2294 read 0x1cae496 thru 0x1cafbda (0x1745 bytes) 2019-12-16T22:46:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:2295 punch from 0x38b7a to 0x3d29f, (0x4725 bytes) 2019-12-16T22:46:11.744 INFO:teuthology.orchestra.run.smithi177.stdout:2297 write 0x74c0b69 thru 0x74c84a5 (0x793d bytes) 2019-12-16T22:46:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:2364 punch from 0xc409dbe to 0xc411471, (0x76b3 bytes) 2019-12-16T22:46:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:2367 punch from 0x25a08a2 to 0x25b05de, (0xfd3c bytes) 2019-12-16T22:46:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:2372 punch from 0x992a627 to 0x992b273, (0xc4c bytes) 2019-12-16T22:46:11.747 INFO:teuthology.orchestra.run.smithi177.stdout:2373 punch from 0xbe8dc14 to 0xbe99940, (0xbd2c bytes) 2019-12-16T22:46:11.748 INFO:teuthology.orchestra.run.smithi177.stdout:2374 read 0x257731c thru 0x25811e2 (0x9ec7 bytes) 2019-12-16T22:46:11.751 INFO:teuthology.orchestra.run.smithi177.stdout:2301 read 0xdf6116a thru 0xdf691c2 (0x8059 bytes) 2019-12-16T22:46:11.752 INFO:teuthology.orchestra.run.smithi177.stdout:2302 writesame 0x4127fde thru 0x412842d data_size 0x8(0x450 bytes) 2019-12-16T22:46:11.752 INFO:teuthology.orchestra.run.smithi177.stdout:2376 punch from 0xc3080f9 to 0xc315a48, (0xd94f bytes) 2019-12-16T22:46:11.752 INFO:teuthology.orchestra.run.smithi177.stdout:2377 clone 24 order 23 su 32768 sc 12 2019-12-16T22:46:11.764 INFO:teuthology.orchestra.run.smithi177.stdout:2303 trunc from 0xe2b91c7 to 0xc9b9eea 2019-12-16T22:46:11.777 INFO:teuthology.orchestra.run.smithi177.stdout:2519 write 0x6c67616 thru 0x6c700bc (0x8aa7 bytes) 2019-12-16T22:46:11.795 INFO:teuthology.orchestra.run.smithi177.stdout:2304 write 0x89e670b thru 0x89e72c6 (0xbbc bytes) 2019-12-16T22:46:11.801 INFO:teuthology.orchestra.run.smithi177.stdout:2305 writesame 0x9ff3cae thru 0x9ffcf0e data_size 0x1(0x9261 bytes) 2019-12-16T22:46:11.832 INFO:teuthology.orchestra.run.smithi177.stdout:2306 trunc from 0xc9b9eea to 0xcbf8135 2019-12-16T22:46:11.838 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.838 INFO:teuthology.orchestra.run.smithi177.stdout:2521 writesame 0x2698631 thru 0x269c29c data_size 0x1(0x3c6c bytes) 2019-12-16T22:46:11.865 INFO:teuthology.orchestra.run.smithi177.stdout:2307 writesame 0x72b9aac thru 0x72c5206 data_size 0x1(0xb75b bytes) 2019-12-16T22:46:11.896 INFO:teuthology.orchestra.run.smithi177.stdout:2308 trunc from 0xcbf8135 to 0xb6f5ec4 2019-12-16T22:46:11.929 INFO:teuthology.orchestra.run.smithi177.stdout:2522 punch from 0x7356796 to 0x736408c, (0xd8f6 bytes) 2019-12-16T22:46:11.930 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.932 INFO:teuthology.orchestra.run.smithi177.stdout:2526 trunc from 0xdf8731a to 0xcc4b8ed 2019-12-16T22:46:11.936 INFO:teuthology.orchestra.run.smithi177.stdout:2310 punch from 0x1b31b28 to 0x1b3cb46, (0xb01e bytes) 2019-12-16T22:46:11.936 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.936 INFO:teuthology.orchestra.run.smithi177.stdout:2312 punch from 0x11c1a1c to 0x11ccb95, (0xb179 bytes) 2019-12-16T22:46:11.936 INFO:teuthology.orchestra.run.smithi177.stdout:2314 read 0xabb8ec2 thru 0xabbf993 (0x6ad2 bytes) 2019-12-16T22:46:11.937 INFO:teuthology.orchestra.run.smithi177.stdout:2315 read 0x51f9384 thru 0x51fe676 (0x52f3 bytes) 2019-12-16T22:46:11.960 INFO:teuthology.orchestra.run.smithi177.stdout:2316 trunc from 0xb6f5ec4 to 0x2006d2e 2019-12-16T22:46:11.966 INFO:teuthology.orchestra.run.smithi177.stdout:2528 read 0x8a3fd9e thru 0x8a47339 (0x759c bytes) 2019-12-16T22:46:11.967 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:11.967 INFO:teuthology.orchestra.run.smithi177.stdout:2530 write 0xb66d0ea thru 0xb66d1be (0xd5 bytes) 2019-12-16T22:46:11.973 INFO:teuthology.orchestra.run.smithi177.stdout:2531 writesame 0x82304d5 thru 0x82331ed data_size 0x1(0x2d19 bytes) 2019-12-16T22:46:12.016 INFO:teuthology.orchestra.run.smithi177.stdout:2532 read 0xb71baf3 thru 0xb725d17 (0xa225 bytes) 2019-12-16T22:46:12.017 INFO:teuthology.orchestra.run.smithi177.stdout:2533 read 0xca0e84f thru 0xca1e324 (0xfad6 bytes) 2019-12-16T22:46:12.017 INFO:teuthology.orchestra.run.smithi177.stdout:2534 writesame 0x3404dff thru 0x3409443 data_size 0x1(0x4645 bytes) 2019-12-16T22:46:12.062 INFO:teuthology.orchestra.run.smithi177.stdout:2317 write 0x77b9081 thru 0x77c66e0 (0xd660 bytes) 2019-12-16T22:46:12.067 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:12.068 INFO:teuthology.orchestra.run.smithi177.stdout:2536 writesame 0x371d81b thru 0x3727687 data_size 0xb(0x9e6d bytes) 2019-12-16T22:46:12.071 INFO:teuthology.orchestra.run.smithi177.stdout:2319 read 0x681f039 thru 0x6821360 (0x2328 bytes) 2019-12-16T22:46:12.072 INFO:teuthology.orchestra.run.smithi177.stdout:2320 read 0x9c08d3 thru 0x9d0665 (0xfd93 bytes) 2019-12-16T22:46:12.072 INFO:teuthology.orchestra.run.smithi177.stdout:2321 read 0x68b90f4 thru 0x68c5460 (0xc36d bytes) 2019-12-16T22:46:12.078 INFO:teuthology.orchestra.run.smithi177.stdout:2323 trunc from 0x77c66e1 to 0x5be0efa 2019-12-16T22:46:12.136 INFO:teuthology.orchestra.run.smithi177.stdout:2537 read 0xbd1d4ee thru 0xbd2a689 (0xd19c bytes) 2019-12-16T22:46:12.141 INFO:teuthology.orchestra.run.smithi177.stdout:2324 write 0x6812c3 thru 0x685dda (0x4b18 bytes) 2019-12-16T22:46:12.153 INFO:teuthology.orchestra.run.smithi177.stdout:2325 trunc from 0x5be0efa to 0x893fd8a 2019-12-16T22:46:12.161 INFO:teuthology.orchestra.run.smithi177.stdout:2538 trunc from 0xcc4b8ed to 0xb4437c 2019-12-16T22:46:12.179 INFO:teuthology.orchestra.run.smithi177.stdout:2326 read 0x57cc5c0 thru 0x57db0d9 (0xeb1a bytes) 2019-12-16T22:46:12.180 INFO:teuthology.orchestra.run.smithi177.stdout:2327 read 0x3ba048c thru 0x3baa83b (0xa3b0 bytes) 2019-12-16T22:46:12.223 INFO:teuthology.orchestra.run.smithi177.stdout:2328 writesame 0xb84b924 thru 0xb854312 data_size 0x1(0x89ef bytes) 2019-12-16T22:46:12.224 INFO:teuthology.orchestra.run.smithi177.stdout:2329 read 0x5841440 thru 0x584c2e4 (0xaea5 bytes) 2019-12-16T22:46:12.225 INFO:teuthology.orchestra.run.smithi177.stdout:2330 read 0x3eb485d thru 0x3ebf95d (0xb101 bytes) 2019-12-16T22:46:12.226 INFO:teuthology.orchestra.run.smithi177.stdout:2331 read 0xb5f6bf9 thru 0xb6028dd (0xbce5 bytes) 2019-12-16T22:46:12.226 INFO:teuthology.orchestra.run.smithi177.stdout:2332 punch from 0x6b2f655 to 0x6b3442f, (0x4dda bytes) 2019-12-16T22:46:12.226 INFO:teuthology.orchestra.run.smithi177.stdout:2333 punch from 0x40ca336 to 0x40d4377, (0xa041 bytes) 2019-12-16T22:46:12.345 INFO:teuthology.orchestra.run.smithi177.stdout:2334 write 0xbbcdbb8 thru 0xbbd1302 (0x374b bytes) 2019-12-16T22:46:12.362 INFO:teuthology.orchestra.run.smithi177.stdout:2335 read 0xab69569 thru 0xab69efd (0x995 bytes) 2019-12-16T22:46:12.380 INFO:teuthology.orchestra.run.smithi177.stdout:2336 trunc from 0xbbd1303 to 0x25eb475 2019-12-16T22:46:12.442 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.0-clone23 from 0xcac0328 (overlap 0x7c6213c) to 0x6381a96 2019-12-16T22:46:12.514 INFO:teuthology.orchestra.run.smithi177.stdout:2337 write 0x14dfb7f thru 0x14e3e20 (0x42a2 bytes) 2019-12-16T22:46:12.522 INFO:teuthology.orchestra.run.smithi177.stdout:2338 punch from 0x192e8b2 to 0x193c4c0, (0xdc0e bytes) 2019-12-16T22:46:12.568 INFO:teuthology.orchestra.run.smithi177.stdout:2339 write 0xccb477a thru 0xccbecfe (0xa585 bytes) 2019-12-16T22:46:12.579 INFO:teuthology.orchestra.run.smithi177.stdout:2340 punch from 0xc631844 to 0xc63832b, (0x6ae7 bytes) 2019-12-16T22:46:12.580 INFO:teuthology.orchestra.run.smithi177.stdout:2341 trunc from 0xccbecff to 0xc5d1b68 2019-12-16T22:46:12.608 INFO:teuthology.orchestra.run.smithi177.stdout:2539 write 0x18304aa thru 0x183d693 (0xd1ea bytes) 2019-12-16T22:46:12.612 INFO:teuthology.orchestra.run.smithi177.stdout:2342 read 0x1eaccee thru 0x1eaf576 (0x2889 bytes) 2019-12-16T22:46:12.613 INFO:teuthology.orchestra.run.smithi177.stdout:2343 read 0x6340a2a thru 0x6346a6c (0x6043 bytes) 2019-12-16T22:46:12.613 INFO:teuthology.orchestra.run.smithi177.stdout:2346 punch from 0x57aecb to 0x5824c2, (0x75f7 bytes) 2019-12-16T22:46:12.613 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:12.613 INFO:teuthology.orchestra.run.smithi177.stdout:2349 write 0xb5a5fd3 thru 0xb5b48d6 (0xe904 bytes) 2019-12-16T22:46:12.614 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.4-clone19 from 0xa687225 (overlap 0xa687225) to 0x95e0054 2019-12-16T22:46:12.647 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #18, image image_cluster1.client.mirror.2-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent19 2019-12-16T22:46:12.664 INFO:teuthology.orchestra.run.smithi177.stdout:2350 trunc from 0xc5d1b68 to 0x59f40d5 2019-12-16T22:46:12.693 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:12.693 INFO:teuthology.orchestra.run.smithi177.stdout:1990 write 0xb67bee1 thru 0xb681e26 (0x5f46 bytes) 2019-12-16T22:46:12.703 INFO:teuthology.orchestra.run.smithi177.stdout:2540 read 0x73aedb thru 0x74a1ab (0xf2d1 bytes) 2019-12-16T22:46:12.713 INFO:teuthology.orchestra.run.smithi177.stdout:2351 read 0x1f5b27d thru 0x1f61bcb (0x694f bytes) 2019-12-16T22:46:12.719 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #15, image image_cluster1.client.mirror.1-clone15 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent16 2019-12-16T22:46:12.721 INFO:teuthology.orchestra.run.smithi177.stdout:2541 read 0x576764 thru 0x584874 (0xe111 bytes) 2019-12-16T22:46:12.745 INFO:teuthology.orchestra.run.smithi177.stdout:2352 write 0xa5c144b thru 0xa5c2001 (0xbb7 bytes) 2019-12-16T22:46:12.755 INFO:teuthology.orchestra.run.smithi177.stdout:1991 read 0x92a90dc thru 0x92b5ac1 (0xc9e6 bytes) 2019-12-16T22:46:12.756 INFO:teuthology.orchestra.run.smithi177.stdout:1992 punch from 0x55d8cf7 to 0x55dbc36, (0x2f3f bytes) 2019-12-16T22:46:12.756 INFO:teuthology.orchestra.run.smithi177.stdout:1993 read 0x89b61c thru 0x8a0a95 (0x547a bytes) 2019-12-16T22:46:12.757 INFO:teuthology.orchestra.run.smithi177.stdout:1994 writesame 0xe68601 thru 0xe69a4d data_size 0x1(0x144d bytes) 2019-12-16T22:46:12.837 INFO:teuthology.orchestra.run.smithi177.stdout:2353 write 0xa9fda30 thru 0xaa05ad7 (0x80a8 bytes) 2019-12-16T22:46:12.856 INFO:teuthology.orchestra.run.smithi177.stdout:1996 read 0x28fd349 thru 0x2909056 (0xbd0e bytes) 2019-12-16T22:46:12.856 INFO:teuthology.orchestra.run.smithi177.stdout:1999 write 0x42b8ed6 thru 0x42bb47c (0x25a7 bytes) 2019-12-16T22:46:12.864 INFO:teuthology.orchestra.run.smithi177.stdout:2354 writesame 0x9a388bf thru 0x9a42771 data_size 0x1(0x9eb3 bytes) 2019-12-16T22:46:12.909 INFO:teuthology.orchestra.run.smithi177.stdout:2355 writesame 0x10dacb8 thru 0x10e2104 data_size 0x1(0x744d bytes) 2019-12-16T22:46:12.912 INFO:teuthology.orchestra.run.smithi177.stdout:2000 read 0x78d7e26 thru 0x78dcc75 (0x4e50 bytes) 2019-12-16T22:46:12.913 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:12.913 INFO:teuthology.orchestra.run.smithi177.stdout:2003 read 0x7e4053b thru 0x7e4e5bd (0xe083 bytes) 2019-12-16T22:46:12.917 INFO:teuthology.orchestra.run.smithi177.stdout:2542 writesame 0x58bbac1 thru 0x58bf301 data_size 0x1(0x3841 bytes) 2019-12-16T22:46:12.925 INFO:teuthology.orchestra.run.smithi177.stdout:2005 trunc from 0xe04de0e to 0x8c724e7 2019-12-16T22:46:12.931 INFO:teuthology.orchestra.run.smithi177.stdout:2989 punch from 0x845923a to 0x845f82f, (0x65f5 bytes) 2019-12-16T22:46:12.931 INFO:teuthology.orchestra.run.smithi177.stdout:2543 read 0x44c58c7 thru 0x44d15b6 (0xbcf0 bytes) 2019-12-16T22:46:12.932 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:12.940 INFO:teuthology.orchestra.run.smithi177.stdout:2356 trunc from 0xaa05ad8 to 0x937024d 2019-12-16T22:46:13.004 INFO:teuthology.orchestra.run.smithi177.stdout:2990 trunc from 0x8f4ffba to 0xb953342 2019-12-16T22:46:13.008 INFO:teuthology.orchestra.run.smithi177.stdout:2357 read 0x336b393 thru 0x336ff2d (0x4b9b bytes) 2019-12-16T22:46:13.008 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.009 INFO:teuthology.orchestra.run.smithi177.stdout:2361 read 0x16a5a01 thru 0x16af5f6 (0x9bf6 bytes) 2019-12-16T22:46:13.009 INFO:teuthology.orchestra.run.smithi177.stdout:2362 read 0x296c050 thru 0x2972a48 (0x69f9 bytes) 2019-12-16T22:46:13.011 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.012 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.012 INFO:teuthology.orchestra.run.smithi177.stdout:2368 punch from 0x37030e5 to 0x37086b4, (0x55cf bytes) 2019-12-16T22:46:13.039 INFO:teuthology.orchestra.run.smithi177.stdout:2006 trunc from 0x8c724e7 to 0x5aca183 2019-12-16T22:46:13.051 INFO:teuthology.orchestra.run.smithi177.stdout:2547 writesame 0xe53a1bb thru 0xe548a10 data_size 0x45(0xe856 bytes) 2019-12-16T22:46:13.071 INFO:teuthology.orchestra.run.smithi177.stdout:2991 read 0x5f438ff thru 0x5f4917c (0x587e bytes) 2019-12-16T22:46:13.071 INFO:teuthology.orchestra.run.smithi177.stdout:2992 read 0x2fa3f5f thru 0x2fae9a5 (0xaa47 bytes) 2019-12-16T22:46:13.071 INFO:teuthology.orchestra.run.smithi177.stdout:2993 writesame 0x5a55a8b thru 0x5a610b0 data_size 0x5(0xb626 bytes) 2019-12-16T22:46:13.074 INFO:teuthology.orchestra.run.smithi177.stdout:2369 write 0xee18c78 thru 0xee21058 (0x83e1 bytes) 2019-12-16T22:46:13.092 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.092 INFO:teuthology.orchestra.run.smithi177.stdout:2371 read 0x334b0c8 thru 0x335a2d5 (0xf20e bytes) 2019-12-16T22:46:13.092 INFO:teuthology.orchestra.run.smithi177.stdout:2372 punch from 0xb83825f to 0xb83d2dd, (0x507e bytes) 2019-12-16T22:46:13.092 INFO:teuthology.orchestra.run.smithi177.stdout:2373 write 0x922f7ec thru 0x923bbd2 (0xc3e7 bytes) 2019-12-16T22:46:13.102 INFO:teuthology.orchestra.run.smithi177.stdout:2549 write 0xe932092 thru 0xe9386a3 (0x6612 bytes) 2019-12-16T22:46:13.294 INFO:teuthology.orchestra.run.smithi177.stdout:2550 write 0x411ffd9 thru 0x4125351 (0x5379 bytes) 2019-12-16T22:46:13.297 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.315 INFO:teuthology.orchestra.run.smithi177.stdout:2374 read 0xe0b1391 thru 0xe0b2d03 (0x1973 bytes) 2019-12-16T22:46:13.316 INFO:teuthology.orchestra.run.smithi177.stdout:2375 read 0x1198a60 thru 0x11a1475 (0x8a16 bytes) 2019-12-16T22:46:13.316 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.317 INFO:teuthology.orchestra.run.smithi177.stdout:2378 read 0x143fc6 thru 0x1481aa (0x41e5 bytes) 2019-12-16T22:46:13.317 INFO:teuthology.orchestra.run.smithi177.stdout:2380 write 0x9979820 thru 0x997c1e2 (0x29c3 bytes) 2019-12-16T22:46:13.335 INFO:teuthology.orchestra.run.smithi177.stdout:2008 write 0x8127334 thru 0x8128b6b (0x1838 bytes) 2019-12-16T22:46:13.346 INFO:teuthology.orchestra.run.smithi177.stdout:2994 write 0xc047850 thru 0xc056a20 (0xf1d1 bytes) 2019-12-16T22:46:13.351 INFO:teuthology.orchestra.run.smithi177.stdout:2381 trunc from 0xee21059 to 0x2b18fe5 2019-12-16T22:46:13.379 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.379 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.380 INFO:teuthology.orchestra.run.smithi177.stdout:2998 read 0xa543689 thru 0xa543cd6 (0x64e bytes) 2019-12-16T22:46:13.380 INFO:teuthology.orchestra.run.smithi177.stdout:3002 punch from 0x37707d6 to 0x377fe20, (0xf64a bytes) 2019-12-16T22:46:13.380 INFO:teuthology.orchestra.run.smithi177.stdout:3004 punch from 0x6ed1daa to 0x6edada9, (0x8fff bytes) 2019-12-16T22:46:13.380 INFO:teuthology.orchestra.run.smithi177.stdout:3005 punch from 0x96cd3ce to 0x96d6493, (0x90c5 bytes) 2019-12-16T22:46:13.381 INFO:teuthology.orchestra.run.smithi177.stdout:3006 trunc from 0xc056a21 to 0xb1aec77 2019-12-16T22:46:13.399 INFO:teuthology.orchestra.run.smithi177.stdout:2554 write 0x48b3a68 thru 0x48bcf78 (0x9511 bytes) 2019-12-16T22:46:13.409 INFO:teuthology.orchestra.run.smithi177.stdout:2383 read 0x46b8d8 thru 0x477a02 (0xc12b bytes) 2019-12-16T22:46:13.410 INFO:teuthology.orchestra.run.smithi177.stdout:2385 punch from 0x11aba61 to 0x11abc71, (0x210 bytes) 2019-12-16T22:46:13.410 INFO:teuthology.orchestra.run.smithi177.stdout:2386 clone 21 order 25 su 524288 sc 13 2019-12-16T22:46:13.424 INFO:teuthology.orchestra.run.smithi177.stdout:2009 writesame 0xaaad086 thru 0xaab4f85 data_size 0x7f(0x7f00 bytes) 2019-12-16T22:46:13.427 INFO:teuthology.orchestra.run.smithi177.stdout:2010 punch from 0x7b9c603 to 0x7b9e75b, (0x2158 bytes) 2019-12-16T22:46:13.428 INFO:teuthology.orchestra.run.smithi177.stdout:2011 write 0x173e624 thru 0x174b274 (0xcc51 bytes) 2019-12-16T22:46:13.445 INFO:teuthology.orchestra.run.smithi177.stdout:3011 read 0x6b9cd4d thru 0x6ba105a (0x430e bytes) 2019-12-16T22:46:13.446 INFO:teuthology.orchestra.run.smithi177.stdout:3012 write 0xae3d04c thru 0xae4b479 (0xe42e bytes) 2019-12-16T22:46:13.463 INFO:teuthology.orchestra.run.smithi177.stdout:2014 writesame 0x2b26ac8 thru 0x2b286d0 data_size 0x1(0x1c09 bytes) 2019-12-16T22:46:13.487 INFO:teuthology.orchestra.run.smithi177.stdout:2017 read 0x39c94c6 thru 0x39c9e54 (0x98f bytes) 2019-12-16T22:46:13.487 INFO:teuthology.orchestra.run.smithi177.stdout:2018 read 0x840a0d8 thru 0x84110c1 (0x6fea bytes) 2019-12-16T22:46:13.491 INFO:teuthology.orchestra.run.smithi177.stdout:3013 trunc from 0xb1aec77 to 0x62e1021 2019-12-16T22:46:13.494 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.495 INFO:teuthology.orchestra.run.smithi177.stdout:2556 writesame 0x16aa32e thru 0x16b71ca data_size 0x1b(0xce9d bytes) 2019-12-16T22:46:13.497 INFO:teuthology.orchestra.run.smithi177.stdout:2019 trunc from 0xaab4f86 to 0x54cfda3 2019-12-16T22:46:13.513 INFO:teuthology.orchestra.run.smithi177.stdout:2557 read 0x8e4ed3c thru 0x8e50ad8 (0x1d9d bytes) 2019-12-16T22:46:13.514 INFO:teuthology.orchestra.run.smithi177.stdout:2558 writesame 0xcf00de9 thru 0xcf07725 data_size 0x1(0x693d bytes) 2019-12-16T22:46:13.563 INFO:teuthology.orchestra.run.smithi177.stdout:2021 clone 21 order 22 su 65536 sc 3 2019-12-16T22:46:13.579 INFO:teuthology.orchestra.run.smithi177.stdout:2560 punch from 0x4e66a63 to 0x4e69dd5, (0x3372 bytes) 2019-12-16T22:46:13.580 INFO:teuthology.orchestra.run.smithi177.stdout:2561 writesame 0x6dddfc6 thru 0x6de2df3 data_size 0x1(0x4e2e bytes) 2019-12-16T22:46:13.592 INFO:teuthology.orchestra.run.smithi177.stdout:3014 write 0x5e21f13 thru 0x5e25876 (0x3964 bytes) 2019-12-16T22:46:13.599 INFO:teuthology.orchestra.run.smithi177.stdout:3015 writesame 0x1b47450 thru 0x1b4e3e5 data_size 0x45(0x6f96 bytes) 2019-12-16T22:46:13.659 INFO:teuthology.orchestra.run.smithi177.stdout:2562 write 0xafb0eb2 thru 0xafc0177 (0xf2c6 bytes) 2019-12-16T22:46:13.662 INFO:teuthology.orchestra.run.smithi177.stdout:3016 trunc from 0x62e1021 to 0x3d4a409 2019-12-16T22:46:13.708 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #18, image image_cluster1.client.mirror.4-clone18 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent19 2019-12-16T22:46:13.727 INFO:teuthology.orchestra.run.smithi177.stdout:2563 read 0x85ef4cd thru 0x85f545e (0x5f92 bytes) 2019-12-16T22:46:13.728 INFO:teuthology.orchestra.run.smithi177.stdout:2565 writesame 0x579bd9a thru 0x579f406 data_size 0x1(0x366d bytes) 2019-12-16T22:46:13.781 INFO:teuthology.orchestra.run.smithi177.stdout:2566 writesame 0x6d729cb thru 0x6d81b5a data_size 0x28(0xf190 bytes) 2019-12-16T22:46:13.801 INFO:teuthology.orchestra.run.smithi177.stdout:2567 punch from 0x39ab353 to 0x39b409d, (0x8d4a bytes) 2019-12-16T22:46:13.801 INFO:teuthology.orchestra.run.smithi177.stdout:2568 write 0xc8103d2 thru 0xc819976 (0x95a5 bytes) 2019-12-16T22:46:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:3017 read 0x4759c0 thru 0x477fa0 (0x25e1 bytes) 2019-12-16T22:46:13.841 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.849 INFO:teuthology.orchestra.run.smithi177.stdout:3020 trunc from 0x3d4a409 to 0x88259cb 2019-12-16T22:46:13.863 INFO:teuthology.orchestra.run.smithi177.stdout:2569 punch from 0x9b88a40 to 0x9b8cab9, (0x4079 bytes) 2019-12-16T22:46:13.863 INFO:teuthology.orchestra.run.smithi177.stdout:2570 write 0x4536670 thru 0x45417f7 (0xb188 bytes) 2019-12-16T22:46:13.868 INFO:teuthology.orchestra.run.smithi177.stdout:3021 writesame 0x62c89f9 thru 0x62cf7db data_size 0x1(0x6de3 bytes) 2019-12-16T22:46:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:13.921 INFO:teuthology.orchestra.run.smithi177.stdout:2572 read 0x549a0ea thru 0x549cce6 (0x2bfd bytes) 2019-12-16T22:46:13.922 INFO:teuthology.orchestra.run.smithi177.stdout:2573 read 0xbdc350 thru 0xbe6147 (0x9df8 bytes) 2019-12-16T22:46:13.939 INFO:teuthology.orchestra.run.smithi177.stdout:3022 writesame 0xe99b8ed thru 0xe9a634c data_size 0x74(0xaa60 bytes) 2019-12-16T22:46:13.947 INFO:teuthology.orchestra.run.smithi177.stdout:3024 write 0x2125988 thru 0x2132931 (0xcfaa bytes) 2019-12-16T22:46:13.952 INFO:teuthology.orchestra.run.smithi177.stdout:2574 trunc from 0xe9386a4 to 0xbeb5b23 2019-12-16T22:46:14.128 INFO:teuthology.orchestra.run.smithi177.stdout:3025 read 0xce0b9cb thru 0xce1629e (0xa8d4 bytes) 2019-12-16T22:46:14.129 INFO:teuthology.orchestra.run.smithi177.stdout:3027 write 0x85327df thru 0x853fd92 (0xd5b4 bytes) 2019-12-16T22:46:14.154 INFO:teuthology.orchestra.run.smithi177.stdout:2577 punch from 0xdddbc3 to 0xdea2be, (0xc6fb bytes) 2019-12-16T22:46:14.191 INFO:teuthology.orchestra.run.smithi177.stdout:3028 writesame 0xe00621d thru 0xe00b16d data_size 0x1f(0x4f51 bytes) 2019-12-16T22:46:14.207 INFO:teuthology.orchestra.run.smithi177.stdout:3029 punch from 0xb1bd2b3 to 0xb1c219b, (0x4ee8 bytes) 2019-12-16T22:46:14.207 INFO:teuthology.orchestra.run.smithi177.stdout:3030 writesame 0x5aed036 thru 0x5af0ccc data_size 0x1(0x3c97 bytes) 2019-12-16T22:46:14.209 INFO:teuthology.orchestra.run.smithi177.stdout:2578 write 0xe3bcd16 thru 0xe3ca8a0 (0xdb8b bytes) 2019-12-16T22:46:14.233 INFO:teuthology.orchestra.run.smithi177.stdout:3031 read 0xde03366 thru 0xde11f92 (0xec2d bytes) 2019-12-16T22:46:14.233 INFO:teuthology.orchestra.run.smithi177.stdout:3033 read 0x5ccca1d thru 0x5cd37a0 (0x6d84 bytes) 2019-12-16T22:46:14.233 INFO:teuthology.orchestra.run.smithi177.stdout:3035 writesame 0x200fd69 thru 0x201103f data_size 0xd(0x12d7 bytes) 2019-12-16T22:46:14.298 INFO:teuthology.orchestra.run.smithi177.stdout:3038 punch from 0x1dad8f to 0x1e411a, (0x938b bytes) 2019-12-16T22:46:14.298 INFO:teuthology.orchestra.run.smithi177.stdout:3039 punch from 0x47f8c4e to 0x4808094, (0xf446 bytes) 2019-12-16T22:46:14.298 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:14.298 INFO:teuthology.orchestra.run.smithi177.stdout:3042 punch from 0x9caaedb to 0x9cb2f92, (0x80b7 bytes) 2019-12-16T22:46:14.299 INFO:teuthology.orchestra.run.smithi177.stdout:3043 write 0x71c064 thru 0x728ea8 (0xce45 bytes) 2019-12-16T22:46:14.332 INFO:teuthology.orchestra.run.smithi177.stdout:2580 write 0xd1afd6b thru 0xd1bbf07 (0xc19d bytes) 2019-12-16T22:46:14.337 INFO:teuthology.orchestra.run.smithi177.stdout:3044 read 0xcdf0127 thru 0xcdff292 (0xf16c bytes) 2019-12-16T22:46:14.338 INFO:teuthology.orchestra.run.smithi177.stdout:3046 read 0xd6669ca thru 0xd66e9a8 (0x7fdf bytes) 2019-12-16T22:46:14.338 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone20 from 0x54cfda3 (overlap 0x54cfda3) to 0x87b2f6 2019-12-16T22:46:14.362 INFO:teuthology.orchestra.run.smithi177.stdout:3047 trunc from 0xe9a634d to 0x10614c1 2019-12-16T22:46:14.463 INFO:teuthology.orchestra.run.smithi177.stdout:2581 trunc from 0xe3ca8a1 to 0x9314c51 2019-12-16T22:46:14.632 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9cd00 2019-12-16T22:46:14.632 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9e150 2019-12-16T22:46:14.633 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x560115a269c0 2019-12-16T22:46:14.633 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x5601186cbd40 2019-12-16T22:46:14.633 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x560118708820 2019-12-16T22:46:14.633 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x56011a55e8f0 2019-12-16T22:46:14.633 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:46:14.633 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.626+0000 7f884a7b2700 -1 reset not still connected to 0x56011c5f3860 2019-12-16T22:46:14.634 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.630+0000 7f884a7b2700 -1 reset not still connected to 0x56011caccf20 2019-12-16T22:46:14.634 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.630+0000 7f884a7b2700 -1 reset not still connected to 0x56011ce167d0 2019-12-16T22:46:14.634 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.630+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474490 2019-12-16T22:46:14.634 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.630+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474b10 2019-12-16T22:46:14.635 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:14.630+0000 7f884a7b2700 -1 reset not still connected to 0x56011fa3f4d0 2019-12-16T22:46:14.683 INFO:teuthology.orchestra.run.smithi177.stdout:3048 read 0x9fe8b9 thru 0xa00175 (0x18bd bytes) 2019-12-16T22:46:14.701 INFO:teuthology.orchestra.run.smithi177.stdout:2582 writesame 0x8c5489c thru 0x8c5f7d3 data_size 0x54(0xaf38 bytes) 2019-12-16T22:46:14.774 INFO:teuthology.orchestra.run.smithi177.stdout:3050 writesame 0x68b4a08 thru 0x68c2222 data_size 0x1b(0xd81b bytes) 2019-12-16T22:46:14.794 INFO:teuthology.orchestra.run.smithi177.stdout:3053 read 0x1816db3 thru 0x182466f (0xd8bd bytes) 2019-12-16T22:46:14.796 INFO:teuthology.orchestra.run.smithi177.stdout:3056 read 0x2772592 thru 0x2780c9a (0xe709 bytes) 2019-12-16T22:46:14.798 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:14.798 INFO:teuthology.orchestra.run.smithi177.stdout:3058 write 0x1228dac thru 0x122d529 (0x477e bytes) 2019-12-16T22:46:14.805 INFO:teuthology.orchestra.run.smithi177.stdout:2583 read 0x333abc5 thru 0x3342a18 (0x7e54 bytes) 2019-12-16T22:46:14.808 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:14.808 INFO:teuthology.orchestra.run.smithi177.stdout:3061 read 0x332dd78 thru 0x3330981 (0x2c0a bytes) 2019-12-16T22:46:14.809 INFO:teuthology.orchestra.run.smithi177.stdout:3062 punch from 0x1b1451a to 0x1b1c900, (0x83e6 bytes) 2019-12-16T22:46:14.809 INFO:teuthology.orchestra.run.smithi177.stdout:3064 punch from 0x15e1158 to 0x15ea4f1, (0x9399 bytes) 2019-12-16T22:46:14.809 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:14.809 INFO:teuthology.orchestra.run.smithi177.stdout:3066 read 0x3cf1446 thru 0x3cfee93 (0xda4e bytes) 2019-12-16T22:46:14.809 INFO:teuthology.orchestra.run.smithi177.stdout:3068 read 0x40d1868 thru 0x40d5d3c (0x44d5 bytes) 2019-12-16T22:46:14.811 INFO:teuthology.orchestra.run.smithi177.stdout:3069 trunc from 0x68c2223 to 0x81f7797 2019-12-16T22:46:14.831 INFO:teuthology.orchestra.run.smithi177.stdout:2584 write 0x99eacc1 thru 0x99f7bad (0xceed bytes) 2019-12-16T22:46:14.843 INFO:teuthology.orchestra.run.smithi177.stdout:3070 punch from 0xe51936 to 0xe55e1d, (0x44e7 bytes) 2019-12-16T22:46:14.844 INFO:teuthology.orchestra.run.smithi177.stdout:3071 punch from 0x3a9310b to 0x3aa1541, (0xe436 bytes) 2019-12-16T22:46:14.844 INFO:teuthology.orchestra.run.smithi177.stdout:3072 read 0x36e74bd thru 0x36f42b2 (0xcdf6 bytes) 2019-12-16T22:46:14.844 INFO:teuthology.orchestra.run.smithi177.stdout:3073 read 0x7d02664 thru 0x7d0ad16 (0x86b3 bytes) 2019-12-16T22:46:14.844 INFO:teuthology.orchestra.run.smithi177.stdout:3074 write 0xe35e5f thru 0xe35e73 (0x15 bytes) 2019-12-16T22:46:14.884 INFO:teuthology.orchestra.run.smithi177.stdout:3075 punch from 0x50171b1 to 0x502625a, (0xf0a9 bytes) 2019-12-16T22:46:14.907 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #19, image image_cluster1.client.mirror.2-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent20 2019-12-16T22:46:14.947 INFO:teuthology.orchestra.run.smithi177.stdout:2585 read 0x6bef910 thru 0x6bff09e (0xf78f bytes) 2019-12-16T22:46:14.948 INFO:teuthology.orchestra.run.smithi177.stdout:2586 punch from 0x65690cd to 0x6572ede, (0x9e11 bytes) 2019-12-16T22:46:14.948 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:14.953 INFO:teuthology.orchestra.run.smithi177.stdout:2588 trunc from 0x99f7bae to 0x67dc282 2019-12-16T22:46:14.953 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone20 from 0x2b18fe5 (overlap 0x2006d2e) to 0x166b2d3 2019-12-16T22:46:14.999 INFO:teuthology.orchestra.run.smithi177.stdout:3076 write 0x9d2ac2c thru 0x9d2f68b (0x4a60 bytes) 2019-12-16T22:46:15.034 INFO:teuthology.orchestra.run.smithi177.stdout:3077 read 0x25535d1 thru 0x255784f (0x427f bytes) 2019-12-16T22:46:15.069 INFO:teuthology.orchestra.run.smithi177.stdout:2589 read 0x9b95f4 thru 0x9bc641 (0x304e bytes) 2019-12-16T22:46:15.072 INFO:teuthology.orchestra.run.smithi177.stdout:2590 write 0x1f72a56 thru 0x1f7c60b (0x9bb6 bytes) 2019-12-16T22:46:15.088 INFO:teuthology.orchestra.run.smithi177.stdout:3078 writesame 0xcee08ee thru 0xceeeb0c data_size 0x1(0xe21f bytes) 2019-12-16T22:46:15.093 INFO:teuthology.orchestra.run.smithi177.stdout:3080 punch from 0x415cb3d to 0x416b0ab, (0xe56e bytes) 2019-12-16T22:46:15.093 INFO:teuthology.orchestra.run.smithi177.stdout:3081 read 0xc465975 thru 0xc46c388 (0x6a14 bytes) 2019-12-16T22:46:15.111 INFO:teuthology.orchestra.run.smithi177.stdout:3083 trunc from 0xceeeb0d to 0x23d6278 2019-12-16T22:46:15.162 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.162 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.162 INFO:teuthology.orchestra.run.smithi177.stdout:2596 punch from 0x2b67bbe to 0x2b772df, (0xf721 bytes) 2019-12-16T22:46:15.163 INFO:teuthology.orchestra.run.smithi177.stdout:2597 write 0x222f68 thru 0x225f25 (0x2fbe bytes) 2019-12-16T22:46:15.193 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:15.186+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:46:15.194 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:15.190+0000 7f884a7b2700 -1 reset not still connected to 0x56011c5f3860 2019-12-16T22:46:15.195 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:15.190+0000 7f884a7b2700 -1 reset not still connected to 0x56011caccf20 2019-12-16T22:46:15.198 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:15.190+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474490 2019-12-16T22:46:15.198 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:15.190+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474b10 2019-12-16T22:46:15.200 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:15.194+0000 7f884a7b2700 -1 reset not still connected to 0x56011fa3f4d0 2019-12-16T22:46:15.323 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.454 INFO:teuthology.orchestra.run.smithi177.stdout:3085 write 0x855fe3c thru 0x856b9cf (0xbb94 bytes) 2019-12-16T22:46:15.508 INFO:teuthology.orchestra.run.smithi177.stdout:3086 write 0x6c507c0 thru 0x6c535c5 (0x2e06 bytes) 2019-12-16T22:46:15.572 INFO:teuthology.orchestra.run.smithi177.stdout:3087 write 0xa319706 thru 0xa31c2f8 (0x2bf3 bytes) 2019-12-16T22:46:15.588 INFO:teuthology.orchestra.run.smithi177.stdout:3088 read 0x515bba1 thru 0x515c5fc (0xa5c bytes) 2019-12-16T22:46:15.588 INFO:teuthology.orchestra.run.smithi177.stdout:3089 punch from 0x58df4fd to 0x58e186b, (0x236e bytes) 2019-12-16T22:46:15.588 INFO:teuthology.orchestra.run.smithi177.stdout:3090 punch from 0x38b080f to 0x38b7649, (0x6e3a bytes) 2019-12-16T22:46:15.589 INFO:teuthology.orchestra.run.smithi177.stdout:3091 read 0x29c0105 thru 0x29cab35 (0xaa31 bytes) 2019-12-16T22:46:15.590 INFO:teuthology.orchestra.run.smithi177.stdout:3092 read 0x8c28635 thru 0x8c2e950 (0x631c bytes) 2019-12-16T22:46:15.606 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #19, image image_cluster1.client.mirror.3-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent20 2019-12-16T22:46:15.614 INFO:teuthology.orchestra.run.smithi177.stdout:3093 write 0xaad67ed thru 0xaadbdb4 (0x55c8 bytes) 2019-12-16T22:46:15.624 INFO:teuthology.orchestra.run.smithi177.stdout:3094 write 0xd3f8d2 thru 0xd4a72a (0xae59 bytes) 2019-12-16T22:46:15.639 INFO:teuthology.orchestra.run.smithi177.stdout:3095 trunc from 0xaadbdb5 to 0xb2b9b8f 2019-12-16T22:46:15.664 INFO:teuthology.orchestra.run.smithi177.stdout:2022 trunc from 0x54cfda3 to 0x7be4949 2019-12-16T22:46:15.665 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.665 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.665 INFO:teuthology.orchestra.run.smithi177.stdout:3101 write 0x4dd55f1 thru 0x4dde813 (0x9223 bytes) 2019-12-16T22:46:15.684 INFO:teuthology.orchestra.run.smithi177.stdout:3102 read 0x279ab8d thru 0x27a02b4 (0x5728 bytes) 2019-12-16T22:46:15.686 INFO:teuthology.orchestra.run.smithi177.stdout:3104 read 0x4f4c3e0 thru 0x4f4eee3 (0x2b04 bytes) 2019-12-16T22:46:15.686 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.686 INFO:teuthology.orchestra.run.smithi177.stdout:3106 read 0x49ad4c9 thru 0x49b7c2a (0xa762 bytes) 2019-12-16T22:46:15.687 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.703 INFO:teuthology.orchestra.run.smithi177.stdout:3108 trunc from 0xb2b9b8f to 0x3219c7d 2019-12-16T22:46:15.711 INFO:teuthology.orchestra.run.smithi177.stdout:2387 write 0x697684c thru 0x69855d1 (0xed86 bytes) 2019-12-16T22:46:15.731 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.731 INFO:teuthology.orchestra.run.smithi177.stdout:2391 punch from 0x335af34 to 0x3369061, (0xe12d bytes) 2019-12-16T22:46:15.731 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.732 INFO:teuthology.orchestra.run.smithi177.stdout:2393 read 0x3bfeec0 thru 0x3c0b269 (0xc3aa bytes) 2019-12-16T22:46:15.741 INFO:teuthology.orchestra.run.smithi177.stdout:2394 trunc from 0x69855d2 to 0xaa524ad 2019-12-16T22:46:15.744 INFO:teuthology.orchestra.run.smithi177.stdout:2023 read 0x329293c thru 0x3293d16 (0x13db bytes) 2019-12-16T22:46:15.784 INFO:teuthology.orchestra.run.smithi177.stdout:2395 read 0x638d5f1 thru 0x6398adf (0xb4ef bytes) 2019-12-16T22:46:15.798 INFO:teuthology.orchestra.run.smithi177.stdout:2024 write 0xd0a78fc thru 0xd0b217e (0xa883 bytes) 2019-12-16T22:46:15.798 INFO:teuthology.orchestra.run.smithi177.stdout:2396 trunc from 0xaa524ad to 0x6a7c622 2019-12-16T22:46:15.838 INFO:teuthology.orchestra.run.smithi177.stdout:2025 writesame 0x5070ce3 thru 0x5073e39 data_size 0x1(0x3157 bytes) 2019-12-16T22:46:15.850 INFO:teuthology.orchestra.run.smithi177.stdout:3112 writesame 0x8235b3b thru 0x8238c2a data_size 0x24(0x30f0 bytes) 2019-12-16T22:46:15.872 INFO:teuthology.orchestra.run.smithi177.stdout:2027 read 0x1945fb1 thru 0x1949489 (0x34d9 bytes) 2019-12-16T22:46:15.878 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.879 INFO:teuthology.orchestra.run.smithi177.stdout:2029 writesame 0x9b9c7e1 thru 0x9b9e8e9 data_size 0x3(0x2109 bytes) 2019-12-16T22:46:15.879 INFO:teuthology.orchestra.run.smithi177.stdout:3113 read 0x5b49482 thru 0x5b588a5 (0xf424 bytes) 2019-12-16T22:46:15.879 INFO:teuthology.orchestra.run.smithi177.stdout:3114 punch from 0x30535dc to 0x30554ec, (0x1f10 bytes) 2019-12-16T22:46:15.880 INFO:teuthology.orchestra.run.smithi177.stdout:3116 read 0x55fb822 thru 0x560475d (0x8f3c bytes) 2019-12-16T22:46:15.880 INFO:teuthology.orchestra.run.smithi177.stdout:3117 writesame 0xb9b1ba thru 0xb9f426 data_size 0x13(0x426d bytes) 2019-12-16T22:46:15.891 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.891 INFO:teuthology.orchestra.run.smithi177.stdout:2031 write 0x5fb9551 thru 0x5fc2798 (0x9248 bytes) 2019-12-16T22:46:15.933 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.933 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:15.933 INFO:teuthology.orchestra.run.smithi177.stdout:2600 writesame 0x46fc0d2 thru 0x4706e6b data_size 0x1b(0xad9a bytes) 2019-12-16T22:46:15.935 INFO:teuthology.orchestra.run.smithi177.stdout:3118 trunc from 0x8238c2b to 0xd4e2068 2019-12-16T22:46:15.953 INFO:teuthology.orchestra.run.smithi177.stdout:2601 write 0x50b3757 thru 0x50b927b (0x5b25 bytes) 2019-12-16T22:46:15.955 INFO:teuthology.orchestra.run.smithi177.stdout:2032 trunc from 0xd0b217f to 0xe284a36 2019-12-16T22:46:15.960 INFO:teuthology.orchestra.run.smithi177.stdout:2398 trunc from 0x6a7c622 to 0x12ca1d9 2019-12-16T22:46:15.978 INFO:teuthology.orchestra.run.smithi177.stdout:3119 write 0x6981a5 thru 0x6a0205 (0x8061 bytes) 2019-12-16T22:46:15.994 INFO:teuthology.orchestra.run.smithi177.stdout:2035 read 0xa973761 thru 0xa97f2b5 (0xbb55 bytes) 2019-12-16T22:46:15.994 INFO:teuthology.orchestra.run.smithi177.stdout:2036 writesame 0x39d602e thru 0x39d6d47 data_size 0xd(0xd1a bytes) 2019-12-16T22:46:15.995 INFO:teuthology.orchestra.run.smithi177.stdout:3120 read 0xa0ca1da thru 0xa0d5d82 (0xbba9 bytes) 2019-12-16T22:46:15.995 INFO:teuthology.orchestra.run.smithi177.stdout:3122 writesame 0xac034c thru 0xac14f4 data_size 0xb(0x11a9 bytes) 2019-12-16T22:46:16.006 INFO:teuthology.orchestra.run.smithi177.stdout:3123 read 0x9501585 thru 0x9503391 (0x1e0d bytes) 2019-12-16T22:46:16.006 INFO:teuthology.orchestra.run.smithi177.stdout:3126 read 0xb425e7 thru 0xb487d6 (0x61f0 bytes) 2019-12-16T22:46:16.009 INFO:teuthology.orchestra.run.smithi177.stdout:3127 writesame 0x91edbde thru 0x91f948c data_size 0x1(0xb8af bytes) 2019-12-16T22:46:16.024 INFO:teuthology.orchestra.run.smithi177.stdout:2037 punch from 0x4abaa02 to 0x4abac6e, (0x26c bytes) 2019-12-16T22:46:16.024 INFO:teuthology.orchestra.run.smithi177.stdout:2038 write 0xa24035a thru 0xa242d50 (0x29f7 bytes) 2019-12-16T22:46:16.044 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.044 INFO:teuthology.orchestra.run.smithi177.stdout:2040 write 0xd2631a2 thru 0xd26d8d5 (0xa734 bytes) 2019-12-16T22:46:16.079 INFO:teuthology.orchestra.run.smithi177.stdout:2041 write 0xb246e2d thru 0xb24e722 (0x78f6 bytes) 2019-12-16T22:46:16.088 INFO:teuthology.orchestra.run.smithi177.stdout:2401 writesame 0xc8beabb thru 0xc8c01bb data_size 0xd(0x1701 bytes) 2019-12-16T22:46:16.090 INFO:teuthology.orchestra.run.smithi177.stdout:2042 read 0x820f6cd thru 0x821c883 (0xd1b7 bytes) 2019-12-16T22:46:16.090 INFO:teuthology.orchestra.run.smithi177.stdout:2043 punch from 0x2a2e24d to 0x2a3350f, (0x52c2 bytes) 2019-12-16T22:46:16.090 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.090 INFO:teuthology.orchestra.run.smithi177.stdout:2045 read 0x7738b83 thru 0x773aea8 (0x2326 bytes) 2019-12-16T22:46:16.093 INFO:teuthology.orchestra.run.smithi177.stdout:2402 trunc from 0xc8c01bc to 0xc92ff16 2019-12-16T22:46:16.096 INFO:teuthology.orchestra.run.smithi177.stdout:3129 trunc from 0xd4e2068 to 0x3d57b7c 2019-12-16T22:46:16.101 INFO:teuthology.orchestra.run.smithi177.stdout:2050 trunc from 0xe284a36 to 0x9ac4faa 2019-12-16T22:46:16.112 INFO:teuthology.orchestra.run.smithi177.stdout:2602 write 0x8cb1bcd thru 0x8cb6f65 (0x5399 bytes) 2019-12-16T22:46:16.129 INFO:teuthology.orchestra.run.smithi177.stdout:2403 read 0xa9c24fd thru 0xa9c5e48 (0x394c bytes) 2019-12-16T22:46:16.129 INFO:teuthology.orchestra.run.smithi177.stdout:2404 write 0x4fe422e thru 0x4fe588b (0x165e bytes) 2019-12-16T22:46:16.142 INFO:teuthology.orchestra.run.smithi177.stdout:2405 write 0xc4ea7dc thru 0xc4f5c54 (0xb479 bytes) 2019-12-16T22:46:16.156 INFO:teuthology.orchestra.run.smithi177.stdout:2407 read 0x1dcd3a7 thru 0x1ddc042 (0xec9c bytes) 2019-12-16T22:46:16.157 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.161 INFO:teuthology.orchestra.run.smithi177.stdout:3131 read 0xfb6f13 thru 0xfb9b0e (0x2bfc bytes) 2019-12-16T22:46:16.163 INFO:teuthology.orchestra.run.smithi177.stdout:3132 punch from 0x3cf819 to 0x3d7e32, (0x8619 bytes) 2019-12-16T22:46:16.163 INFO:teuthology.orchestra.run.smithi177.stdout:3133 punch from 0xdf72f to 0xe5f3e, (0x680f bytes) 2019-12-16T22:46:16.185 INFO:teuthology.orchestra.run.smithi177.stdout:2051 write 0xdaf4853 thru 0xdaf7771 (0x2f1f bytes) 2019-12-16T22:46:16.186 INFO:teuthology.orchestra.run.smithi177.stdout:2604 read 0x607903e thru 0x60885a6 (0xf569 bytes) 2019-12-16T22:46:16.187 INFO:teuthology.orchestra.run.smithi177.stdout:2609 read 0x3331e72 thru 0x333f9dd (0xdb6c bytes) 2019-12-16T22:46:16.189 INFO:teuthology.orchestra.run.smithi177.stdout:2409 write 0xe9287a9 thru 0xe92980d (0x1065 bytes) 2019-12-16T22:46:16.196 INFO:teuthology.orchestra.run.smithi177.stdout:2410 writesame 0x3477ae thru 0x34d978 data_size 0xf(0x61cb bytes) 2019-12-16T22:46:16.202 INFO:teuthology.orchestra.run.smithi177.stdout:2411 read 0x4cd95b0 thru 0x4ce02f8 (0x6d49 bytes) 2019-12-16T22:46:16.204 INFO:teuthology.orchestra.run.smithi177.stdout:2413 write 0x6db962 thru 0x6dccb6 (0x1355 bytes) 2019-12-16T22:46:16.206 INFO:teuthology.orchestra.run.smithi177.stdout:3134 write 0xbe71581 thru 0xbe73416 (0x1e96 bytes) 2019-12-16T22:46:16.216 INFO:teuthology.orchestra.run.smithi177.stdout:2052 trunc from 0xdaf7772 to 0x7219102 2019-12-16T22:46:16.216 INFO:teuthology.orchestra.run.smithi177.stdout:2414 write 0x3182394 thru 0x3189467 (0x70d4 bytes) 2019-12-16T22:46:16.219 INFO:teuthology.orchestra.run.smithi177.stdout:3135 write 0x8f47861 thru 0x8f54e54 (0xd5f4 bytes) 2019-12-16T22:46:16.219 INFO:teuthology.orchestra.run.smithi177.stdout:2416 write 0x2876d92 thru 0x287bf6a (0x51d9 bytes) 2019-12-16T22:46:16.226 INFO:teuthology.orchestra.run.smithi177.stdout:2611 write 0xa167553 thru 0xa16b8ab (0x4359 bytes) 2019-12-16T22:46:16.242 INFO:teuthology.orchestra.run.smithi177.stdout:2419 trunc from 0xe92980e to 0xa139e89 2019-12-16T22:46:16.265 INFO:teuthology.orchestra.run.smithi177.stdout:2054 writesame 0x41933b8 thru 0x41a107f data_size 0x9d(0xdcc8 bytes) 2019-12-16T22:46:16.270 INFO:teuthology.orchestra.run.smithi177.stdout:3136 write 0x7fe3b76 thru 0x7fec4e4 (0x896f bytes) 2019-12-16T22:46:16.319 INFO:teuthology.orchestra.run.smithi177.stdout:2420 writesame 0x2aa21fb thru 0x2aa88c2 data_size 0x68(0x66c8 bytes) 2019-12-16T22:46:16.325 INFO:teuthology.orchestra.run.smithi177.stdout:3138 trunc from 0xbe73417 to 0x5393da5 2019-12-16T22:46:16.329 INFO:teuthology.orchestra.run.smithi177.stdout:2057 read 0x4e92cdd thru 0x4e9cd2e (0xa052 bytes) 2019-12-16T22:46:16.330 INFO:teuthology.orchestra.run.smithi177.stdout:2058 write 0x3bc3f9c thru 0x3bceea9 (0xaf0e bytes) 2019-12-16T22:46:16.365 INFO:teuthology.orchestra.run.smithi177.stdout:2612 write 0xc337985 thru 0xc33ee49 (0x74c5 bytes) 2019-12-16T22:46:16.387 INFO:teuthology.orchestra.run.smithi177.stdout:2059 trunc from 0x7219102 to 0xcc8be69 2019-12-16T22:46:16.388 INFO:teuthology.orchestra.run.smithi177.stdout:2421 writesame 0xcc8e422 thru 0xcc9b2cf data_size 0x8f(0xceae bytes) 2019-12-16T22:46:16.397 INFO:teuthology.orchestra.run.smithi177.stdout:2422 punch from 0x3716c8c to 0x371f1dd, (0x8551 bytes) 2019-12-16T22:46:16.398 INFO:teuthology.orchestra.run.smithi177.stdout:2423 punch from 0x29eecbc to 0x29fe3ca, (0xf70e bytes) 2019-12-16T22:46:16.398 INFO:teuthology.orchestra.run.smithi177.stdout:2425 write 0x89fab31 thru 0x89ff8ac (0x4d7c bytes) 2019-12-16T22:46:16.413 INFO:teuthology.orchestra.run.smithi177.stdout:2426 read 0x793bb3b thru 0x794ba04 (0xfeca bytes) 2019-12-16T22:46:16.413 INFO:teuthology.orchestra.run.smithi177.stdout:2427 writesame 0x467bad8 thru 0x468101a data_size 0x17(0x5543 bytes) 2019-12-16T22:46:16.426 INFO:teuthology.orchestra.run.smithi177.stdout:2428 read 0xc19e0b1 thru 0xc1a72aa (0x91fa bytes) 2019-12-16T22:46:16.426 INFO:teuthology.orchestra.run.smithi177.stdout:2429 write 0x198f918 thru 0x1993e47 (0x4530 bytes) 2019-12-16T22:46:16.428 INFO:teuthology.orchestra.run.smithi177.stdout:2060 write 0x3bd2095 thru 0x3bd2dec (0xd58 bytes) 2019-12-16T22:46:16.435 INFO:teuthology.orchestra.run.smithi177.stdout:2430 write 0xa59189f thru 0xa59a57d (0x8cdf bytes) 2019-12-16T22:46:16.447 INFO:teuthology.orchestra.run.smithi177.stdout:2432 write 0xc587aee thru 0xc58dcd4 (0x61e7 bytes) 2019-12-16T22:46:16.472 INFO:teuthology.orchestra.run.smithi177.stdout:2615 read 0x9bbb460 thru 0x9bca2c9 (0xee6a bytes) 2019-12-16T22:46:16.472 INFO:teuthology.orchestra.run.smithi177.stdout:2616 read 0x9d25aa8 thru 0x9d338a4 (0xddfd bytes) 2019-12-16T22:46:16.472 INFO:teuthology.orchestra.run.smithi177.stdout:2617 write 0x9150844 thru 0x9153ec6 (0x3683 bytes) 2019-12-16T22:46:16.479 INFO:teuthology.orchestra.run.smithi177.stdout:3140 write 0xdf83b47 thru 0xdf9173f (0xdbf9 bytes) 2019-12-16T22:46:16.488 INFO:teuthology.orchestra.run.smithi177.stdout:2434 write 0xe600730 thru 0xe606c3b (0x650c bytes) 2019-12-16T22:46:16.493 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.499 INFO:teuthology.orchestra.run.smithi177.stdout:2435 punch from 0x4655c6d to 0x465a328, (0x46bb bytes) 2019-12-16T22:46:16.499 INFO:teuthology.orchestra.run.smithi177.stdout:2436 read 0xa6edde4 thru 0xa6f2783 (0x49a0 bytes) 2019-12-16T22:46:16.502 INFO:teuthology.orchestra.run.smithi177.stdout:2437 write 0xa138ea0 thru 0xa141559 (0x86ba bytes) 2019-12-16T22:46:16.539 INFO:teuthology.orchestra.run.smithi177.stdout:2440 writesame 0x635bde9 thru 0x636224f data_size 0x1(0x6467 bytes) 2019-12-16T22:46:16.554 INFO:teuthology.orchestra.run.smithi177.stdout:2618 punch from 0xe821cf to 0xe8e41e, (0xc24f bytes) 2019-12-16T22:46:16.554 INFO:teuthology.orchestra.run.smithi177.stdout:2064 writesame 0xeca7097 thru 0xecb01e0 data_size 0x3(0x914a bytes) 2019-12-16T22:46:16.556 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.557 INFO:teuthology.orchestra.run.smithi177.stdout:2067 write 0x81a994 thru 0x81b1c1 (0x82e bytes) 2019-12-16T22:46:16.558 INFO:teuthology.orchestra.run.smithi177.stdout:3141 write 0xbad6b62 thru 0xbadf13b (0x85da bytes) 2019-12-16T22:46:16.571 INFO:teuthology.orchestra.run.smithi177.stdout:2441 trunc from 0xe606c3c to 0xdb8ca7f 2019-12-16T22:46:16.595 INFO:teuthology.orchestra.run.smithi177.stdout:3143 read 0xde573d1 thru 0xde5ff8a (0x8bba bytes) 2019-12-16T22:46:16.595 INFO:teuthology.orchestra.run.smithi177.stdout:3144 write 0xcb17536 thru 0xcb25a99 (0xe564 bytes) 2019-12-16T22:46:16.616 INFO:teuthology.orchestra.run.smithi177.stdout:2619 write 0xc570878 thru 0xc577b8f (0x7318 bytes) 2019-12-16T22:46:16.632 INFO:teuthology.orchestra.run.smithi177.stdout:2442 write 0x6769ad5 thru 0x677644a (0xc976 bytes) 2019-12-16T22:46:16.635 INFO:teuthology.orchestra.run.smithi177.stdout:2621 punch from 0x5e44abe to 0x5e4e022, (0x9564 bytes) 2019-12-16T22:46:16.635 INFO:teuthology.orchestra.run.smithi177.stdout:2622 writesame 0xbca132b thru 0xbca6e0b data_size 0x2f(0x5ae1 bytes) 2019-12-16T22:46:16.640 INFO:teuthology.orchestra.run.smithi177.stdout:3147 read 0x281ef44 thru 0x282293a (0x39f7 bytes) 2019-12-16T22:46:16.642 INFO:teuthology.orchestra.run.smithi177.stdout:3148 read 0x9feff1a thru 0x9ff8c3c (0x8d23 bytes) 2019-12-16T22:46:16.642 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.643 INFO:teuthology.orchestra.run.smithi177.stdout:2068 trunc from 0xecb01e1 to 0x343fe31 2019-12-16T22:46:16.647 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.648 INFO:teuthology.orchestra.run.smithi177.stdout:2444 writesame 0x10964b thru 0x10d3c8 data_size 0x11(0x3d7e bytes) 2019-12-16T22:46:16.658 INFO:teuthology.orchestra.run.smithi177.stdout:2446 write 0xac8c3f5 thru 0xac90c8e (0x489a bytes) 2019-12-16T22:46:16.673 INFO:teuthology.orchestra.run.smithi177.stdout:2447 clone 22 order 18 su 16384 sc 8 2019-12-16T22:46:16.709 INFO:teuthology.orchestra.run.smithi177.stdout:3150 writesame 0xe5d0e4e thru 0xe5d4e34 data_size 0x7(0x3fe7 bytes) 2019-12-16T22:46:16.712 INFO:teuthology.orchestra.run.smithi177.stdout:2623 writesame 0x4d10293 thru 0x4d1390c data_size 0x13(0x367a bytes) 2019-12-16T22:46:16.716 INFO:teuthology.orchestra.run.smithi177.stdout:3151 trunc from 0xe5d4e35 to 0xc984266 2019-12-16T22:46:16.739 INFO:teuthology.orchestra.run.smithi177.stdout:2069 trunc from 0x343fe31 to 0xb3d93ab 2019-12-16T22:46:16.774 INFO:teuthology.orchestra.run.smithi177.stdout:2070 read 0xab05a59 thru 0xab14c4a (0xf1f2 bytes) 2019-12-16T22:46:16.775 INFO:teuthology.orchestra.run.smithi177.stdout:2071 read 0x85af22c thru 0x85b6db1 (0x7b86 bytes) 2019-12-16T22:46:16.775 INFO:teuthology.orchestra.run.smithi177.stdout:2072 punch from 0x3f2f6fe to 0x3f3ee8b, (0xf78d bytes) 2019-12-16T22:46:16.775 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.775 INFO:teuthology.orchestra.run.smithi177.stdout:2075 read 0x54e1b35 thru 0x54f0bbf (0xf08b bytes) 2019-12-16T22:46:16.775 INFO:teuthology.orchestra.run.smithi177.stdout:2078 read 0xd70bbd thru 0xd77055 (0x6499 bytes) 2019-12-16T22:46:16.776 INFO:teuthology.orchestra.run.smithi177.stdout:2080 writesame 0xd118a5 thru 0xd1a127 data_size 0x21(0x8883 bytes) 2019-12-16T22:46:16.793 INFO:teuthology.orchestra.run.smithi177.stdout:2624 punch from 0x6b2b83d to 0x6b3ab23, (0xf2e6 bytes) 2019-12-16T22:46:16.793 INFO:teuthology.orchestra.run.smithi177.stdout:2625 read 0x3a3a5ea thru 0x3a41463 (0x6e7a bytes) 2019-12-16T22:46:16.811 INFO:teuthology.orchestra.run.smithi177.stdout:2626 trunc from 0xc577b90 to 0x3a70997 2019-12-16T22:46:16.815 INFO:teuthology.orchestra.run.smithi177.stdout:3152 writesame 0x7d66521 thru 0x7d6ab10 data_size 0xc(0x45f0 bytes) 2019-12-16T22:46:16.846 INFO:teuthology.orchestra.run.smithi177.stdout:2082 write 0x2cd3839 thru 0x2cd810a (0x48d2 bytes) 2019-12-16T22:46:16.870 INFO:teuthology.orchestra.run.smithi177.stdout:3153 trunc from 0xc984266 to 0x7c2febf 2019-12-16T22:46:16.912 INFO:teuthology.orchestra.run.smithi177.stdout:2083 punch from 0x81c5c8c to 0x81c9d6d, (0x40e1 bytes) 2019-12-16T22:46:16.912 INFO:teuthology.orchestra.run.smithi177.stdout:2084 write 0x7131be7 thru 0x713e4dd (0xc8f7 bytes) 2019-12-16T22:46:16.972 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:16.972 INFO:teuthology.orchestra.run.smithi177.stdout:2086 read 0x7bd9d72 thru 0x7bdc67b (0x290a bytes) 2019-12-16T22:46:16.986 INFO:teuthology.orchestra.run.smithi177.stdout:2088 trunc from 0xb3d93ab to 0x57e2ed4 2019-12-16T22:46:17.075 INFO:teuthology.orchestra.run.smithi177.stdout:2089 punch from 0x522f3f1 to 0x523ad28, (0xb937 bytes) 2019-12-16T22:46:17.076 INFO:teuthology.orchestra.run.smithi177.stdout:2090 read 0x50803f9 thru 0x50903a5 (0xffad bytes) 2019-12-16T22:46:17.080 INFO:teuthology.orchestra.run.smithi177.stdout:3154 trunc from 0x7c2febf to 0xd1c1c71 2019-12-16T22:46:17.082 INFO:teuthology.orchestra.run.smithi177.stdout:2627 read 0x210f59a thru 0x2116983 (0x73ea bytes) 2019-12-16T22:46:17.085 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.085 INFO:teuthology.orchestra.run.smithi177.stdout:2630 write 0x287cb3c thru 0x28867ec (0x9cb1 bytes) 2019-12-16T22:46:17.086 INFO:teuthology.orchestra.run.smithi177.stdout:2091 trunc from 0x57e2ed4 to 0x105d352 2019-12-16T22:46:17.201 INFO:teuthology.orchestra.run.smithi177.stdout:3155 read 0x17324b1 thru 0x1740677 (0xe1c7 bytes) 2019-12-16T22:46:17.206 INFO:teuthology.orchestra.run.smithi177.stdout:3156 writesame 0x7f7abec thru 0x7f8909e data_size 0x1(0xe4b3 bytes) 2019-12-16T22:46:17.256 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.257 INFO:teuthology.orchestra.run.smithi177.stdout:3158 writesame 0xcf093b5 thru 0xcf0b27b data_size 0x1(0x1ec7 bytes) 2019-12-16T22:46:17.271 INFO:teuthology.orchestra.run.smithi177.stdout:2632 read 0x23c6fac thru 0x23d352b (0xc580 bytes) 2019-12-16T22:46:17.272 INFO:teuthology.orchestra.run.smithi177.stdout:3159 write 0x9ccefad thru 0x9cde1a7 (0xf1fb bytes) 2019-12-16T22:46:17.274 INFO:teuthology.orchestra.run.smithi177.stdout:2633 trunc from 0x3a70997 to 0x491b60a 2019-12-16T22:46:17.276 INFO:teuthology.orchestra.run.smithi177.stdout:2093 read 0x1ff025 thru 0x20255d (0x3539 bytes) 2019-12-16T22:46:17.308 INFO:teuthology.orchestra.run.smithi177.stdout:3160 read 0xc47ac8 thru 0xc5696f (0xeea8 bytes) 2019-12-16T22:46:17.309 INFO:teuthology.orchestra.run.smithi177.stdout:3161 write 0x955fa7b thru 0x956db25 (0xe0ab bytes) 2019-12-16T22:46:17.311 INFO:teuthology.orchestra.run.smithi177.stdout:2634 trunc from 0x491b60a to 0x469a98d 2019-12-16T22:46:17.317 INFO:teuthology.orchestra.run.smithi177.stdout:2095 write 0x71346fc thru 0x713f64d (0xaf52 bytes) 2019-12-16T22:46:17.333 INFO:teuthology.orchestra.run.smithi177.stdout:2096 write 0x247cfba thru 0x248c1b3 (0xf1fa bytes) 2019-12-16T22:46:17.346 INFO:teuthology.orchestra.run.smithi177.stdout:3162 write 0x6c6ad79 thru 0x6c6c8c0 (0x1b48 bytes) 2019-12-16T22:46:17.350 INFO:teuthology.orchestra.run.smithi177.stdout:3164 write 0xcde0bfb thru 0xcde26ec (0x1af2 bytes) 2019-12-16T22:46:17.363 INFO:teuthology.orchestra.run.smithi177.stdout:2097 trunc from 0x713f64e to 0x5fc9701 2019-12-16T22:46:17.365 INFO:teuthology.orchestra.run.smithi177.stdout:3167 writesame 0x5c1769e thru 0x5c2479a data_size 0x1(0xd0fd bytes) 2019-12-16T22:46:17.371 INFO:teuthology.orchestra.run.smithi177.stdout:2635 trunc from 0x469a98d to 0x157c8ec 2019-12-16T22:46:17.392 INFO:teuthology.orchestra.run.smithi177.stdout:3170 read 0x6e364e0 thru 0x6e36ee5 (0xa06 bytes) 2019-12-16T22:46:17.392 INFO:teuthology.orchestra.run.smithi177.stdout:3171 write 0x65b4b33 thru 0x65bb87e (0x6d4c bytes) 2019-12-16T22:46:17.426 INFO:teuthology.orchestra.run.smithi177.stdout:3172 trunc from 0xd1c1c71 to 0x40b306d 2019-12-16T22:46:17.466 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.475 INFO:teuthology.orchestra.run.smithi177.stdout:2098 writesame 0x8f89202 thru 0x8f8d4e3 data_size 0x7(0x42e2 bytes) 2019-12-16T22:46:17.495 INFO:teuthology.orchestra.run.smithi177.stdout:2099 trunc from 0x8f8d4e4 to 0x150130a 2019-12-16T22:46:17.508 INFO:teuthology.orchestra.run.smithi177.stdout:2637 write 0x8e6cfc8 thru 0x8e757b9 (0x87f2 bytes) 2019-12-16T22:46:17.510 INFO:teuthology.orchestra.run.smithi177.stdout:3173 trunc from 0x40b306d to 0xd92b1e6 2019-12-16T22:46:17.546 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.546 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.547 INFO:teuthology.orchestra.run.smithi177.stdout:3174 punch from 0x65ff8bb to 0x6606878, (0x6fbd bytes) 2019-12-16T22:46:17.547 INFO:teuthology.orchestra.run.smithi177.stdout:3176 writesame 0x7f15ac3 thru 0x7f1ed54 data_size 0x49(0x9292 bytes) 2019-12-16T22:46:17.569 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.570 INFO:teuthology.orchestra.run.smithi177.stdout:3178 writesame 0x452126 thru 0x45247d data_size 0x4(0x358 bytes) 2019-12-16T22:46:17.570 INFO:teuthology.orchestra.run.smithi177.stdout:2104 trunc from 0x150130a to 0xbc330dc 2019-12-16T22:46:17.576 INFO:teuthology.orchestra.run.smithi177.stdout:3179 write 0x224706c thru 0x2250b1f (0x9ab4 bytes) 2019-12-16T22:46:17.594 INFO:teuthology.orchestra.run.smithi177.stdout:2638 trunc from 0x8e757ba to 0xeb59db6 2019-12-16T22:46:17.597 INFO:teuthology.orchestra.run.smithi177.stdout:3180 write 0x8eeac52 thru 0x8efa38d (0xf73c bytes) 2019-12-16T22:46:17.604 INFO:teuthology.orchestra.run.smithi177.stdout:2106 read 0x62e1b87 thru 0x62e921b (0x7695 bytes) 2019-12-16T22:46:17.611 INFO:teuthology.orchestra.run.smithi177.stdout:2107 trunc from 0xbc330dc to 0x87f05fa 2019-12-16T22:46:17.621 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.3-clone21 2019-12-16T22:46:17.632 INFO:teuthology.orchestra.run.smithi177.stdout:3181 writesame 0x42d7b10 thru 0x42dd39f data_size 0x68(0x5890 bytes) 2019-12-16T22:46:17.632 INFO:teuthology.orchestra.run.smithi177.stdout:2640 punch from 0x1bbaf18 to 0x1bc409a, (0x9182 bytes) 2019-12-16T22:46:17.632 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.632 INFO:teuthology.orchestra.run.smithi177.stdout:2642 read 0x74eb17b thru 0x74eeba3 (0x3a29 bytes) 2019-12-16T22:46:17.633 INFO:teuthology.orchestra.run.smithi177.stdout:2643 write 0x86865fc thru 0x86869db (0x3e0 bytes) 2019-12-16T22:46:17.637 INFO:teuthology.orchestra.run.smithi177.stdout:3182 write 0x825f51d thru 0x8260813 (0x12f7 bytes) 2019-12-16T22:46:17.640 INFO:teuthology.orchestra.run.smithi177.stdout:2108 writesame 0x91a553 thru 0x91b139 data_size 0x1(0xbe7 bytes) 2019-12-16T22:46:17.648 INFO:teuthology.orchestra.run.smithi177.stdout:2644 write 0x9cc39f8 thru 0x9cc9afc (0x6105 bytes) 2019-12-16T22:46:17.662 INFO:teuthology.orchestra.run.smithi177.stdout:3183 trunc from 0xd92b1e6 to 0x270179e 2019-12-16T22:46:17.737 INFO:teuthology.orchestra.run.smithi177.stdout:2109 writesame 0xa4a27d0 thru 0xa4a7c71 data_size 0x45(0x54a2 bytes) 2019-12-16T22:46:17.742 INFO:teuthology.orchestra.run.smithi177.stdout:2111 read 0x4fde20c thru 0x4fe570e (0x7503 bytes) 2019-12-16T22:46:17.743 INFO:teuthology.orchestra.run.smithi177.stdout:2112 punch from 0x9423b6d to 0x943283e, (0xecd1 bytes) 2019-12-16T22:46:17.743 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.743 INFO:teuthology.orchestra.run.smithi177.stdout:2645 write 0xd396439 thru 0xd39ace7 (0x48af bytes) 2019-12-16T22:46:17.756 INFO:teuthology.orchestra.run.smithi177.stdout:3184 read 0xc1d38b thru 0xc1ecc3 (0x1939 bytes) 2019-12-16T22:46:17.758 INFO:teuthology.orchestra.run.smithi177.stdout:3189 read 0xa674e7 thru 0xa6c29a (0x4db4 bytes) 2019-12-16T22:46:17.759 INFO:teuthology.orchestra.run.smithi177.stdout:3190 write 0x199a9ad thru 0x19aa290 (0xf8e4 bytes) 2019-12-16T22:46:17.780 INFO:teuthology.orchestra.run.smithi177.stdout:3193 read 0x18dcbc9 thru 0x18e992c (0xcd64 bytes) 2019-12-16T22:46:17.781 INFO:teuthology.orchestra.run.smithi177.stdout:3196 punch from 0x1c75026 to 0x1c7dfbd, (0x8f97 bytes) 2019-12-16T22:46:17.801 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #22, image image_cluster1.client.mirror.0-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent23 2019-12-16T22:46:17.802 INFO:teuthology.orchestra.run.smithi177.stdout:2115 writesame 0xbb51fa1 thru 0xbb5b968 data_size 0x4c(0x99c8 bytes) 2019-12-16T22:46:17.810 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:17.811 INFO:teuthology.orchestra.run.smithi177.stdout:2117 read 0x38f5eb5 thru 0x38f74b7 (0x1603 bytes) 2019-12-16T22:46:17.811 INFO:teuthology.orchestra.run.smithi177.stdout:2119 write 0x9a32d67 thru 0x9a3599a (0x2c34 bytes) 2019-12-16T22:46:17.828 INFO:teuthology.orchestra.run.smithi177.stdout:2646 read 0x92e04d1 thru 0x92e6589 (0x60b9 bytes) 2019-12-16T22:46:17.829 INFO:teuthology.orchestra.run.smithi177.stdout:2647 writesame 0x9eb79b9 thru 0x9eba026 data_size 0x1(0x266e bytes) 2019-12-16T22:46:17.836 INFO:teuthology.orchestra.run.smithi177.stdout:3198 writesame 0xdfdf2c3 thru 0xdfe3114 data_size 0x3(0x3e52 bytes) 2019-12-16T22:46:17.837 INFO:teuthology.orchestra.run.smithi177.stdout:2120 trunc from 0xbb5b969 to 0x6c7ca34 2019-12-16T22:46:17.839 INFO:teuthology.orchestra.run.smithi177.stdout:3200 punch from 0x9fe27da to 0x9fec033, (0x9859 bytes) 2019-12-16T22:46:17.840 INFO:teuthology.orchestra.run.smithi177.stdout:3201 trunc from 0xdfe3115 to 0xe404228 2019-12-16T22:46:17.866 INFO:teuthology.orchestra.run.smithi177.stdout:2378 trunc from 0xcac0328 to 0x85cb3e2 2019-12-16T22:46:17.876 INFO:teuthology.orchestra.run.smithi177.stdout:3202 write 0x4bd21fd thru 0x4bd3dff (0x1c03 bytes) 2019-12-16T22:46:17.882 INFO:teuthology.orchestra.run.smithi177.stdout:2648 punch from 0xbd7bb6e to 0xbd8b682, (0xfb14 bytes) 2019-12-16T22:46:17.883 INFO:teuthology.orchestra.run.smithi177.stdout:2649 writesame 0x7e09a37 thru 0x7e0c008 data_size 0x2(0x25d2 bytes) 2019-12-16T22:46:17.910 INFO:teuthology.orchestra.run.smithi177.stdout:3204 trunc from 0xe404228 to 0x3ca3131 2019-12-16T22:46:17.913 INFO:teuthology.orchestra.run.smithi177.stdout:2121 read 0x385af61 thru 0x385f016 (0x40b6 bytes) 2019-12-16T22:46:17.913 INFO:teuthology.orchestra.run.smithi177.stdout:2122 punch from 0x520ea6d to 0x521763c, (0x8bcf bytes) 2019-12-16T22:46:17.956 INFO:teuthology.orchestra.run.smithi177.stdout:2650 write 0xcf5f406 thru 0xcf63219 (0x3e14 bytes) 2019-12-16T22:46:17.965 INFO:teuthology.orchestra.run.smithi177.stdout:2123 writesame 0xd59a51a thru 0xd59fa1c data_size 0x1(0x5503 bytes) 2019-12-16T22:46:17.967 INFO:teuthology.orchestra.run.smithi177.stdout:3206 writesame 0xd20eba thru 0xd2572d data_size 0x2(0x4874 bytes) 2019-12-16T22:46:17.990 INFO:teuthology.orchestra.run.smithi177.stdout:3207 read 0x34ef95 thru 0x35acf4 (0xbd60 bytes) 2019-12-16T22:46:17.994 INFO:teuthology.orchestra.run.smithi177.stdout:2124 read 0x299202b thru 0x299be20 (0x9df6 bytes) 2019-12-16T22:46:17.994 INFO:teuthology.orchestra.run.smithi177.stdout:2125 punch from 0x2720b8f to 0x272d94e, (0xcdbf bytes) 2019-12-16T22:46:17.995 INFO:teuthology.orchestra.run.smithi177.stdout:2126 write 0x2a7c57b thru 0x2a7edfe (0x2884 bytes) 2019-12-16T22:46:17.999 INFO:teuthology.orchestra.run.smithi177.stdout:3208 trunc from 0x3ca3131 to 0x5bfc3a7 2019-12-16T22:46:18.010 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:18.011 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:18.011 INFO:teuthology.orchestra.run.smithi177.stdout:2131 write 0xb9f21cf thru 0xb9fe643 (0xc475 bytes) 2019-12-16T22:46:18.095 INFO:teuthology.orchestra.run.smithi177.stdout:2133 read 0xc78211 thru 0xc7ef8e (0x6d7e bytes) 2019-12-16T22:46:18.096 INFO:teuthology.orchestra.run.smithi177.stdout:2134 write 0x267786a thru 0x2680729 (0x8ec0 bytes) 2019-12-16T22:46:18.127 INFO:teuthology.orchestra.run.smithi177.stdout:2651 read 0x7f80f74 thru 0x7f8b1fc (0xa289 bytes) 2019-12-16T22:46:18.128 INFO:teuthology.orchestra.run.smithi177.stdout:2652 punch from 0xdb2172 to 0xdb3fbc, (0x1e4a bytes) 2019-12-16T22:46:18.129 INFO:teuthology.orchestra.run.smithi177.stdout:2653 write 0xb2eb1cc thru 0xb2f3555 (0x838a bytes) 2019-12-16T22:46:18.154 INFO:teuthology.orchestra.run.smithi177.stdout:2136 trunc from 0xd59fa1d to 0x7d341d1 2019-12-16T22:46:18.211 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #20, image image_cluster1.client.mirror.3-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent21 2019-12-16T22:46:18.356 INFO:teuthology.orchestra.run.smithi177.stdout:3209 write 0xce5ab4d thru 0xce6a874 (0xfd28 bytes) 2019-12-16T22:46:18.357 INFO:teuthology.orchestra.run.smithi177.stdout:2654 write 0xbf04fe3 thru 0xbf08f14 (0x3f32 bytes) 2019-12-16T22:46:18.415 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:18.415 INFO:teuthology.orchestra.run.smithi177.stdout:2137 write 0x744a46c thru 0x744aa45 (0x5da bytes) 2019-12-16T22:46:18.420 INFO:teuthology.orchestra.run.smithi177.stdout:2449 trunc from 0xdb8ca7f to 0xaf940d2 2019-12-16T22:46:18.441 INFO:teuthology.orchestra.run.smithi177.stdout:3210 read 0xcc8ea71 thru 0xcc91c13 (0x31a3 bytes) 2019-12-16T22:46:18.441 INFO:teuthology.orchestra.run.smithi177.stdout:3212 read 0x1a7e50 thru 0x1b4b1a (0xcccb bytes) 2019-12-16T22:46:18.453 INFO:teuthology.orchestra.run.smithi177.stdout:3214 write 0xa8c27ad thru 0xa8c9ec2 (0x7716 bytes) 2019-12-16T22:46:18.463 INFO:teuthology.orchestra.run.smithi177.stdout:2139 trunc from 0x7d341d1 to 0x96ca509 2019-12-16T22:46:18.569 INFO:teuthology.orchestra.run.smithi177.stdout:3215 write 0xabea0fe thru 0xabf3112 (0x9015 bytes) 2019-12-16T22:46:18.579 INFO:teuthology.orchestra.run.smithi177.stdout:2655 read 0x2097a38 thru 0x209829e (0x867 bytes) 2019-12-16T22:46:18.580 INFO:teuthology.orchestra.run.smithi177.stdout:2656 writesame 0x63d4c05 thru 0x63ddd20 data_size 0x4(0x911c bytes) 2019-12-16T22:46:18.605 INFO:teuthology.orchestra.run.smithi177.stdout:2140 write 0x9a0eb6 thru 0x9a1894 (0x9df bytes) 2019-12-16T22:46:18.674 INFO:teuthology.orchestra.run.smithi177.stdout:2141 read 0x6885941 thru 0x6893341 (0xda01 bytes) 2019-12-16T22:46:18.676 INFO:teuthology.orchestra.run.smithi177.stdout:2142 trunc from 0x96ca509 to 0xa13474c 2019-12-16T22:46:18.774 INFO:teuthology.orchestra.run.smithi177.stdout:3218 write 0xd430336 thru 0xd437200 (0x6ecb bytes) 2019-12-16T22:46:18.791 INFO:teuthology.orchestra.run.smithi177.stdout:2657 read 0x651ec40 thru 0x652330e (0x46cf bytes) 2019-12-16T22:46:18.793 INFO:teuthology.orchestra.run.smithi177.stdout:3219 read 0x77f08e8 thru 0x77fb743 (0xae5c bytes) 2019-12-16T22:46:18.794 INFO:teuthology.orchestra.run.smithi177.stdout:3220 punch from 0x8a62ec3 to 0x8a6ae0a, (0x7f47 bytes) 2019-12-16T22:46:18.794 INFO:teuthology.orchestra.run.smithi177.stdout:3221 punch from 0x18c5960 to 0x18ccad5, (0x7175 bytes) 2019-12-16T22:46:18.794 INFO:teuthology.orchestra.run.smithi177.stdout:3222 read 0x33af003 thru 0x33bddf0 (0xedee bytes) 2019-12-16T22:46:18.794 INFO:teuthology.orchestra.run.smithi177.stdout:3223 write 0x4e268e7 thru 0x4e3451d (0xdc37 bytes) 2019-12-16T22:46:18.794 INFO:teuthology.orchestra.run.smithi177.stdout:2658 read 0xe7633d3 thru 0xe770750 (0xd37e bytes) 2019-12-16T22:46:18.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.814+0000 7f66f9929700 -1 reset not still connected to 0x55a3700498e0 2019-12-16T22:46:18.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.814+0000 7f66f9929700 -1 reset not still connected to 0x55a378399e90 2019-12-16T22:46:18.814 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.814+0000 7f66f9929700 -1 reset not still connected to 0x55a3785ad9b0 2019-12-16T22:46:18.836 INFO:teuthology.orchestra.run.smithi177.stdout:2143 read 0x29b86d4 thru 0x29c4f21 (0xc84e bytes) 2019-12-16T22:46:18.842 INFO:teuthology.orchestra.run.smithi177.stdout:2144 read 0x80e7d3f thru 0x80ea18f (0x2451 bytes) 2019-12-16T22:46:18.842 INFO:teuthology.orchestra.run.smithi177.stdout:2145 trunc from 0xa13474c to 0xa55cca9 2019-12-16T22:46:18.855 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.854+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdeeff0 2019-12-16T22:46:18.855 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.854+0000 7f85ca542700 -1 reset not still connected to 0x559a10391930 2019-12-16T22:46:18.855 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.854+0000 7f85ca542700 -1 reset not still connected to 0x559a184848a0 2019-12-16T22:46:18.855 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.854+0000 7f85ca542700 -1 reset not still connected to 0x559a197b7860 2019-12-16T22:46:18.856 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.854+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:18.856 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.854+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:18.856 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.854+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:18.896 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.890+0000 7f85ca542700 -1 reset not still connected to 0x559a0b169a00 2019-12-16T22:46:18.902 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:18.890+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9cd00 2019-12-16T22:46:18.902 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:18.894+0000 7f884a7b2700 -1 reset not still connected to 0x560113c9e150 2019-12-16T22:46:18.902 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:18.894+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:46:18.903 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:18.894+0000 7f884a7b2700 -1 reset not still connected to 0x56011c5f3860 2019-12-16T22:46:18.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.894+0000 7f66f9929700 -1 reset not still connected to 0x55a369f8be90 2019-12-16T22:46:18.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.894+0000 7f66f9929700 -1 reset not still connected to 0x55a36a3987d0 2019-12-16T22:46:18.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.894+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc72b60 2019-12-16T22:46:18.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.898+0000 7f66f9929700 -1 reset not still connected to 0x55a36c55c000 2019-12-16T22:46:18.904 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.894+0000 7f85ca542700 -1 reset not still connected to 0x559a0b16a080 2019-12-16T22:46:18.904 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.898+0000 7f85ca542700 -1 reset not still connected to 0x559a0bbbe270 2019-12-16T22:46:18.906 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a0e045670 2019-12-16T22:46:18.907 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a0e31e150 2019-12-16T22:46:18.907 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a0eebae50 2019-12-16T22:46:18.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f66f9929700 -1 reset not still connected to 0x55a36fd13930 2019-12-16T22:46:18.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f66f9929700 -1 reset not still connected to 0x55a3700498e0 2019-12-16T22:46:18.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f66f9929700 -1 reset not still connected to 0x55a378399e90 2019-12-16T22:46:18.908 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdeeff0 2019-12-16T22:46:18.909 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a10391930 2019-12-16T22:46:18.909 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a184848a0 2019-12-16T22:46:18.909 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a197b7860 2019-12-16T22:46:18.909 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:18.909 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:18.909 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:18.909 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:18.910 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a24379110 2019-12-16T22:46:18.910 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a249dadd0 2019-12-16T22:46:18.910 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f85ca542700 -1 reset not still connected to 0x559a24b26b60 2019-12-16T22:46:18.911 INFO:teuthology.orchestra.run.smithi177.stdout:3226 write 0x87e5760 thru 0x87e79fe (0x229f bytes) 2019-12-16T22:46:18.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:18.902+0000 7f66f9929700 -1 reset not still connected to 0x55a3785ad9b0 2019-12-16T22:46:18.959 INFO:teuthology.orchestra.run.smithi177.stdout:2146 punch from 0x51a0916 to 0x51abe05, (0xb4ef bytes) 2019-12-16T22:46:18.963 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:18.963 INFO:teuthology.orchestra.run.smithi177.stdout:2451 write 0x29db141 thru 0x29e6daf (0xbc6f bytes) 2019-12-16T22:46:18.968 INFO:teuthology.orchestra.run.smithi177.stdout:3227 flatten 2019-12-16T22:46:18.973 INFO:teuthology.orchestra.run.smithi177.stdout:2659 write 0xeb85256 thru 0xeb8dccb (0x8a76 bytes) 2019-12-16T22:46:19.140 INFO:teuthology.orchestra.run.smithi177.stdout:2147 writesame 0xbc2282d thru 0xbc2bbb2 data_size 0x17(0x9386 bytes) 2019-12-16T22:46:19.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.134+0000 7f66f9929700 -1 reset not still connected to 0x55a36a9fa5b0 2019-12-16T22:46:19.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.134+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc72b60 2019-12-16T22:46:19.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.134+0000 7f66f9929700 -1 reset not still connected to 0x55a36c55c000 2019-12-16T22:46:19.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.134+0000 7f66f9929700 -1 reset not still connected to 0x55a36fd13930 2019-12-16T22:46:19.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.134+0000 7f66f9929700 -1 reset not still connected to 0x55a3700498e0 2019-12-16T22:46:19.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.134+0000 7f66f9929700 -1 reset not still connected to 0x55a377f63a00 2019-12-16T22:46:19.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.138+0000 7f66f9929700 -1 reset not still connected to 0x55a377f63d40 2019-12-16T22:46:19.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.138+0000 7f66f9929700 -1 reset not still connected to 0x55a378399e90 2019-12-16T22:46:19.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.138+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f30c0 2019-12-16T22:46:19.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.138+0000 7f66f9929700 -1 reset not still connected to 0x55a379b50270 2019-12-16T22:46:19.157 INFO:teuthology.orchestra.run.smithi177.stdout:2149 read 0x271e3b2 thru 0x2724266 (0x5eb5 bytes) 2019-12-16T22:46:19.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.186+0000 7f66f9929700 -1 reset not still connected to 0x55a36c55c000 2019-12-16T22:46:19.193 INFO:teuthology.orchestra.run.smithi177.stdout:2452 read 0x2731a66 thru 0x2738bf0 (0x718b bytes) 2019-12-16T22:46:19.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.194+0000 7f66f9929700 -1 reset not still connected to 0x55a36fd13930 2019-12-16T22:46:19.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.194+0000 7f66f9929700 -1 reset not still connected to 0x55a3700498e0 2019-12-16T22:46:19.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.194+0000 7f66f9929700 -1 reset not still connected to 0x55a377f63a00 2019-12-16T22:46:19.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.198+0000 7f66f9929700 -1 reset not still connected to 0x55a377f63d40 2019-12-16T22:46:19.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.198+0000 7f66f9929700 -1 reset not still connected to 0x55a378399e90 2019-12-16T22:46:19.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.198+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f30c0 2019-12-16T22:46:19.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.198+0000 7f66f9929700 -1 reset not still connected to 0x55a379b50270 2019-12-16T22:46:19.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.198+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51a00 2019-12-16T22:46:19.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a369f8be90 2019-12-16T22:46:19.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a36a3987d0 2019-12-16T22:46:19.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc72b60 2019-12-16T22:46:19.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a36c55c000 2019-12-16T22:46:19.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721450 2019-12-16T22:46:19.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a36c722490 2019-12-16T22:46:19.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a36fd13930 2019-12-16T22:46:19.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a3700498e0 2019-12-16T22:46:19.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.306+0000 7f66f9929700 -1 reset not still connected to 0x55a377f63a00 2019-12-16T22:46:19.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.310+0000 7f66f9929700 -1 reset not still connected to 0x55a378399e90 2019-12-16T22:46:19.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.310+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f1ad0 2019-12-16T22:46:19.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.310+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f30c0 2019-12-16T22:46:19.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.310+0000 7f66f9929700 -1 reset not still connected to 0x55a379b50270 2019-12-16T22:46:19.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:19.310+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51a00 2019-12-16T22:46:19.336 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:19.336 INFO:teuthology.orchestra.run.smithi177.stdout:3229 read 0x81c2024 thru 0x81ccb33 (0xab10 bytes) 2019-12-16T22:46:19.336 INFO:teuthology.orchestra.run.smithi177.stdout:3230 writesame 0xa5634df thru 0xa56a1e9 data_size 0x5(0x6d0b bytes) 2019-12-16T22:46:19.378 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.374+0000 7fb660f13700 -1 reset not still connected to 0x55f63e7204e0 2019-12-16T22:46:19.400 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:46:19.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ffb0 2019-12-16T22:46:19.400 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:46:19.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a90150 2019-12-16T22:46:19.400 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:46:19.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be4970 2019-12-16T22:46:19.478 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.470+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba4680 2019-12-16T22:46:19.478 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.470+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba4d00 2019-12-16T22:46:19.478 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.470+0000 7f884a7b2700 -1 reset not still connected to 0x56011bba5ad0 2019-12-16T22:46:19.478 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.470+0000 7f884a7b2700 -1 reset not still connected to 0x56011c5f3860 2019-12-16T22:46:19.478 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.470+0000 7f884a7b2700 -1 reset not still connected to 0x56011caccf20 2019-12-16T22:46:19.479 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.474+0000 7f884a7b2700 -1 reset not still connected to 0x56011ce167d0 2019-12-16T22:46:19.479 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.474+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474490 2019-12-16T22:46:19.479 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.474+0000 7f884a7b2700 -1 reset not still connected to 0x56011d474b10 2019-12-16T22:46:19.479 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:19.474+0000 7f884a7b2700 -1 reset not still connected to 0x56011fa3f4d0 2019-12-16T22:46:19.550 INFO:teuthology.orchestra.run.smithi177.stdout:2150 write 0xd6687ca thru 0xd66f10a (0x6941 bytes) 2019-12-16T22:46:19.606 INFO:teuthology.orchestra.run.smithi177.stdout:3231 read 0x32bdadc thru 0x32cb9a4 (0xdec9 bytes) 2019-12-16T22:46:19.607 INFO:teuthology.orchestra.run.smithi177.stdout:3232 read 0xd3e57ca thru 0xd3ebf22 (0x6759 bytes) 2019-12-16T22:46:19.607 INFO:teuthology.orchestra.run.smithi177.stdout:3234 punch from 0x7a34435 to 0x7a3a9b0, (0x657b bytes) 2019-12-16T22:46:19.620 INFO:teuthology.orchestra.run.smithi177.stdout:3235 trunc from 0xd437201 to 0x5b70f64 2019-12-16T22:46:19.630 INFO:teuthology.orchestra.run.smithi177.stdout:2661 punch from 0x3ae0b24 to 0x3ae348b, (0x2967 bytes) 2019-12-16T22:46:19.631 INFO:teuthology.orchestra.run.smithi177.stdout:2662 clone 18 order 18 su 1024 sc 2 2019-12-16T22:46:19.642 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.638+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb0d80 2019-12-16T22:46:19.644 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.638+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a680 2019-12-16T22:46:19.644 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.638+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a750 2019-12-16T22:46:19.646 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.638+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a820 2019-12-16T22:46:19.646 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.638+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84aea0 2019-12-16T22:46:19.654 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.646+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84b040 2019-12-16T22:46:19.654 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.646+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84bba0 2019-12-16T22:46:19.656 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d9765b0 2019-12-16T22:46:19.657 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976750 2019-12-16T22:46:19.657 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976820 2019-12-16T22:46:19.657 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976b60 2019-12-16T22:46:19.657 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976dd0 2019-12-16T22:46:19.657 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d977790 2019-12-16T22:46:19.657 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d977d40 2019-12-16T22:46:19.658 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d978560 2019-12-16T22:46:19.658 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d979670 2019-12-16T22:46:19.658 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbec30 2019-12-16T22:46:19.658 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbf6c0 2019-12-16T22:46:19.659 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc1c20 2019-12-16T22:46:19.659 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa76c0 2019-12-16T22:46:19.661 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa7930 2019-12-16T22:46:19.661 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa90c0 2019-12-16T22:46:19.661 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9190 2019-12-16T22:46:19.661 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9260 2019-12-16T22:46:19.661 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9400 2019-12-16T22:46:19.661 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9c20 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34a000 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34a410 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34aea0 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34b450 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34b790 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34be10 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34cff0 2019-12-16T22:46:19.662 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34d260 2019-12-16T22:46:19.663 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34d810 2019-12-16T22:46:19.663 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e7204e0 2019-12-16T22:46:19.664 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e722080 2019-12-16T22:46:19.664 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e722cb0 2019-12-16T22:46:19.664 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63e723260 2019-12-16T22:46:19.664 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63f6daea0 2019-12-16T22:46:19.664 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f63f6dcd80 2019-12-16T22:46:19.664 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f64055cd00 2019-12-16T22:46:19.664 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.654+0000 7fb660f13700 -1 reset not still connected to 0x55f64055f9b0 2019-12-16T22:46:19.694 INFO:teuthology.orchestra.run.smithi177.stdout:2152 punch from 0x8740514 to 0x8743fa7, (0x3a93 bytes) 2019-12-16T22:46:19.696 INFO:teuthology.orchestra.run.smithi177.stdout:2153 clone 22 order 21 su 1048576 sc 6 2019-12-16T22:46:19.759 INFO:teuthology.orchestra.run.smithi177.stdout:2454 write 0xe2e1cbd thru 0xe2e256f (0x8b3 bytes) 2019-12-16T22:46:19.811 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.806+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84bd40 2019-12-16T22:46:19.811 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:19.806+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84c080 2019-12-16T22:46:19.812 INFO:teuthology.orchestra.run.smithi177.stdout:3236 trunc from 0x5b70f64 to 0x2193278 2019-12-16T22:46:19.843 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:19.843 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:19.844 INFO:teuthology.orchestra.run.smithi177.stdout:2458 write 0x52e063e thru 0x52ec69e (0xc061 bytes) 2019-12-16T22:46:19.946 INFO:teuthology.orchestra.run.smithi177.stdout:2459 read 0x23a1706 thru 0x23b0999 (0xf294 bytes) 2019-12-16T22:46:19.949 INFO:teuthology.orchestra.run.smithi177.stdout:2460 writesame 0x29128b5 thru 0x2921019 data_size 0x1(0xe765 bytes) 2019-12-16T22:46:20.034 INFO:teuthology.orchestra.run.smithi177.stdout:2461 clone 23 order 19 su 8192 sc 11 2019-12-16T22:46:20.108 INFO:teuthology.orchestra.run.smithi177.stdout:3239 writesame 0xd40f677 thru 0xd41d7ee data_size 0x6f(0xe178 bytes) 2019-12-16T22:46:20.112 INFO:teuthology.orchestra.run.smithi177.stdout:3240 write 0x1891d7 thru 0x18aa3e (0x1868 bytes) 2019-12-16T22:46:20.156 INFO:teuthology.orchestra.run.smithi177.stdout:3241 read 0x811e793 thru 0x811f703 (0xf71 bytes) 2019-12-16T22:46:20.156 INFO:teuthology.orchestra.run.smithi177.stdout:3243 punch from 0x351ba05 to 0x352979d, (0xdd98 bytes) 2019-12-16T22:46:20.156 INFO:teuthology.orchestra.run.smithi177.stdout:3244 trunc from 0xd41d7ef to 0xc866d3b 2019-12-16T22:46:20.247 INFO:teuthology.orchestra.run.smithi177.stdout:3245 trunc from 0xc866d3b to 0x93a400 2019-12-16T22:46:20.310 INFO:teuthology.orchestra.run.smithi177.stdout:3247 writesame 0x26619d0 thru 0x2670972 data_size 0x8f(0xefa3 bytes) 2019-12-16T22:46:20.318 INFO:teuthology.orchestra.run.smithi177.stdout:3248 read 0x124289e thru 0x124d839 (0xaf9c bytes) 2019-12-16T22:46:20.318 INFO:teuthology.orchestra.run.smithi177.stdout:3249 read 0x19615ea thru 0x1969799 (0x81b0 bytes) 2019-12-16T22:46:20.320 INFO:teuthology.orchestra.run.smithi177.stdout:3250 trunc from 0x2670973 to 0x2df83e6 2019-12-16T22:46:20.386 INFO:teuthology.orchestra.run.smithi177.stdout:3254 writesame 0xcc488a5 thru 0xcc4bbdd data_size 0x2f(0x3339 bytes) 2019-12-16T22:46:20.389 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone21 from 0xd66f10b (overlap 0x105d352) to 0x0 2019-12-16T22:46:20.391 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.3-clone22 from 0xe2e2570 (overlap 0xaf940d2) to 0x9e053f0 2019-12-16T22:46:20.398 INFO:teuthology.orchestra.run.smithi177.stdout:3255 trunc from 0xcc4bbde to 0x8481547 2019-12-16T22:46:20.436 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.5-clone17 from 0xeb8dccc (overlap 0xb4437c) to 0x481afe 2019-12-16T22:46:20.526 INFO:teuthology.orchestra.run.smithi177.stdout:3256 punch from 0x28d8850 to 0x28e0075, (0x7825 bytes) 2019-12-16T22:46:20.658 INFO:teuthology.orchestra.run.smithi177.stdout:3257 write 0x8bba544 thru 0x8bc278c (0x8249 bytes) 2019-12-16T22:46:20.771 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #20, image image_cluster1.client.mirror.2-clone20 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent21 2019-12-16T22:46:20.827 INFO:teuthology.orchestra.run.smithi177.stdout:3259 trunc from 0x8bc278d to 0x8499171 2019-12-16T22:46:20.860 INFO:teuthology.orchestra.run.smithi177.stdout:2154 read 0xb21e063 thru 0xb228b0a (0xaaa8 bytes) 2019-12-16T22:46:21.016 INFO:teuthology.orchestra.run.smithi177.stdout:2155 punch from 0x74dd60b to 0x74e2897, (0x528c bytes) 2019-12-16T22:46:21.016 INFO:teuthology.orchestra.run.smithi177.stdout:2158 writesame 0x9356f8b thru 0x935adc4 data_size 0x1e(0x3e3a bytes) 2019-12-16T22:46:21.042 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:21.042 INFO:teuthology.orchestra.run.smithi177.stdout:2161 read 0xb19baa5 thru 0xb1ab020 (0xf57c bytes) 2019-12-16T22:46:21.046 INFO:teuthology.orchestra.run.smithi177.stdout:3260 writesame 0x80064d7 thru 0x8014e21 data_size 0x1(0xe94b bytes) 2019-12-16T22:46:21.078 INFO:teuthology.orchestra.run.smithi177.stdout:2163 trunc from 0xd66f10b to 0x414844b 2019-12-16T22:46:21.127 INFO:teuthology.orchestra.run.smithi177.stdout:3261 trunc from 0x8499171 to 0xeb3121c 2019-12-16T22:46:21.136 INFO:teuthology.orchestra.run.smithi177.stdout:2379 writesame 0x4037283 thru 0x4038c4d data_size 0x3(0x19cb bytes) 2019-12-16T22:46:21.158 INFO:teuthology.orchestra.run.smithi177.stdout:3262 write 0xce28560 thru 0xce36917 (0xe3b8 bytes) 2019-12-16T22:46:21.197 INFO:teuthology.orchestra.run.smithi177.stdout:2164 write 0x3b0fb4a thru 0x3b13000 (0x34b7 bytes) 2019-12-16T22:46:21.254 INFO:teuthology.orchestra.run.smithi177.stdout:3264 read 0x21af31e thru 0x21b1229 (0x1f0c bytes) 2019-12-16T22:46:21.311 INFO:teuthology.orchestra.run.smithi177.stdout:2166 write 0xd585cae thru 0xd58af96 (0x52e9 bytes) 2019-12-16T22:46:21.341 INFO:teuthology.orchestra.run.smithi177.stdout:2170 trunc from 0xd58af97 to 0xcd31365 2019-12-16T22:46:21.375 INFO:teuthology.orchestra.run.smithi177.stdout:3265 write 0xedb21a7 thru 0xedbf433 (0xd28d bytes) 2019-12-16T22:46:21.401 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #21, image image_cluster1.client.mirror.3-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent22 2019-12-16T22:46:21.403 INFO:teuthology.orchestra.run.smithi177.stdout:2172 writesame 0x503d15 thru 0x50e45c data_size 0x35(0xa748 bytes) 2019-12-16T22:46:21.451 INFO:teuthology.orchestra.run.smithi177.stdout:2174 write 0xb020b53 thru 0xb02b5db (0xaa89 bytes) 2019-12-16T22:46:21.523 INFO:teuthology.orchestra.run.smithi177.stdout:3266 write 0x901d08a thru 0x9028e20 (0xbd97 bytes) 2019-12-16T22:46:21.523 INFO:teuthology.orchestra.run.smithi177.stdout:2175 punch from 0x75b89cb to 0x75c55e3, (0xcc18 bytes) 2019-12-16T22:46:21.523 INFO:teuthology.orchestra.run.smithi177.stdout:2177 read 0x66d5c27 thru 0x66d7567 (0x1941 bytes) 2019-12-16T22:46:21.524 INFO:teuthology.orchestra.run.smithi177.stdout:2178 writesame 0x433e8c thru 0x44327f data_size 0x1a(0xf3f4 bytes) 2019-12-16T22:46:21.739 INFO:teuthology.orchestra.run.smithi177.stdout:3268 write 0x7dd69e1 thru 0x7dda38a (0x39aa bytes) 2019-12-16T22:46:21.774 INFO:teuthology.orchestra.run.smithi177.stdout:2181 read 0x8c0e57d thru 0x8c14643 (0x60c7 bytes) 2019-12-16T22:46:21.775 INFO:teuthology.orchestra.run.smithi177.stdout:2182 punch from 0x8db5933 to 0x8dbe4a7, (0x8b74 bytes) 2019-12-16T22:46:21.775 INFO:teuthology.orchestra.run.smithi177.stdout:2183 write 0x5021d6d thru 0x5029a52 (0x7ce6 bytes) 2019-12-16T22:46:21.834 INFO:teuthology.orchestra.run.smithi177.stdout:3269 write 0x8d97fde thru 0x8da621c (0xe23f bytes) 2019-12-16T22:46:21.950 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:21.950 INFO:teuthology.orchestra.run.smithi177.stdout:2185 writesame 0x1293aa2 thru 0x129e94f data_size 0x3a(0xaeae bytes) 2019-12-16T22:46:21.977 INFO:teuthology.orchestra.run.smithi177.stdout:3271 read 0x3474869 thru 0x3481494 (0xcc2c bytes) 2019-12-16T22:46:21.977 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:21.978 INFO:teuthology.orchestra.run.smithi177.stdout:3273 write 0xcf81625 thru 0xcf83962 (0x233e bytes) 2019-12-16T22:46:22.029 INFO:teuthology.orchestra.run.smithi177.stdout:3274 read 0x2e02634 thru 0x2e043b0 (0x1d7d bytes) 2019-12-16T22:46:22.029 INFO:teuthology.orchestra.run.smithi177.stdout:3275 trunc from 0xedbf434 to 0xb95ceed 2019-12-16T22:46:22.035 INFO:teuthology.orchestra.run.smithi177.stdout:2188 writesame 0x491d0ae thru 0x4927324 data_size 0x13(0xa277 bytes) 2019-12-16T22:46:22.059 INFO:teuthology.orchestra.run.smithi177.stdout:2189 writesame 0xc99b2a7 thru 0xc9a11a3 data_size 0x1(0x5efd bytes) 2019-12-16T22:46:22.133 INFO:teuthology.orchestra.run.smithi177.stdout:2190 write 0x2957b9a thru 0x295a586 (0x29ed bytes) 2019-12-16T22:46:22.196 INFO:teuthology.orchestra.run.smithi177.stdout:2191 read 0xbacf47f thru 0xbaddea9 (0xea2b bytes) 2019-12-16T22:46:22.196 INFO:teuthology.orchestra.run.smithi177.stdout:2194 write 0x385a912 thru 0x3862fc4 (0x86b3 bytes) 2019-12-16T22:46:22.231 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.232 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.232 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.232 INFO:teuthology.orchestra.run.smithi177.stdout:2199 write 0x680c2e5 thru 0x68114b8 (0x51d4 bytes) 2019-12-16T22:46:22.257 INFO:teuthology.orchestra.run.smithi177.stdout:2200 punch from 0x9f86cd1 to 0x9f939a8, (0xccd7 bytes) 2019-12-16T22:46:22.258 INFO:teuthology.orchestra.run.smithi177.stdout:2201 writesame 0x63f0915 thru 0x63fbe30 data_size 0x86(0xb51c bytes) 2019-12-16T22:46:22.270 INFO:teuthology.orchestra.run.smithi177.stdout:2202 writesame 0x49b7640 thru 0x49ba91f data_size 0x4a(0x32e0 bytes) 2019-12-16T22:46:22.292 INFO:teuthology.orchestra.run.smithi177.stdout:2205 read 0x2530391 thru 0x253c4a1 (0xc111 bytes) 2019-12-16T22:46:22.292 INFO:teuthology.orchestra.run.smithi177.stdout:2207 write 0x34882f thru 0x3565c8 (0xdd9a bytes) 2019-12-16T22:46:22.293 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.293 INFO:teuthology.orchestra.run.smithi177.stdout:3277 write 0xb8ff331 thru 0xb90dd6d (0xea3d bytes) 2019-12-16T22:46:22.334 INFO:teuthology.orchestra.run.smithi177.stdout:3278 write 0x1f8191f thru 0x1f8afb8 (0x969a bytes) 2019-12-16T22:46:22.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:22.362+0000 7f66f9929700 -1 reset not still connected to 0x55a3700498e0 2019-12-16T22:46:22.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:22.362+0000 7f66f9929700 -1 reset not still connected to 0x55a377f63d40 2019-12-16T22:46:22.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:22.362+0000 7f66f9929700 -1 reset not still connected to 0x55a378399e90 2019-12-16T22:46:22.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:22.362+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f30c0 2019-12-16T22:46:22.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:22.362+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51a00 2019-12-16T22:46:22.389 INFO:teuthology.orchestra.run.smithi177.stdout:2208 read 0x1a85e10 thru 0x1a91a0e (0xbbff bytes) 2019-12-16T22:46:22.395 INFO:teuthology.orchestra.run.smithi177.stdout:2209 trunc from 0xcd31365 to 0x9bab7e7 2019-12-16T22:46:22.401 INFO:teuthology.orchestra.run.smithi177.stdout:3279 read 0x885b4ac thru 0x886705f (0xbbb4 bytes) 2019-12-16T22:46:22.417 INFO:teuthology.orchestra.run.smithi177.stdout:3280 read 0x4b86a92 thru 0x4b86f54 (0x4c3 bytes) 2019-12-16T22:46:22.422 INFO:teuthology.orchestra.run.smithi177.stdout:3281 trunc from 0xb95ceed to 0x85b38bb 2019-12-16T22:46:22.450 INFO:teuthology.orchestra.run.smithi177.stdout:2462 punch from 0x935d70e to 0x9366ab1, (0x93a3 bytes) 2019-12-16T22:46:22.516 INFO:teuthology.orchestra.run.smithi177.stdout:2463 punch from 0x380597a to 0x3809ca1, (0x4327 bytes) 2019-12-16T22:46:22.516 INFO:teuthology.orchestra.run.smithi177.stdout:2464 writesame 0x624d257 thru 0x62594b8 data_size 0x2(0xc262 bytes) 2019-12-16T22:46:22.553 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.553 INFO:teuthology.orchestra.run.smithi177.stdout:2212 writesame 0x1ad1456 thru 0x1adfa52 data_size 0xd(0xe5fd bytes) 2019-12-16T22:46:22.590 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.591 INFO:teuthology.orchestra.run.smithi177.stdout:2214 read 0x6a1f4b8 thru 0x6a257e3 (0x632c bytes) 2019-12-16T22:46:22.591 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.591 INFO:teuthology.orchestra.run.smithi177.stdout:2217 read 0x49e70d5 thru 0x49ec270 (0x519c bytes) 2019-12-16T22:46:22.601 INFO:teuthology.orchestra.run.smithi177.stdout:2218 trunc from 0x9bab7e7 to 0x3a0cb7f 2019-12-16T22:46:22.633 INFO:teuthology.orchestra.run.smithi177.stdout:3282 punch from 0x5a0f82b to 0x5a0ff50, (0x725 bytes) 2019-12-16T22:46:22.645 INFO:teuthology.orchestra.run.smithi177.stdout:2465 read 0x2e0b47 thru 0x2ee13e (0xd5f8 bytes) 2019-12-16T22:46:22.648 INFO:teuthology.orchestra.run.smithi177.stdout:2466 writesame 0x7ca4a0b thru 0x7cb2d5f data_size 0x13(0xe355 bytes) 2019-12-16T22:46:22.671 INFO:teuthology.orchestra.run.smithi177.stdout:3283 write 0xabc09c8 thru 0xabc4ddb (0x4414 bytes) 2019-12-16T22:46:22.684 INFO:teuthology.orchestra.run.smithi177.stdout:3284 read 0x4837ceb thru 0x48411ba (0x94d0 bytes) 2019-12-16T22:46:22.713 INFO:teuthology.orchestra.run.smithi177.stdout:3285 write 0xd341a4b thru 0xd34eaf5 (0xd0ab bytes) 2019-12-16T22:46:22.739 INFO:teuthology.orchestra.run.smithi177.stdout:3288 trunc from 0xd34eaf6 to 0xe50ed45 2019-12-16T22:46:22.744 INFO:teuthology.orchestra.run.smithi177.stdout:2467 trunc from 0xe2e2570 to 0xc47acc2 2019-12-16T22:46:22.763 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:22.763 INFO:teuthology.orchestra.run.smithi177.stdout:3290 write 0xba8ed60 thru 0xba98f8c (0xa22d bytes) 2019-12-16T22:46:22.784 INFO:teuthology.orchestra.run.smithi177.stdout:3292 punch from 0x1a0c9f5 to 0x1a101da, (0x37e5 bytes) 2019-12-16T22:46:22.784 INFO:teuthology.orchestra.run.smithi177.stdout:3293 trunc from 0xe50ed45 to 0xe41f973 2019-12-16T22:46:22.810 INFO:teuthology.orchestra.run.smithi177.stdout:3297 read 0x7ab1f6c thru 0x7ab3d97 (0x1e2c bytes) 2019-12-16T22:46:22.810 INFO:teuthology.orchestra.run.smithi177.stdout:3298 writesame 0x5a5ab5c thru 0x5a691c1 data_size 0x4d(0xe666 bytes) 2019-12-16T22:46:22.835 INFO:teuthology.orchestra.run.smithi177.stdout:2220 trunc from 0x3a0cb7f to 0x6a01f9e 2019-12-16T22:46:22.861 INFO:teuthology.orchestra.run.smithi177.stdout:2221 read 0x622027c thru 0x62284f9 (0x827e bytes) 2019-12-16T22:46:22.861 INFO:teuthology.orchestra.run.smithi177.stdout:2222 read 0x341d2d9 thru 0x3429573 (0xc29b bytes) 2019-12-16T22:46:22.863 INFO:teuthology.orchestra.run.smithi177.stdout:2223 read 0x5272e74 thru 0x5272eb0 (0x3d bytes) 2019-12-16T22:46:22.890 INFO:teuthology.orchestra.run.smithi177.stdout:2224 writesame 0x9711256 thru 0x9714fcd data_size 0x1c(0x3d78 bytes) 2019-12-16T22:46:22.929 INFO:teuthology.orchestra.run.smithi177.stdout:2225 writesame 0xca7cb05 thru 0xca7cc7e data_size 0x12(0x17a bytes) 2019-12-16T22:46:22.932 INFO:teuthology.orchestra.run.smithi177.stdout:2226 read 0x1b58cc0 thru 0x1b672fc (0xe63d bytes) 2019-12-16T22:46:22.932 INFO:teuthology.orchestra.run.smithi177.stdout:2230 read 0x13d7cad thru 0x13e3a8e (0xbde2 bytes) 2019-12-16T22:46:22.935 INFO:teuthology.orchestra.run.smithi177.stdout:2232 write 0x799146a thru 0x799aafb (0x9692 bytes) 2019-12-16T22:46:22.947 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #16, image image_cluster1.client.mirror.5-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent17 2019-12-16T22:46:22.953 INFO:teuthology.orchestra.run.smithi177.stdout:2233 trunc from 0xca7cc7f to 0xb79d2e7 2019-12-16T22:46:23.108 INFO:teuthology.orchestra.run.smithi177.stdout:2234 clone 23 order 23 su 524288 sc 15 2019-12-16T22:46:23.109 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:23.109 INFO:teuthology.orchestra.run.smithi177.stdout:2664 write 0xb965fc2 thru 0xb9703ed (0xa42c bytes) 2019-12-16T22:46:23.206 INFO:teuthology.orchestra.run.smithi177.stdout:2665 read 0x8786fc7 thru 0x878bdbd (0x4df7 bytes) 2019-12-16T22:46:23.295 INFO:teuthology.orchestra.run.smithi177.stdout:2666 read 0xc54eeed thru 0xc5540e4 (0x51f8 bytes) 2019-12-16T22:46:23.295 INFO:teuthology.orchestra.run.smithi177.stdout:2667 punch from 0x5ebff72 to 0x5ecd390, (0xd41e bytes) 2019-12-16T22:46:23.296 INFO:teuthology.orchestra.run.smithi177.stdout:2669 punch from 0xa05958b to 0xa060cba, (0x772f bytes) 2019-12-16T22:46:23.296 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:23.296 INFO:teuthology.orchestra.run.smithi177.stdout:2671 read 0xda3be2a thru 0xda48807 (0xc9de bytes) 2019-12-16T22:46:23.296 INFO:teuthology.orchestra.run.smithi177.stdout:2673 read 0x20d8b54 thru 0x20ddf25 (0x53d2 bytes) 2019-12-16T22:46:23.296 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:23.296 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:23.297 INFO:teuthology.orchestra.run.smithi177.stdout:2676 writesame 0x4be8ef thru 0x4cd811 data_size 0x1(0xef23 bytes) 2019-12-16T22:46:23.604 INFO:teuthology.orchestra.run.smithi177.stdout:3299 write 0x2a6c70e thru 0x2a7628c (0x9b7f bytes) 2019-12-16T22:46:23.627 INFO:teuthology.orchestra.run.smithi177.stdout:3301 write 0x894fba thru 0x89c46a (0x74b1 bytes) 2019-12-16T22:46:23.642 INFO:teuthology.orchestra.run.smithi177.stdout:3302 write 0x75eea74 thru 0x75f3175 (0x4702 bytes) 2019-12-16T22:46:23.651 INFO:teuthology.orchestra.run.smithi177.stdout:3305 read 0x80851f3 thru 0x808d900 (0x870e bytes) 2019-12-16T22:46:23.651 INFO:teuthology.orchestra.run.smithi177.stdout:3306 write 0xe3f05c4 thru 0xe3f98aa (0x92e7 bytes) 2019-12-16T22:46:23.660 INFO:teuthology.orchestra.run.smithi177.stdout:2468 trunc from 0xc47acc2 to 0x366961f 2019-12-16T22:46:23.731 INFO:teuthology.orchestra.run.smithi177.stdout:2381 write 0x470d12e thru 0x4717e0b (0xacde bytes) 2019-12-16T22:46:23.731 INFO:teuthology.orchestra.run.smithi177.stdout:3308 punch from 0xa2fae9a to 0xa30523b, (0xa3a1 bytes) 2019-12-16T22:46:23.731 INFO:teuthology.orchestra.run.smithi177.stdout:3310 read 0xad0512c thru 0xad0d7f9 (0x86ce bytes) 2019-12-16T22:46:23.732 INFO:teuthology.orchestra.run.smithi177.stdout:3311 punch from 0xe01569c to 0xe01fc4d, (0xa5b1 bytes) 2019-12-16T22:46:23.753 INFO:teuthology.orchestra.run.smithi177.stdout:2677 trunc from 0xeb8dccc to 0x8eb966b 2019-12-16T22:46:23.756 INFO:teuthology.orchestra.run.smithi177.stdout:3312 trunc from 0xe41f973 to 0x73c9ef5 2019-12-16T22:46:24.014 INFO:teuthology.orchestra.run.smithi177.stdout:2678 read 0x71f88be thru 0x72065d0 (0xdd13 bytes) 2019-12-16T22:46:24.014 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:24.015 INFO:teuthology.orchestra.run.smithi177.stdout:2680 read 0x636c25e thru 0x637876f (0xc512 bytes) 2019-12-16T22:46:24.064 INFO:teuthology.orchestra.run.smithi177.stdout:2681 trunc from 0x8eb966b to 0x2a22ced 2019-12-16T22:46:24.174 INFO:teuthology.orchestra.run.smithi177.stdout:3313 read 0x324c577 thru 0x32509f8 (0x4482 bytes) 2019-12-16T22:46:24.276 INFO:teuthology.orchestra.run.smithi177.stdout:2682 trunc from 0x2a22ced to 0x1af452d 2019-12-16T22:46:24.319 INFO:teuthology.orchestra.run.smithi177.stdout:3314 write 0xc34ffdf thru 0xc355f0c (0x5f2e bytes) 2019-12-16T22:46:24.319 INFO:teuthology.orchestra.run.smithi177.stdout:2470 punch from 0x1ad74ab to 0x1add064, (0x5bb9 bytes) 2019-12-16T22:46:24.319 INFO:teuthology.orchestra.run.smithi177.stdout:2472 writesame 0x167c45f thru 0x1680e76 data_size 0x4(0x4a18 bytes) 2019-12-16T22:46:24.396 INFO:teuthology.orchestra.run.smithi177.stdout:3315 read 0x879f37 thru 0x885299 (0xb363 bytes) 2019-12-16T22:46:24.410 INFO:teuthology.orchestra.run.smithi177.stdout:3317 trunc from 0xc355f0d to 0xe71f898 2019-12-16T22:46:24.422 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xee20c9b 2019-12-16T22:46:24.444 INFO:teuthology.orchestra.run.smithi177.stdout:2475 trunc from 0x366961f to 0xee20c9b 2019-12-16T22:46:24.677 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:24.681 INFO:teuthology.orchestra.run.smithi177.stdout:2686 trunc from 0x1af452d to 0x3a15fcf 2019-12-16T22:46:24.768 INFO:teuthology.orchestra.run.smithi177.stdout:2477 read 0x4b82df2 thru 0x4b8ee90 (0xc09f bytes) 2019-12-16T22:46:24.769 INFO:teuthology.orchestra.run.smithi177.stdout:2478 writesame 0x28d3ef thru 0x297add data_size 0x7(0xa6ef bytes) 2019-12-16T22:46:24.810 INFO:teuthology.orchestra.run.smithi177.stdout:2687 write 0x36345cb thru 0x363afd1 (0x6a07 bytes) 2019-12-16T22:46:24.884 INFO:teuthology.orchestra.run.smithi177.stdout:2688 punch from 0x280d06e to 0x2813674, (0x6606 bytes) 2019-12-16T22:46:24.884 INFO:teuthology.orchestra.run.smithi177.stdout:2690 punch from 0x7fa4c3 to 0x801e14, (0x7951 bytes) 2019-12-16T22:46:24.884 INFO:teuthology.orchestra.run.smithi177.stdout:2691 punch from 0x25cda57 to 0x25ced4f, (0x12f8 bytes) 2019-12-16T22:46:24.889 INFO:teuthology.orchestra.run.smithi177.stdout:2480 read 0x7f89fbe thru 0x7f940ce (0xa111 bytes) 2019-12-16T22:46:24.891 INFO:teuthology.orchestra.run.smithi177.stdout:2481 read 0x4bf31ec thru 0x4bf5cf1 (0x2b06 bytes) 2019-12-16T22:46:24.891 INFO:teuthology.orchestra.run.smithi177.stdout:2482 writesame 0x3ba379 thru 0x3bc009 data_size 0x1(0x1c91 bytes) 2019-12-16T22:46:24.963 INFO:teuthology.orchestra.run.smithi177.stdout:2692 writesame 0xadc0470 thru 0xadc23d7 data_size 0x1e(0x1f68 bytes) 2019-12-16T22:46:24.968 INFO:teuthology.orchestra.run.smithi177.stdout:2694 punch from 0x3d4e55b to 0x3d5bac7, (0xd56c bytes) 2019-12-16T22:46:25.073 INFO:teuthology.orchestra.run.smithi177.stdout:2695 write 0xd514662 thru 0xd519c7f (0x561e bytes) 2019-12-16T22:46:25.224 INFO:teuthology.orchestra.run.smithi177.stdout:2696 read 0x41500e2 thru 0x415324c (0x316b bytes) 2019-12-16T22:46:25.224 INFO:teuthology.orchestra.run.smithi177.stdout:2697 read 0xc3a5735 thru 0xc3a95d7 (0x3ea3 bytes) 2019-12-16T22:46:25.224 INFO:teuthology.orchestra.run.smithi177.stdout:2698 read 0xafb89eb thru 0xafc22bb (0x98d1 bytes) 2019-12-16T22:46:25.225 INFO:teuthology.orchestra.run.smithi177.stdout:2701 punch from 0x7ebdd4f to 0x7ec68f4, (0x8ba5 bytes) 2019-12-16T22:46:25.225 INFO:teuthology.orchestra.run.smithi177.stdout:2702 read 0x6e3274d thru 0x6e3e1b5 (0xba69 bytes) 2019-12-16T22:46:25.225 INFO:teuthology.orchestra.run.smithi177.stdout:2703 read 0x275c1e8 thru 0x2768876 (0xc68f bytes) 2019-12-16T22:46:25.225 INFO:teuthology.orchestra.run.smithi177.stdout:2704 write 0x53c9fa2 thru 0x53d7c50 (0xdcaf bytes) 2019-12-16T22:46:25.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.250+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574683f1ed0 finish: resending after timeout 2019-12-16T22:46:25.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.250+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574677b62d0 finish: resending after timeout 2019-12-16T22:46:25.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.250+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574642cc1e0 finish: resending after timeout 2019-12-16T22:46:25.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.250+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557465273750 finish: resending after timeout 2019-12-16T22:46:25.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574628ddef0 finish: resending after timeout 2019-12-16T22:46:25.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574648f7570 finish: resending after timeout 2019-12-16T22:46:25.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574677b8d00 finish: resending after timeout 2019-12-16T22:46:25.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746798fb10 finish: resending after timeout 2019-12-16T22:46:25.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557465d5c5a0 finish: resending after timeout 2019-12-16T22:46:25.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557468c8cb20 finish: resending after timeout 2019-12-16T22:46:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557468c8ded0 finish: resending after timeout 2019-12-16T22:46:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746731cee0 finish: resending after timeout 2019-12-16T22:46:25.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557462a79570 finish: resending after timeout 2019-12-16T22:46:25.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746798cff0 finish: resending after timeout 2019-12-16T22:46:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574683ed1b0 finish: resending after timeout 2019-12-16T22:46:25.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557466e5e0f0 finish: resending after timeout 2019-12-16T22:46:25.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746731d0c0 finish: resending after timeout 2019-12-16T22:46:25.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.298+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557463d80940 finish: resending after timeout 2019-12-16T22:46:25.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:25.314+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557464ada1c0 finish: resending after timeout 2019-12-16T22:46:25.379 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:25.382 INFO:teuthology.orchestra.run.smithi177.stdout:2707 trunc from 0xd519c80 to 0xc59d650 2019-12-16T22:46:25.435 INFO:teuthology.orchestra.run.smithi177.stdout:2484 read 0x5d4a96 thru 0x5dc562 (0x7acd bytes) 2019-12-16T22:46:25.437 INFO:teuthology.orchestra.run.smithi177.stdout:2486 writesame 0xca2d0da thru 0xca2ffe2 data_size 0x1(0x2f09 bytes) 2019-12-16T22:46:25.462 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.2-clone22 2019-12-16T22:46:25.493 INFO:teuthology.orchestra.run.smithi177.stdout:2487 write 0xdb5ab19 thru 0xdb6a70b (0xfbf3 bytes) 2019-12-16T22:46:25.523 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:25.518+0000 7f884a7b2700 -1 reset not still connected to 0x56012dfffc20 2019-12-16T22:46:25.523 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:25.518+0000 7f8837bad700 -1 osd.0 pg_epoch: 86 pg[2.2( v 86'985 (0'0,86'985] local-lis/les=13/14 n=108 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [0,1] r=0 lpr=13 luod=86'984 crt=86'983 lcod 86'983 mlcod 86'983 active+clean ps=[d6~2,d9~3]] bad op order, already applied 76967 > this 76886 2019-12-16T22:46:25.523 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f8837bad700 time 2019-12-16T22:46:25.521082+0000 2019-12-16T22:46:25.523 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-16T22:46:25.524 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.524 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x560103561140] 2019-12-16T22:46:25.524 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.524 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.524 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.524 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.525 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.525 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.525 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.525 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.525 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.525 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.525 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:*** Caught signal (Aborted) ** 2019-12-16T22:46:25.526 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: in thread 7f8837bad700 thread_name:tp_osd_tp 2019-12-16T22:46:25.526 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:25.522+0000 7f8837bad700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f8837bad700 time 2019-12-16T22:46:25.521082+0000 2019-12-16T22:46:25.526 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-16T22:46:25.526 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.526 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.527 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x560103561140] 2019-12-16T22:46:25.527 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.527 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.527 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.527 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.527 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.527 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.528 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.528 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.528 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.528 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.528 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.529 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.529 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (()+0x12890) [0x7f885bb02890] 2019-12-16T22:46:25.529 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (gsignal()+0xc7) [0x7f885a7b4e97] 2019-12-16T22:46:25.529 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (abort()+0x141) [0x7f885a7b6801] 2019-12-16T22:46:25.529 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x560103561211] 2019-12-16T22:46:25.529 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.529 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.530 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.530 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.530 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.530 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.531 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.531 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.531 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 13: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.531 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 14: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.531 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:2019-12-16T22:46:25.530+0000 7f8837bad700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:46:25.532 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: in thread 7f8837bad700 thread_name:tp_osd_tp 2019-12-16T22:46:25.532 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.532 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.532 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (()+0x12890) [0x7f885bb02890] 2019-12-16T22:46:25.532 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (gsignal()+0xc7) [0x7f885a7b4e97] 2019-12-16T22:46:25.533 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (abort()+0x141) [0x7f885a7b6801] 2019-12-16T22:46:25.533 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x560103561211] 2019-12-16T22:46:25.533 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.533 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.533 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.533 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.533 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.534 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.534 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.534 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.534 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 13: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.534 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 14: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.534 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:46:25.534 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.545 INFO:teuthology.orchestra.run.smithi177.stdout:3318 trunc from 0xe71f898 to 0x16bfaf1 2019-12-16T22:46:25.551 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -4461> 2019-12-16T22:46:25.518+0000 7f884a7b2700 -1 reset not still connected to 0x56012dfffc20 2019-12-16T22:46:25.552 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -4454> 2019-12-16T22:46:25.518+0000 7f8837bad700 -1 osd.0 pg_epoch: 86 pg[2.2( v 86'985 (0'0,86'985] local-lis/les=13/14 n=108 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [0,1] r=0 lpr=13 luod=86'984 crt=86'983 lcod 86'983 mlcod 86'983 active+clean ps=[d6~2,d9~3]] bad op order, already applied 76967 > this 76886 2019-12-16T22:46:25.554 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -3263> 2019-12-16T22:46:25.522+0000 7f8837bad700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f8837bad700 time 2019-12-16T22:46:25.521082+0000 2019-12-16T22:46:25.554 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-16T22:46:25.554 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.554 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.554 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x560103561140] 2019-12-16T22:46:25.555 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.555 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.555 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.555 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.555 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.555 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.555 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.556 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.556 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.556 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.556 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.557 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -1774> 2019-12-16T22:46:25.530+0000 7f8837bad700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:46:25.557 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: in thread 7f8837bad700 thread_name:tp_osd_tp 2019-12-16T22:46:25.557 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.557 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.557 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (()+0x12890) [0x7f885bb02890] 2019-12-16T22:46:25.557 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (gsignal()+0xc7) [0x7f885a7b4e97] 2019-12-16T22:46:25.557 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (abort()+0x141) [0x7f885a7b6801] 2019-12-16T22:46:25.558 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x560103561211] 2019-12-16T22:46:25.558 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.558 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.558 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.558 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.559 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.559 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.559 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.559 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.559 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 13: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.559 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 14: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.560 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:46:25.560 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.566 INFO:teuthology.orchestra.run.smithi177.stdout:2708 read 0x9060b5 thru 0x90e634 (0x8580 bytes) 2019-12-16T22:46:25.576 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -9464> 2019-12-16T22:46:25.518+0000 7f884a7b2700 -1 reset not still connected to 0x56012dfffc20 2019-12-16T22:46:25.576 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -9457> 2019-12-16T22:46:25.518+0000 7f8837bad700 -1 osd.0 pg_epoch: 86 pg[2.2( v 86'985 (0'0,86'985] local-lis/les=13/14 n=108 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [0,1] r=0 lpr=13 luod=86'984 crt=86'983 lcod 86'983 mlcod 86'983 active+clean ps=[d6~2,d9~3]] bad op order, already applied 76967 > this 76886 2019-12-16T22:46:25.582 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -8266> 2019-12-16T22:46:25.522+0000 7f8837bad700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f8837bad700 time 2019-12-16T22:46:25.521082+0000 2019-12-16T22:46:25.582 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-16T22:46:25.582 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.583 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.583 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x560103561140] 2019-12-16T22:46:25.583 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.583 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.583 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.583 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.583 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.584 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.584 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.584 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.584 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.584 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.584 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:25.582+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc73520 2019-12-16T22:46:25.585 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: -6777> 2019-12-16T22:46:25.530+0000 7f8837bad700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:46:25.585 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: in thread 7f8837bad700 thread_name:tp_osd_tp 2019-12-16T22:46:25.585 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:25.586 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:25.586 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 1: (()+0x12890) [0x7f885bb02890] 2019-12-16T22:46:25.586 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2: (gsignal()+0xc7) [0x7f885a7b4e97] 2019-12-16T22:46:25.586 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 3: (abort()+0x141) [0x7f885a7b6801] 2019-12-16T22:46:25.586 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x560103561211] 2019-12-16T22:46:25.586 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x56010373d729] 2019-12-16T22:46:25.586 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x560103741660] 2019-12-16T22:46:25.587 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x56010374c761] 2019-12-16T22:46:25.587 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5601035d267b] 2019-12-16T22:46:25.587 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x56010382c817] 2019-12-16T22:46:25.587 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5601035eeb0c] 2019-12-16T22:46:25.587 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x560103c2e47c] 2019-12-16T22:46:25.587 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x560103c316d0] 2019-12-16T22:46:25.587 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 13: (()+0x76db) [0x7f885baf76db] 2019-12-16T22:46:25.588 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 14: (clone()+0x3f) [0x7f885a89788f] 2019-12-16T22:46:25.588 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:46:25.588 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr: 2019-12-16T22:46:28.028 INFO:teuthology.orchestra.run.smithi177.stdout:2711 write 0xe54517 thru 0xe61754 (0xd23e bytes) 2019-12-16T22:46:28.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:28.038+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574673de5a0 finish: resending after timeout 2019-12-16T22:46:28.063 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.115 INFO:teuthology.orchestra.run.smithi177.stdout:2488 trunc from 0xee20c9b to 0xa2a4da 2019-12-16T22:46:28.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:28.122+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574673dfb30 finish: resending after timeout 2019-12-16T22:46:28.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:28.142+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574673e1cf0 finish: resending after timeout 2019-12-16T22:46:28.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:28.170+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557466e771b0 finish: resending after timeout 2019-12-16T22:46:28.174 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.174 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.175 INFO:teuthology.orchestra.run.smithi177.stdout:3321 read 0xa64c34 thru 0xa6d036 (0x8403 bytes) 2019-12-16T22:46:28.175 INFO:teuthology.orchestra.run.smithi177.stdout:3322 punch from 0x117ca4d to 0x1181fde, (0x5591 bytes) 2019-12-16T22:46:28.237 INFO:teuthology.orchestra.run.smithi177.stdout:2383 write 0xdd49400 thru 0xdd54108 (0xad09 bytes) 2019-12-16T22:46:28.267 INFO:teuthology.orchestra.run.smithi177.stdout:3323 write 0xa8eeb17 thru 0xa8f3b48 (0x5032 bytes) 2019-12-16T22:46:28.271 INFO:teuthology.orchestra.run.smithi177.stdout:2712 write 0x1edfd0a thru 0x1ee59ed (0x5ce4 bytes) 2019-12-16T22:46:28.272 INFO:teuthology.orchestra.run.smithi177.stdout:2384 writesame 0xc2cade9 thru 0xc2cbcf5 data_size 0x1(0xf0d bytes) 2019-12-16T22:46:28.290 INFO:teuthology.orchestra.run.smithi177.stdout:3324 write 0x67ce1c9 thru 0x67d13a4 (0x31dc bytes) 2019-12-16T22:46:28.303 INFO:teuthology.orchestra.run.smithi177.stdout:2385 read 0xd6ea48f thru 0xd6ec920 (0x2492 bytes) 2019-12-16T22:46:28.304 INFO:teuthology.orchestra.run.smithi177.stdout:2713 read 0x37930c8 thru 0x3797f5c (0x4e95 bytes) 2019-12-16T22:46:28.304 INFO:teuthology.orchestra.run.smithi177.stdout:2714 read 0x8f11f0 thru 0x8f161f (0x430 bytes) 2019-12-16T22:46:28.305 INFO:teuthology.orchestra.run.smithi177.stdout:2386 write 0x4f2502f thru 0x4f2a583 (0x5555 bytes) 2019-12-16T22:46:28.308 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.308 INFO:teuthology.orchestra.run.smithi177.stdout:3326 read 0x18035f9 thru 0x18106da (0xd0e2 bytes) 2019-12-16T22:46:28.317 INFO:teuthology.orchestra.run.smithi177.stdout:3327 read 0x8a89c61 thru 0x8a989b0 (0xed50 bytes) 2019-12-16T22:46:28.328 INFO:teuthology.orchestra.run.smithi177.stdout:2715 trunc from 0xc59d650 to 0x1efb4b2 2019-12-16T22:46:28.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.386+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51a00 2019-12-16T22:46:28.479 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #21, image image_cluster1.client.mirror.2-clone21 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent22 2019-12-16T22:46:28.554 INFO:teuthology.orchestra.run.smithi177.stdout:3328 writesame 0xeaca0db thru 0xeacba5c data_size 0x5(0x1982 bytes) 2019-12-16T22:46:28.556 INFO:teuthology.orchestra.run.smithi177.stdout:3330 write 0xd8b9579 thru 0xd8bb1f5 (0x1c7d bytes) 2019-12-16T22:46:28.585 INFO:teuthology.orchestra.run.smithi177.stdout:2235 read 0x41d0da2 thru 0x41d91a3 (0x8402 bytes) 2019-12-16T22:46:28.587 INFO:teuthology.orchestra.run.smithi177.stdout:3331 punch from 0x91aa290 to 0x91b6864, (0xc5d4 bytes) 2019-12-16T22:46:28.587 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.587 INFO:teuthology.orchestra.run.smithi177.stdout:3334 read 0x80356a2 thru 0x803b185 (0x5ae4 bytes) 2019-12-16T22:46:28.590 INFO:teuthology.orchestra.run.smithi177.stdout:3335 read 0xa29c016 thru 0xa2a4ff0 (0x8fdb bytes) 2019-12-16T22:46:28.591 INFO:teuthology.orchestra.run.smithi177.stdout:3336 punch from 0xab9763d to 0xaba70f0, (0xfab3 bytes) 2019-12-16T22:46:28.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a3645047d0 2019-12-16T22:46:28.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a368b908a0 2019-12-16T22:46:28.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee8270 2019-12-16T22:46:28.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee95f0 2019-12-16T22:46:28.604 INFO:teuthology.orchestra.run.smithi177.stdout:3338 trunc from 0xeacba5d to 0x94e19d7 2019-12-16T22:46:28.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:46:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a36a9fba00 2019-12-16T22:46:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:46:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:46:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:46:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a36fd13930 2019-12-16T22:46:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:46:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:46:28.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:28.602+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51040 2019-12-16T22:46:28.628 INFO:teuthology.orchestra.run.smithi177.stdout:2237 write 0x6b33aaa thru 0x6b35837 (0x1d8e bytes) 2019-12-16T22:46:28.730 INFO:teuthology.orchestra.run.smithi177.stdout:2238 write 0xe98daff thru 0xe98edea (0x12ec bytes) 2019-12-16T22:46:28.741 INFO:teuthology.orchestra.run.smithi177.stdout:2240 read 0xcbb79c thru 0xcc6385 (0xabea bytes) 2019-12-16T22:46:28.741 INFO:teuthology.orchestra.run.smithi177.stdout:2241 read 0x1611b2a thru 0x161c635 (0xab0c bytes) 2019-12-16T22:46:28.757 INFO:teuthology.orchestra.run.smithi177.stdout:2489 write 0x367b3b1 thru 0x3680eb9 (0x5b09 bytes) 2019-12-16T22:46:28.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:28.758+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574673e0580 finish: resending after timeout 2019-12-16T22:46:28.762 INFO:teuthology.orchestra.run.smithi177.stdout:2242 trunc from 0xe98edeb to 0x5333456 2019-12-16T22:46:28.780 INFO:teuthology.orchestra.run.smithi177.stdout:3339 writesame 0x12e2fb8 thru 0x12e35f6 data_size 0x3(0x63f bytes) 2019-12-16T22:46:28.783 INFO:teuthology.orchestra.run.smithi177.stdout:2716 write 0xc84d993 thru 0xc84e06d (0x6db bytes) 2019-12-16T22:46:28.808 INFO:teuthology.orchestra.run.smithi177.stdout:3340 write 0x61e7c5 thru 0x62d834 (0xf070 bytes) 2019-12-16T22:46:28.825 INFO:teuthology.orchestra.run.smithi177.stdout:2490 punch from 0xf0f010 to 0xf1b305, (0xc2f5 bytes) 2019-12-16T22:46:28.825 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.834 INFO:teuthology.orchestra.run.smithi177.stdout:2493 trunc from 0x3680eba to 0x8265423 2019-12-16T22:46:28.862 INFO:teuthology.orchestra.run.smithi177.stdout:3341 punch from 0x29ad23b to 0x29b22d7, (0x509c bytes) 2019-12-16T22:46:28.862 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.862 INFO:teuthology.orchestra.run.smithi177.stdout:3345 punch from 0x203fd38 to 0x2044ba8, (0x4e70 bytes) 2019-12-16T22:46:28.862 INFO:teuthology.orchestra.run.smithi177.stdout:3346 read 0x34952cd thru 0x349d7b1 (0x84e5 bytes) 2019-12-16T22:46:28.863 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.867 INFO:teuthology.orchestra.run.smithi177.stdout:2717 write 0x7b94063 thru 0x7b9e46d (0xa40b bytes) 2019-12-16T22:46:28.871 INFO:teuthology.orchestra.run.smithi177.stdout:3348 trunc from 0x94e19d7 to 0x4d36e8e 2019-12-16T22:46:28.882 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:28.938 INFO:teuthology.orchestra.run.smithi177.stdout:2496 write 0xe3fc5a4 thru 0xe40304b (0x6aa8 bytes) 2019-12-16T22:46:28.962 INFO:teuthology.orchestra.run.smithi177.stdout:2243 write 0xe61185a thru 0xe61f00b (0xd7b2 bytes) 2019-12-16T22:46:28.973 INFO:teuthology.orchestra.run.smithi177.stdout:2498 read 0x6392159 thru 0x639b2fb (0x91a3 bytes) 2019-12-16T22:46:28.973 INFO:teuthology.orchestra.run.smithi177.stdout:2499 read 0x2b63d9 thru 0x2b7ef4 (0x1b1c bytes) 2019-12-16T22:46:28.974 INFO:teuthology.orchestra.run.smithi177.stdout:2500 read 0x300d16d thru 0x301c59e (0xf432 bytes) 2019-12-16T22:46:28.974 INFO:teuthology.orchestra.run.smithi177.stdout:2501 read 0x15202b1 thru 0x1521215 (0xf65 bytes) 2019-12-16T22:46:28.980 INFO:teuthology.orchestra.run.smithi177.stdout:2718 write 0x8728d68 thru 0x87306c5 (0x795e bytes) 2019-12-16T22:46:28.991 INFO:teuthology.orchestra.run.smithi177.stdout:2503 trunc from 0xe40304c to 0x4874965 2019-12-16T22:46:29.024 INFO:teuthology.orchestra.run.smithi177.stdout:2245 read 0x854bb20 thru 0x854e2f6 (0x27d7 bytes) 2019-12-16T22:46:29.024 INFO:teuthology.orchestra.run.smithi177.stdout:2246 write 0x19edfb0 thru 0x19f816c (0xa1bd bytes) 2019-12-16T22:46:29.040 INFO:teuthology.orchestra.run.smithi177.stdout:2249 writesame 0x5340f5d thru 0x53507f5 data_size 0x1(0xf899 bytes) 2019-12-16T22:46:29.049 INFO:teuthology.orchestra.run.smithi177.stdout:2720 punch from 0x35c97a7 to 0x35cd91e, (0x4177 bytes) 2019-12-16T22:46:29.050 INFO:teuthology.orchestra.run.smithi177.stdout:2721 read 0x1091f0b thru 0x109d04e (0xb144 bytes) 2019-12-16T22:46:29.050 INFO:teuthology.orchestra.run.smithi177.stdout:2722 write 0x327da31 thru 0x32868e0 (0x8eb0 bytes) 2019-12-16T22:46:29.114 INFO:teuthology.orchestra.run.smithi177.stdout:2724 write 0x53aa292 thru 0x53adbe3 (0x3952 bytes) 2019-12-16T22:46:29.132 INFO:teuthology.orchestra.run.smithi177.stdout:2250 write 0xe058d2 thru 0xe0cd22 (0x7451 bytes) 2019-12-16T22:46:29.147 INFO:teuthology.orchestra.run.smithi177.stdout:2252 read 0x7f3660f thru 0x7f366b6 (0xa8 bytes) 2019-12-16T22:46:29.155 INFO:teuthology.orchestra.run.smithi177.stdout:2727 punch from 0x6b64169 to 0x6b72f9f, (0xee36 bytes) 2019-12-16T22:46:29.155 INFO:teuthology.orchestra.run.smithi177.stdout:2728 punch from 0x8e56467 to 0x8e661cf, (0xfd68 bytes) 2019-12-16T22:46:29.155 INFO:teuthology.orchestra.run.smithi177.stdout:2729 writesame 0x8f0311b thru 0x8f0b2ea data_size 0x1f(0x81d0 bytes) 2019-12-16T22:46:29.157 INFO:teuthology.orchestra.run.smithi177.stdout:3349 write 0x86e20bf thru 0x86ef397 (0xd2d9 bytes) 2019-12-16T22:46:29.162 INFO:teuthology.orchestra.run.smithi177.stdout:2253 trunc from 0xe61f00c to 0x7381ea2 2019-12-16T22:46:29.173 INFO:teuthology.orchestra.run.smithi177.stdout:2504 punch from 0x2f62628 to 0x2f6299c, (0x374 bytes) 2019-12-16T22:46:29.173 INFO:teuthology.orchestra.run.smithi177.stdout:2730 write 0x1e391ff thru 0x1e3c52d (0x332f bytes) 2019-12-16T22:46:29.192 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:29.193 INFO:teuthology.orchestra.run.smithi177.stdout:3351 write 0x1b15c48 thru 0x1b182e9 (0x26a2 bytes) 2019-12-16T22:46:29.207 INFO:teuthology.orchestra.run.smithi177.stdout:2254 read 0x616df43 thru 0x617af40 (0xcffe bytes) 2019-12-16T22:46:29.208 INFO:teuthology.orchestra.run.smithi177.stdout:2256 punch from 0x3067598 to 0x3067742, (0x1aa bytes) 2019-12-16T22:46:29.208 INFO:teuthology.orchestra.run.smithi177.stdout:2257 punch from 0xb22422 to 0xb2bcff, (0x98dd bytes) 2019-12-16T22:46:29.208 INFO:teuthology.orchestra.run.smithi177.stdout:2258 read 0x5e4e820 thru 0x5e5b0c4 (0xc8a5 bytes) 2019-12-16T22:46:29.238 INFO:teuthology.orchestra.run.smithi177.stdout:2259 write 0xccbd93f thru 0xccc385c (0x5f1e bytes) 2019-12-16T22:46:29.245 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:29.246 INFO:teuthology.orchestra.run.smithi177.stdout:2261 writesame 0x9711650 thru 0x971ba34 data_size 0x1(0xa3e5 bytes) 2019-12-16T22:46:29.267 INFO:teuthology.orchestra.run.smithi177.stdout:2263 read 0x1f7a0c5 thru 0x1f88c41 (0xeb7d bytes) 2019-12-16T22:46:29.349 INFO:teuthology.orchestra.run.smithi177.stdout:2249 punch from 0x565b301 to 0x565f5ba, (0x42b9 bytes) 2019-12-16T22:46:29.564 INFO:teuthology.orchestra.run.smithi177.stdout:2264 punch from 0x1b9624e to 0x1b97bd2, (0x1984 bytes) 2019-12-16T22:46:29.564 INFO:teuthology.orchestra.run.smithi177.stdout:2266 writesame 0x3201f0d thru 0x320d115 data_size 0x11(0xb209 bytes) 2019-12-16T22:46:29.564 INFO:tasks.ceph.cluster1.osd.0.smithi106.stderr:daemon-helper: command crashed with signal 6 2019-12-16T22:46:29.568 INFO:teuthology.orchestra.run.smithi177.stdout:2731 read 0x26eca74 thru 0x26ef95a (0x2ee7 bytes) 2019-12-16T22:46:29.574 INFO:teuthology.orchestra.run.smithi177.stdout:2732 trunc from 0xc84e06e to 0xe1167e4 2019-12-16T22:46:29.577 INFO:teuthology.orchestra.run.smithi177.stdout:2267 trunc from 0xccc385d to 0xadde1de 2019-12-16T22:46:29.591 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.586+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a5b0 2019-12-16T22:46:29.592 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.586+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a8f0 2019-12-16T22:46:29.597 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.594+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdede10 2019-12-16T22:46:29.598 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.594+0000 7f85ca542700 -1 reset not still connected to 0x559a12ba1cf0 2019-12-16T22:46:29.601 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.598+0000 7f85ca542700 -1 reset not still connected to 0x559a150c84e0 2019-12-16T22:46:29.601 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.598+0000 7f85ca542700 -1 reset not still connected to 0x559a182b89c0 2019-12-16T22:46:29.602 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.598+0000 7f85ca542700 -1 reset not still connected to 0x559a182ba080 2019-12-16T22:46:29.602 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.598+0000 7f85ca542700 -1 reset not still connected to 0x559a196ad110 2019-12-16T22:46:29.602 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.598+0000 7f85ca542700 -1 reset not still connected to 0x559a196aebe0 2019-12-16T22:46:29.606 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a197b6750 2019-12-16T22:46:29.607 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e5b0 2019-12-16T22:46:29.607 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:29.608 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9450 2019-12-16T22:46:29.608 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9d40 2019-12-16T22:46:29.608 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:29.608 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:29.608 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:29.609 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1e5c6b10 2019-12-16T22:46:29.609 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fb520 2019-12-16T22:46:29.610 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:29.610 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:29.610 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a24378750 2019-12-16T22:46:29.610 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a24379110 2019-12-16T22:46:29.610 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a2437be90 2019-12-16T22:46:29.610 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a249dc630 2019-12-16T22:46:29.610 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.606+0000 7f85ca542700 -1 reset not still connected to 0x559a2686ac30 2019-12-16T22:46:29.613 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a2686be10 2019-12-16T22:46:29.613 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:29.613 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:29.613 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0aa57110 2019-12-16T22:46:29.613 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0b442150 2019-12-16T22:46:29.613 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0bbbe680 2019-12-16T22:46:29.614 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0e045670 2019-12-16T22:46:29.614 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0eebb810 2019-12-16T22:46:29.614 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a5b0 2019-12-16T22:46:29.614 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a8f0 2019-12-16T22:46:29.614 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55b790 2019-12-16T22:46:29.614 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55c700 2019-12-16T22:46:29.614 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdede10 2019-12-16T22:46:29.615 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a150c84e0 2019-12-16T22:46:29.615 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a182b89c0 2019-12-16T22:46:29.615 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a182ba080 2019-12-16T22:46:29.615 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a196ad110 2019-12-16T22:46:29.615 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a196aebe0 2019-12-16T22:46:29.615 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:29.615 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9450 2019-12-16T22:46:29.616 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9d40 2019-12-16T22:46:29.616 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:29.616 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:29.616 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:29.616 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fb520 2019-12-16T22:46:29.616 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:29.616 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:29.617 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a24378750 2019-12-16T22:46:29.617 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a24379110 2019-12-16T22:46:29.617 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a2437be90 2019-12-16T22:46:29.617 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a249dc630 2019-12-16T22:46:29.617 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a2686be10 2019-12-16T22:46:29.618 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:29.618 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:29.610+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:29.618 INFO:teuthology.orchestra.run.smithi177.stdout:2506 write 0x75368e8 thru 0x75462f8 (0xfa11 bytes) 2019-12-16T22:46:29.621 INFO:teuthology.orchestra.run.smithi177.stdout:2733 read 0x8e5ed96 thru 0x8e6d465 (0xe6d0 bytes) 2019-12-16T22:46:29.622 INFO:teuthology.orchestra.run.smithi177.stdout:2734 read 0x6e15999 thru 0x6e24aab (0xf113 bytes) 2019-12-16T22:46:29.622 INFO:teuthology.orchestra.run.smithi177.stdout:2269 write 0x7e402d0 thru 0x7e41a84 (0x17b5 bytes) 2019-12-16T22:46:29.629 INFO:teuthology.orchestra.run.smithi177.stdout:2270 read 0x55c3b6b thru 0x55c983c (0x5cd2 bytes) 2019-12-16T22:46:29.649 INFO:teuthology.orchestra.run.smithi177.stdout:2735 trunc from 0xe1167e4 to 0x339a29e 2019-12-16T22:46:29.653 INFO:teuthology.orchestra.run.smithi177.stdout:2271 trunc from 0xadde1de to 0x21894b7 2019-12-16T22:46:29.653 INFO:teuthology.orchestra.run.smithi177.stdout:2250 write 0xce32153 thru 0xce35091 (0x2f3f bytes) 2019-12-16T22:46:29.665 INFO:teuthology.orchestra.run.smithi177.stdout:2507 write 0x2cc4861 thru 0x2cd0175 (0xb915 bytes) 2019-12-16T22:46:29.672 INFO:teuthology.orchestra.run.smithi177.stdout:2251 writesame 0x984548a thru 0x984e06a data_size 0x1(0x8be1 bytes) 2019-12-16T22:46:29.704 INFO:teuthology.orchestra.run.smithi177.stdout:2252 punch from 0x9d25687 to 0x9d2b98c, (0x6305 bytes) 2019-12-16T22:46:29.704 INFO:teuthology.orchestra.run.smithi177.stdout:2253 write 0x199c2dc thru 0x19a3b97 (0x78bc bytes) 2019-12-16T22:46:30.088 INFO:teuthology.orchestra.run.smithi177.stdout:2255 writesame 0x64b3a09 thru 0x64c1022 data_size 0xcb(0xd61a bytes) 2019-12-16T22:46:30.089 INFO:teuthology.orchestra.run.smithi177.stdout:2508 read 0x1c75f1d thru 0x1c83585 (0xd669 bytes) 2019-12-16T22:46:30.089 INFO:teuthology.orchestra.run.smithi177.stdout:2510 read 0x6aa0d21 thru 0x6aa892a (0x7c0a bytes) 2019-12-16T22:46:30.090 INFO:teuthology.orchestra.run.smithi177.stdout:2511 trunc from 0x75462f9 to 0x6ef1b2b 2019-12-16T22:46:30.105 INFO:teuthology.orchestra.run.smithi177.stdout:2388 read 0x2d9fef6 thru 0x2da1be1 (0x1cec bytes) 2019-12-16T22:46:30.108 INFO:teuthology.orchestra.run.smithi177.stdout:2389 read 0x355c54c thru 0x356a2ac (0xdd61 bytes) 2019-12-16T22:46:30.113 INFO:teuthology.orchestra.run.smithi177.stdout:2736 read 0x2e7de65 thru 0x2e81171 (0x330d bytes) 2019-12-16T22:46:30.113 INFO:teuthology.orchestra.run.smithi177.stdout:2738 read 0x51b282 thru 0x51d2d5 (0x2054 bytes) 2019-12-16T22:46:30.114 INFO:teuthology.orchestra.run.smithi177.stdout:2390 punch from 0x6f8bd4c to 0x6f917ba, (0x5a6e bytes) 2019-12-16T22:46:30.114 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.114 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.120 INFO:teuthology.orchestra.run.smithi177.stdout:2394 trunc from 0xdd54109 to 0xc4a0e65 2019-12-16T22:46:30.120 INFO:teuthology.orchestra.run.smithi177.stdout:2272 read 0x1aaf786 thru 0x1ab59ef (0x626a bytes) 2019-12-16T22:46:30.121 INFO:teuthology.orchestra.run.smithi177.stdout:2273 read 0x13e449e thru 0x13e7b25 (0x3688 bytes) 2019-12-16T22:46:30.123 INFO:teuthology.orchestra.run.smithi177.stdout:2274 read 0xf0c711 thru 0xf135f1 (0x6ee1 bytes) 2019-12-16T22:46:30.123 INFO:teuthology.orchestra.run.smithi177.stdout:2275 read 0x1c8d9be thru 0x1c8db39 (0x17c bytes) 2019-12-16T22:46:30.124 INFO:teuthology.orchestra.run.smithi177.stdout:2277 read 0x30ac1b thru 0x31abea (0xffd0 bytes) 2019-12-16T22:46:30.125 INFO:teuthology.orchestra.run.smithi177.stdout:2256 write 0xa8a3d94 thru 0xa8a478f (0x9fc bytes) 2019-12-16T22:46:30.141 INFO:teuthology.orchestra.run.smithi177.stdout:2257 read 0xc6a432a thru 0xc6aabf0 (0x68c7 bytes) 2019-12-16T22:46:30.148 INFO:teuthology.orchestra.run.smithi177.stdout:2740 writesame 0x82540c3 thru 0x8257206 data_size 0x6(0x3144 bytes) 2019-12-16T22:46:30.149 INFO:teuthology.orchestra.run.smithi177.stdout:2395 read 0x86a6c92 thru 0x86b004d (0x93bc bytes) 2019-12-16T22:46:30.150 INFO:teuthology.orchestra.run.smithi177.stdout:2742 write 0x9c2d00 thru 0x9cb2c8 (0x85c9 bytes) 2019-12-16T22:46:30.152 INFO:teuthology.orchestra.run.smithi177.stdout:2278 write 0x6f8881c thru 0x6f92acd (0xa2b2 bytes) 2019-12-16T22:46:30.173 INFO:teuthology.orchestra.run.smithi177.stdout:2512 writesame 0x8a8ef43 thru 0x8a9160a data_size 0x22(0x26c8 bytes) 2019-12-16T22:46:30.179 INFO:teuthology.orchestra.run.smithi177.stdout:2513 write 0x5ef1cf3 thru 0x5efb011 (0x931f bytes) 2019-12-16T22:46:30.182 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.182 INFO:teuthology.orchestra.run.smithi177.stdout:2281 read 0x50506f9 thru 0x505ee20 (0xe728 bytes) 2019-12-16T22:46:30.199 INFO:teuthology.orchestra.run.smithi177.stdout:2258 write 0xee1446a thru 0xee1ee95 (0xaa2c bytes) 2019-12-16T22:46:30.212 INFO:teuthology.orchestra.run.smithi177.stdout:2397 write 0xcb38360 thru 0xcb3851c (0x1bd bytes) 2019-12-16T22:46:30.216 INFO:teuthology.orchestra.run.smithi177.stdout:2515 read 0xbdb6aa thru 0xbe3453 (0x7daa bytes) 2019-12-16T22:46:30.217 INFO:teuthology.orchestra.run.smithi177.stdout:2516 read 0x80760d9 thru 0x807d4d0 (0x73f8 bytes) 2019-12-16T22:46:30.217 INFO:teuthology.orchestra.run.smithi177.stdout:2517 write 0x159dfae thru 0x15a0485 (0x24d8 bytes) 2019-12-16T22:46:30.223 INFO:teuthology.orchestra.run.smithi177.stdout:2259 read 0xdb54b32 thru 0xdb55a73 (0xf42 bytes) 2019-12-16T22:46:30.223 INFO:teuthology.orchestra.run.smithi177.stdout:2260 write 0x372bce2 thru 0x372e1bd (0x24dc bytes) 2019-12-16T22:46:30.224 INFO:teuthology.orchestra.run.smithi177.stdout:2284 write 0xc149c3d thru 0xc156d5c (0xd120 bytes) 2019-12-16T22:46:30.226 INFO:teuthology.orchestra.run.smithi177.stdout:2400 writesame 0x21b420e thru 0x21c04ed data_size 0x10(0xc2e0 bytes) 2019-12-16T22:46:30.239 INFO:teuthology.orchestra.run.smithi177.stdout:2743 read 0x7ce41c9 thru 0x7cedac5 (0x98fd bytes) 2019-12-16T22:46:30.239 INFO:teuthology.orchestra.run.smithi177.stdout:2745 read 0x8006efc thru 0x8011f1c (0xb021 bytes) 2019-12-16T22:46:30.240 INFO:teuthology.orchestra.run.smithi177.stdout:2746 write 0x58e65b2 thru 0x58ee012 (0x7a61 bytes) 2019-12-16T22:46:30.242 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.242 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.246 INFO:teuthology.orchestra.run.smithi177.stdout:2520 trunc from 0x8a9160b to 0x6fae3b9 2019-12-16T22:46:30.250 INFO:teuthology.orchestra.run.smithi177.stdout:2747 read 0x7b818c7 thru 0x7b8396b (0x20a5 bytes) 2019-12-16T22:46:30.251 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:30.250+0000 7f85ca542700 -1 reset not still connected to 0x559a0fded380 2019-12-16T22:46:30.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574648f7570 finish: resending after timeout 2019-12-16T22:46:30.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574677b8d00 finish: resending after timeout 2019-12-16T22:46:30.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746798fb10 finish: resending after timeout 2019-12-16T22:46:30.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.254+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557465d5c5a0 finish: resending after timeout 2019-12-16T22:46:30.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557468c8cb20 finish: resending after timeout 2019-12-16T22:46:30.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557468c8ded0 finish: resending after timeout 2019-12-16T22:46:30.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746731cee0 finish: resending after timeout 2019-12-16T22:46:30.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557462a79570 finish: resending after timeout 2019-12-16T22:46:30.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746798cff0 finish: resending after timeout 2019-12-16T22:46:30.261 INFO:teuthology.orchestra.run.smithi177.stdout:2748 trunc from 0x8257207 to 0x3eae8f2 2019-12-16T22:46:30.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x5574683ed1b0 finish: resending after timeout 2019-12-16T22:46:30.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557466e5e0f0 finish: resending after timeout 2019-12-16T22:46:30.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.258+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746731d0c0 finish: resending after timeout 2019-12-16T22:46:30.268 INFO:teuthology.orchestra.run.smithi177.stdout:2286 write 0xc97cfd7 thru 0xc97f018 (0x2042 bytes) 2019-12-16T22:46:30.272 INFO:teuthology.orchestra.run.smithi177.stdout:2521 punch from 0x15a9fec to 0x15b88e7, (0xe8fb bytes) 2019-12-16T22:46:30.274 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.275 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.275 INFO:teuthology.orchestra.run.smithi177.stdout:2290 writesame 0x51a1466 thru 0x51a8974 data_size 0x7(0x750f bytes) 2019-12-16T22:46:30.287 INFO:teuthology.orchestra.run.smithi177.stdout:2262 trunc from 0xee1ee96 to 0x8406b44 2019-12-16T22:46:30.294 INFO:teuthology.orchestra.run.smithi177.stdout:2291 write 0x5d2cc37 thru 0x5d2f208 (0x25d2 bytes) 2019-12-16T22:46:30.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.298+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557463d80940 finish: resending after timeout 2019-12-16T22:46:30.302 INFO:teuthology.orchestra.run.smithi177.stdout:2292 read 0x1bbc846 thru 0x1bc1c31 (0x53ec bytes) 2019-12-16T22:46:30.303 INFO:teuthology.orchestra.run.smithi177.stdout:2293 writesame 0x54a5457 thru 0x54aa5f4 data_size 0x2(0x519e bytes) 2019-12-16T22:46:30.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:30.314+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557464ada1c0 finish: resending after timeout 2019-12-16T22:46:30.329 INFO:teuthology.orchestra.run.smithi177.stdout:2522 writesame 0xe502fc6 thru 0xe506c6a data_size 0x4b(0x3ca5 bytes) 2019-12-16T22:46:30.336 INFO:teuthology.orchestra.run.smithi177.stdout:2524 writesame 0x7bff50f thru 0x7c08038 data_size 0x2(0x8b2a bytes) 2019-12-16T22:46:30.407 INFO:teuthology.orchestra.run.smithi177.stdout:2294 writesame 0xd639d87 thru 0xd6478db data_size 0x1(0xdb55 bytes) 2019-12-16T22:46:30.413 INFO:teuthology.orchestra.run.smithi177.stdout:2295 write 0x7176390 thru 0x717bea7 (0x5b18 bytes) 2019-12-16T22:46:30.431 INFO:teuthology.orchestra.run.smithi177.stdout:2528 read 0x846e567 thru 0x84735f4 (0x508e bytes) 2019-12-16T22:46:30.431 INFO:teuthology.orchestra.run.smithi177.stdout:2531 punch from 0xd21d29f to 0xd229757, (0xc4b8 bytes) 2019-12-16T22:46:30.431 INFO:teuthology.orchestra.run.smithi177.stdout:2297 read 0x2636f55 thru 0x2644905 (0xd9b1 bytes) 2019-12-16T22:46:30.432 INFO:teuthology.orchestra.run.smithi177.stdout:2532 writesame 0x8b389a2 thru 0x8b3d5aa data_size 0x1(0x4c09 bytes) 2019-12-16T22:46:30.450 INFO:teuthology.orchestra.run.smithi177.stdout:2298 trunc from 0xd6478dc to 0x3c46d97 2019-12-16T22:46:30.464 INFO:teuthology.orchestra.run.smithi177.stdout:2751 read 0x2c2717d thru 0x2c3653c (0xf3c0 bytes) 2019-12-16T22:46:30.465 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.465 INFO:teuthology.orchestra.run.smithi177.stdout:2754 punch from 0x4ae50f to 0x4af9fb, (0x14ec bytes) 2019-12-16T22:46:30.465 INFO:teuthology.orchestra.run.smithi177.stdout:2757 writesame 0x3309f51 thru 0x3314374 data_size 0x16(0xa424 bytes) 2019-12-16T22:46:30.483 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.483 INFO:teuthology.orchestra.run.smithi177.stdout:2536 write 0x306bd85 thru 0x3077cf1 (0xbf6d bytes) 2019-12-16T22:46:30.497 INFO:teuthology.orchestra.run.smithi177.stdout:2758 read 0x1f798f6 thru 0x1f7f8ca (0x5fd5 bytes) 2019-12-16T22:46:30.501 INFO:teuthology.orchestra.run.smithi177.stdout:2265 write 0xf6ff29 thru 0xf7e051 (0xe129 bytes) 2019-12-16T22:46:30.531 INFO:teuthology.orchestra.run.smithi177.stdout:2537 write 0x9412c1c thru 0x941d33d (0xa722 bytes) 2019-12-16T22:46:30.537 INFO:teuthology.orchestra.run.smithi177.stdout:2299 read 0x1927668 thru 0x19309df (0x9378 bytes) 2019-12-16T22:46:30.538 INFO:teuthology.orchestra.run.smithi177.stdout:2301 punch from 0x4dfc53 to 0x4eef47, (0xf2f4 bytes) 2019-12-16T22:46:30.538 INFO:teuthology.orchestra.run.smithi177.stdout:2303 read 0x33488a5 thru 0x334b9b7 (0x3113 bytes) 2019-12-16T22:46:30.539 INFO:teuthology.orchestra.run.smithi177.stdout:2304 writesame 0x34bff27 thru 0x34cca9f data_size 0x3(0xcb79 bytes) 2019-12-16T22:46:30.556 INFO:teuthology.orchestra.run.smithi177.stdout:2305 read 0x2c71f9d thru 0x2c7b4b1 (0x9515 bytes) 2019-12-16T22:46:30.569 INFO:teuthology.orchestra.run.smithi177.stdout:2538 writesame 0x8953d5b thru 0x89595df data_size 0x1f(0x5885 bytes) 2019-12-16T22:46:30.570 INFO:teuthology.orchestra.run.smithi177.stdout:2306 trunc from 0x3c46d97 to 0x88036c5 2019-12-16T22:46:30.582 INFO:teuthology.orchestra.run.smithi177.stdout:2759 write 0xb5854cd thru 0xb586e97 (0x19cb bytes) 2019-12-16T22:46:30.596 INFO:teuthology.orchestra.run.smithi177.stdout:2307 read 0x2a72f46 thru 0x2a7b810 (0x88cb bytes) 2019-12-16T22:46:30.597 INFO:teuthology.orchestra.run.smithi177.stdout:2309 read 0x23eb049 thru 0x23ee53d (0x34f5 bytes) 2019-12-16T22:46:30.598 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.598 INFO:teuthology.orchestra.run.smithi177.stdout:2313 clone 24 order 18 su 2048 sc 14 2019-12-16T22:46:30.601 INFO:teuthology.orchestra.run.smithi177.stdout:2760 write 0xa9a3925 thru 0xa9aae11 (0x74ed bytes) 2019-12-16T22:46:30.603 INFO:teuthology.orchestra.run.smithi177.stdout:2539 writesame 0x6b05be thru 0x6b221d data_size 0x10(0x1c60 bytes) 2019-12-16T22:46:30.612 INFO:teuthology.orchestra.run.smithi177.stdout:2762 read 0x782f1a3 thru 0x783cbe8 (0xda46 bytes) 2019-12-16T22:46:30.612 INFO:teuthology.orchestra.run.smithi177.stdout:2763 read 0x3782d2 thru 0x38053a (0x8269 bytes) 2019-12-16T22:46:30.613 INFO:teuthology.orchestra.run.smithi177.stdout:2540 write 0x66c0201 thru 0x66cf555 (0xf355 bytes) 2019-12-16T22:46:30.621 INFO:teuthology.orchestra.run.smithi177.stdout:2764 writesame 0x3974cff thru 0x3975697 data_size 0x15(0x999 bytes) 2019-12-16T22:46:30.645 INFO:teuthology.orchestra.run.smithi177.stdout:2765 write 0x1515b5f thru 0x151c51c (0x69be bytes) 2019-12-16T22:46:30.709 INFO:teuthology.orchestra.run.smithi177.stdout:2766 read 0x93ead1b thru 0x93f24c2 (0x77a8 bytes) 2019-12-16T22:46:30.709 INFO:teuthology.orchestra.run.smithi177.stdout:2767 punch from 0x7dd3a7b to 0x7dd4487, (0xa0c bytes) 2019-12-16T22:46:30.709 INFO:teuthology.orchestra.run.smithi177.stdout:2768 write 0x2252db9 thru 0x225d701 (0xa949 bytes) 2019-12-16T22:46:30.715 INFO:teuthology.orchestra.run.smithi177.stdout:2266 write 0xb9f710e thru 0xb9f96cf (0x25c2 bytes) 2019-12-16T22:46:30.740 INFO:teuthology.orchestra.run.smithi177.stdout:2769 write 0x87d5275 thru 0x87d6402 (0x118e bytes) 2019-12-16T22:46:30.760 INFO:teuthology.orchestra.run.smithi177.stdout:2542 trunc from 0xe506c6b to 0x6868646 2019-12-16T22:46:30.769 INFO:teuthology.orchestra.run.smithi177.stdout:2267 trunc from 0xb9f96d0 to 0x3716ae0 2019-12-16T22:46:30.830 INFO:teuthology.orchestra.run.smithi177.stdout:2543 read 0x2d4d429 thru 0x2d5124b (0x3e23 bytes) 2019-12-16T22:46:30.844 INFO:teuthology.orchestra.run.smithi177.stdout:2544 trunc from 0x6868646 to 0xbd720f8 2019-12-16T22:46:30.867 INFO:teuthology.orchestra.run.smithi177.stdout:2770 writesame 0xc099ff7 thru 0xc0a79e6 data_size 0x16(0xd9f0 bytes) 2019-12-16T22:46:30.877 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:30.877 INFO:teuthology.orchestra.run.smithi177.stdout:2547 read 0x1a07733 thru 0x1a0da23 (0x62f1 bytes) 2019-12-16T22:46:30.877 INFO:teuthology.orchestra.run.smithi177.stdout:2548 writesame 0x499ddb5 thru 0x499f2cf data_size 0x1(0x151b bytes) 2019-12-16T22:46:30.894 INFO:teuthology.orchestra.run.smithi177.stdout:2550 writesame 0x8822001 thru 0x882ba2c data_size 0x8f(0x9a2c bytes) 2019-12-16T22:46:30.913 INFO:teuthology.orchestra.run.smithi177.stdout:2551 punch from 0xa953d9b to 0xa9634ed, (0xf752 bytes) 2019-12-16T22:46:30.913 INFO:teuthology.orchestra.run.smithi177.stdout:2553 read 0x2811ec6 thru 0x281cf64 (0xb09f bytes) 2019-12-16T22:46:30.931 INFO:teuthology.orchestra.run.smithi177.stdout:2554 trunc from 0xbd720f8 to 0x284de6e 2019-12-16T22:46:30.970 INFO:teuthology.orchestra.run.smithi177.stdout:2771 writesame 0xda48417 thru 0xda52448 data_size 0xf(0xa032 bytes) 2019-12-16T22:46:30.973 INFO:teuthology.orchestra.run.smithi177.stdout:2772 read 0xcc87efd thru 0xcc8b08a (0x318e bytes) 2019-12-16T22:46:30.974 INFO:teuthology.orchestra.run.smithi177.stdout:2773 read 0xaca4832 thru 0xacac1c8 (0x7997 bytes) 2019-12-16T22:46:30.974 INFO:teuthology.orchestra.run.smithi177.stdout:2774 punch from 0x58cf852 to 0x58d1aad, (0x225b bytes) 2019-12-16T22:46:30.989 INFO:teuthology.orchestra.run.smithi177.stdout:2775 trunc from 0xda52449 to 0x4e766d2 2019-12-16T22:46:30.990 INFO:teuthology.orchestra.run.smithi177.stdout:2555 read 0x22b25aa thru 0x22ba3de (0x7e35 bytes) 2019-12-16T22:46:31.040 INFO:teuthology.orchestra.run.smithi177.stdout:3352 write 0x4347d47 thru 0x4356b12 (0xedcc bytes) 2019-12-16T22:46:31.044 INFO:teuthology.orchestra.run.smithi177.stdout:2556 writesame 0xaa66c32 thru 0xaa7279b data_size 0x2(0xbb6a bytes) 2019-12-16T22:46:31.047 INFO:teuthology.orchestra.run.smithi177.stdout:2558 write 0xd56dde thru 0xd59ffb (0x321e bytes) 2019-12-16T22:46:31.065 INFO:teuthology.orchestra.run.smithi177.stdout:3353 read 0x64e9f50 thru 0x64f5e5f (0xbf10 bytes) 2019-12-16T22:46:31.065 INFO:teuthology.orchestra.run.smithi177.stdout:3355 read 0x62f4e30 thru 0x62fedc6 (0x9f97 bytes) 2019-12-16T22:46:31.065 INFO:teuthology.orchestra.run.smithi177.stdout:3356 write 0x51e34f2 thru 0x51e4cae (0x17bd bytes) 2019-12-16T22:46:31.067 INFO:teuthology.orchestra.run.smithi177.stdout:2559 write 0x8202fdd thru 0x8204531 (0x1555 bytes) 2019-12-16T22:46:31.070 INFO:teuthology.orchestra.run.smithi177.stdout:3358 write 0x19cbbce thru 0x19cc345 (0x778 bytes) 2019-12-16T22:46:31.085 INFO:teuthology.orchestra.run.smithi177.stdout:2560 punch from 0x6a50727 to 0x6a5a37c, (0x9c55 bytes) 2019-12-16T22:46:31.085 INFO:teuthology.orchestra.run.smithi177.stdout:2562 punch from 0x1ae898c to 0x1aea008, (0x167c bytes) 2019-12-16T22:46:31.088 INFO:teuthology.orchestra.run.smithi177.stdout:3359 trunc from 0x86ef398 to 0x625c09b 2019-12-16T22:46:31.128 INFO:teuthology.orchestra.run.smithi177.stdout:2564 write 0xae45292 thru 0xae52a13 (0xd782 bytes) 2019-12-16T22:46:31.129 INFO:teuthology.orchestra.run.smithi177.stdout:2778 writesame 0x617d940 thru 0x618c8f7 data_size 0xc(0xefb8 bytes) 2019-12-16T22:46:31.138 INFO:teuthology.orchestra.run.smithi177.stdout:3360 read 0x511bdb3 thru 0x512ad8a (0xefd8 bytes) 2019-12-16T22:46:31.167 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.167 INFO:teuthology.orchestra.run.smithi177.stdout:2566 write 0x6b94c02 thru 0x6ba35d6 (0xe9d5 bytes) 2019-12-16T22:46:31.168 INFO:teuthology.orchestra.run.smithi177.stdout:3361 write 0x79ee7a7 thru 0x79f9ceb (0xb545 bytes) 2019-12-16T22:46:31.190 INFO:teuthology.orchestra.run.smithi177.stdout:3362 read 0x12264c8 thru 0x122e5a0 (0x80d9 bytes) 2019-12-16T22:46:31.190 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone23 from 0x88036c5 (overlap 0x21894b7) to 0x6b50f1 2019-12-16T22:46:31.196 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.196 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.205 INFO:teuthology.orchestra.run.smithi177.stdout:3366 trunc from 0x79f9cec to 0x3642bf1 2019-12-16T22:46:31.219 INFO:teuthology.orchestra.run.smithi177.stdout:2567 writesame 0x39773b thru 0x39bb9a data_size 0x10(0x4460 bytes) 2019-12-16T22:46:31.234 INFO:teuthology.orchestra.run.smithi177.stdout:2569 writesame 0x284856 thru 0x2900ff data_size 0x3(0xb8aa bytes) 2019-12-16T22:46:31.234 INFO:teuthology.orchestra.run.smithi177.stdout:2779 write 0xb0c8761 thru 0xb0ce1b4 (0x5a54 bytes) 2019-12-16T22:46:31.255 INFO:teuthology.orchestra.run.smithi177.stdout:2780 read 0x655b9cf thru 0x656a5ad (0xebdf bytes) 2019-12-16T22:46:31.255 INFO:teuthology.orchestra.run.smithi177.stdout:2781 punch from 0x52c2066 to 0x52c976d, (0x7707 bytes) 2019-12-16T22:46:31.255 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.255 INFO:teuthology.orchestra.run.smithi177.stdout:2784 punch from 0xaaa6d00 to 0xaaab05d, (0x435d bytes) 2019-12-16T22:46:31.256 INFO:teuthology.orchestra.run.smithi177.stdout:2785 read 0x91bc659 thru 0x91c8076 (0xba1e bytes) 2019-12-16T22:46:31.256 INFO:teuthology.orchestra.run.smithi177.stdout:2786 write 0x840e997 thru 0x841631e (0x7988 bytes) 2019-12-16T22:46:31.268 INFO:teuthology.orchestra.run.smithi177.stdout:2268 write 0x407d498 thru 0x408b26a (0xddd3 bytes) 2019-12-16T22:46:31.271 INFO:teuthology.orchestra.run.smithi177.stdout:2788 read 0x6b97681 thru 0x6b9e1fd (0x6b7d bytes) 2019-12-16T22:46:31.271 INFO:teuthology.orchestra.run.smithi177.stdout:2789 read 0x2877d71 thru 0x287b780 (0x3a10 bytes) 2019-12-16T22:46:31.271 INFO:teuthology.orchestra.run.smithi177.stdout:2790 writesame 0x713c7d1 thru 0x7147cdc data_size 0x2(0xb50c bytes) 2019-12-16T22:46:31.281 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.282 INFO:teuthology.orchestra.run.smithi177.stdout:3367 punch from 0x4a6fb1 to 0x4a97dd, (0x282c bytes) 2019-12-16T22:46:31.282 INFO:teuthology.orchestra.run.smithi177.stdout:3368 punch from 0x58b04f to 0x58d0d9, (0x208a bytes) 2019-12-16T22:46:31.282 INFO:teuthology.orchestra.run.smithi177.stdout:3369 read 0xab606c thru 0xabe651 (0x85e6 bytes) 2019-12-16T22:46:31.283 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.284 INFO:teuthology.orchestra.run.smithi177.stdout:2572 trunc from 0xae52a14 to 0xbea985f 2019-12-16T22:46:31.286 INFO:teuthology.orchestra.run.smithi177.stdout:2269 punch from 0x3d4f355 to 0x3d55800, (0x64ab bytes) 2019-12-16T22:46:31.292 INFO:teuthology.orchestra.run.smithi177.stdout:3372 trunc from 0x3642bf1 to 0x6d80177 2019-12-16T22:46:31.307 INFO:teuthology.orchestra.run.smithi177.stdout:2573 read 0x96fec82 thru 0x970c9cb (0xdd4a bytes) 2019-12-16T22:46:31.308 INFO:teuthology.orchestra.run.smithi177.stdout:2574 writesame 0x443b047 thru 0x44472f1 data_size 0x1(0xc2ab bytes) 2019-12-16T22:46:31.311 INFO:teuthology.orchestra.run.smithi177.stdout:2792 trunc from 0xb0ce1b5 to 0x15b8782 2019-12-16T22:46:31.322 INFO:teuthology.orchestra.run.smithi177.stdout:2270 write 0xaac93b8 thru 0xaad5a10 (0xc659 bytes) 2019-12-16T22:46:31.322 INFO:teuthology.orchestra.run.smithi177.stdout:3373 clone 18 order 25 su 4194304 sc 3 2019-12-16T22:46:31.344 INFO:teuthology.orchestra.run.smithi177.stdout:2271 write 0xa7fb748 thru 0xa8047a6 (0x905f bytes) 2019-12-16T22:46:31.359 INFO:teuthology.orchestra.run.smithi177.stdout:2575 write 0x5dc72b1 thru 0x5dcd7c7 (0x6517 bytes) 2019-12-16T22:46:31.361 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.362 INFO:teuthology.orchestra.run.smithi177.stdout:2273 punch from 0x78dad9c to 0x78dd3be, (0x2622 bytes) 2019-12-16T22:46:31.362 INFO:teuthology.orchestra.run.smithi177.stdout:2274 writesame 0x480570f thru 0x480fff4 data_size 0xd(0xa8e6 bytes) 2019-12-16T22:46:31.375 INFO:teuthology.orchestra.run.smithi177.stdout:2275 punch from 0x610ac70 to 0x610daa6, (0x2e36 bytes) 2019-12-16T22:46:31.376 INFO:teuthology.orchestra.run.smithi177.stdout:2280 punch from 0x98a3f0 to 0x9967e6, (0xc3f6 bytes) 2019-12-16T22:46:31.383 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #22, image image_cluster1.client.mirror.2-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent23 2019-12-16T22:46:31.405 INFO:teuthology.orchestra.run.smithi177.stdout:2576 write 0xc0abc2b thru 0xc0b364d (0x7a23 bytes) 2019-12-16T22:46:31.408 INFO:teuthology.orchestra.run.smithi177.stdout:2282 write 0xe49df05 thru 0xe4ab8b3 (0xd9af bytes) 2019-12-16T22:46:31.414 INFO:teuthology.orchestra.run.smithi177.stdout:2795 writesame 0x71fa6e3 thru 0x71feb8b data_size 0x1f(0x44a9 bytes) 2019-12-16T22:46:31.418 INFO:teuthology.orchestra.run.smithi177.stdout:2796 read 0x1e12feb thru 0x1e14364 (0x137a bytes) 2019-12-16T22:46:31.418 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.418 INFO:teuthology.orchestra.run.smithi177.stdout:2798 read 0x300f23 thru 0x30ef56 (0xe034 bytes) 2019-12-16T22:46:31.426 INFO:teuthology.orchestra.run.smithi177.stdout:2799 write 0x21efb5f thru 0x21f7333 (0x77d5 bytes) 2019-12-16T22:46:31.427 INFO:teuthology.orchestra.run.smithi177.stdout:2285 read 0x68cde2b thru 0x68d39dd (0x5bb3 bytes) 2019-12-16T22:46:31.428 INFO:teuthology.orchestra.run.smithi177.stdout:2287 punch from 0xa0b372c to 0xa0b3ccd, (0x5a1 bytes) 2019-12-16T22:46:31.428 INFO:teuthology.orchestra.run.smithi177.stdout:2289 write 0x5e82fd thru 0x5e8f0e (0xc12 bytes) 2019-12-16T22:46:31.439 INFO:teuthology.orchestra.run.smithi177.stdout:2801 read 0x3075d7d thru 0x30839c1 (0xdc45 bytes) 2019-12-16T22:46:31.439 INFO:teuthology.orchestra.run.smithi177.stdout:2804 read 0x65988aa thru 0x659cc82 (0x43d9 bytes) 2019-12-16T22:46:31.439 INFO:teuthology.orchestra.run.smithi177.stdout:2805 read 0xcbce7c thru 0xccaa57 (0xdbdc bytes) 2019-12-16T22:46:31.453 INFO:teuthology.orchestra.run.smithi177.stdout:2806 trunc from 0x71feb8c to 0x29c4093 2019-12-16T22:46:31.465 INFO:teuthology.orchestra.run.smithi177.stdout:2290 write 0x649f31e thru 0x64ab2fa (0xbfdd bytes) 2019-12-16T22:46:31.471 INFO:teuthology.orchestra.run.smithi177.stdout:2577 write 0xe787575 thru 0xe791cb8 (0xa744 bytes) 2019-12-16T22:46:31.487 INFO:teuthology.orchestra.run.smithi177.stdout:2291 punch from 0xd4b80e8 to 0xd4bf015, (0x6f2d bytes) 2019-12-16T22:46:31.487 INFO:teuthology.orchestra.run.smithi177.stdout:2292 read 0xdd494de thru 0xdd58b12 (0xf635 bytes) 2019-12-16T22:46:31.497 INFO:teuthology.orchestra.run.smithi177.stdout:2294 trunc from 0xe4ab8b4 to 0x87d5289 2019-12-16T22:46:31.924 INFO:teuthology.orchestra.run.smithi177.stdout:2401 write 0x7e13242 thru 0x7e1922c (0x5feb bytes) 2019-12-16T22:46:31.931 INFO:teuthology.orchestra.run.smithi177.stdout:2402 read 0x4980936 thru 0x498d28b (0xc956 bytes) 2019-12-16T22:46:31.932 INFO:teuthology.orchestra.run.smithi177.stdout:2403 writesame 0x530c57d thru 0x5311280 data_size 0x6a(0x4d04 bytes) 2019-12-16T22:46:31.934 INFO:teuthology.orchestra.run.smithi177.stdout:2296 trunc from 0x87d5289 to 0x7060096 2019-12-16T22:46:31.942 INFO:teuthology.orchestra.run.smithi177.stdout:2406 trunc from 0xcb3851d to 0xad082de 2019-12-16T22:46:31.950 INFO:teuthology.orchestra.run.smithi177.stdout:2809 write 0x4c2d334 thru 0x4c2d6f1 (0x3be bytes) 2019-12-16T22:46:31.954 INFO:teuthology.orchestra.run.smithi177.stdout:2578 trunc from 0xe791cb9 to 0xdb6ff8 2019-12-16T22:46:31.981 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:31.982 INFO:teuthology.orchestra.run.smithi177.stdout:2408 read 0x2f8ff73 thru 0x2f9c5e0 (0xc66e bytes) 2019-12-16T22:46:31.982 INFO:teuthology.orchestra.run.smithi177.stdout:2297 write 0x799a3f1 thru 0x79a1375 (0x6f85 bytes) 2019-12-16T22:46:31.983 INFO:teuthology.orchestra.run.smithi177.stdout:2409 punch from 0x10bacbc to 0x10c1ec2, (0x7206 bytes) 2019-12-16T22:46:31.983 INFO:teuthology.orchestra.run.smithi177.stdout:2411 read 0x3d20925 thru 0x3d2cfb4 (0xc690 bytes) 2019-12-16T22:46:31.997 INFO:teuthology.orchestra.run.smithi177.stdout:2299 writesame 0x7191729 thru 0x7199353 data_size 0x13(0x7c2b bytes) 2019-12-16T22:46:32.005 INFO:teuthology.orchestra.run.smithi177.stdout:2810 writesame 0xa818ef6 thru 0xa826a8f data_size 0x1(0xdb9a bytes) 2019-12-16T22:46:32.016 INFO:teuthology.orchestra.run.smithi177.stdout:2300 read 0x673c0b3 thru 0x6743104 (0x7052 bytes) 2019-12-16T22:46:32.016 INFO:teuthology.orchestra.run.smithi177.stdout:2301 write 0x65b4c5c thru 0x65b6768 (0x1b0d bytes) 2019-12-16T22:46:32.017 INFO:teuthology.orchestra.run.smithi177.stdout:2814 read 0x1d4d60f thru 0x1d57e48 (0xa83a bytes) 2019-12-16T22:46:32.029 INFO:teuthology.orchestra.run.smithi177.stdout:2579 trunc from 0xdb6ff8 to 0x6365bf7 2019-12-16T22:46:32.033 INFO:teuthology.orchestra.run.smithi177.stdout:2815 trunc from 0xa826a90 to 0x3142c30 2019-12-16T22:46:32.067 INFO:teuthology.orchestra.run.smithi177.stdout:2413 write 0xd3107e2 thru 0xd31858e (0x7dad bytes) 2019-12-16T22:46:32.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b2750 2019-12-16T22:46:32.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b35f0 2019-12-16T22:46:32.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b3fb0 2019-12-16T22:46:32.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b43c0 2019-12-16T22:46:32.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a361662000 2019-12-16T22:46:32.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a3620152b0 2019-12-16T22:46:32.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a362bded00 2019-12-16T22:46:32.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a362d2d520 2019-12-16T22:46:32.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a3630afee0 2019-12-16T22:46:32.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.090+0000 7f66f9929700 -1 reset not still connected to 0x55a3645047d0 2019-12-16T22:46:32.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee8410 2019-12-16T22:46:32.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee95f0 2019-12-16T22:46:32.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:46:32.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36a9fba00 2019-12-16T22:46:32.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:46:32.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc72b60 2019-12-16T22:46:32.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:46:32.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:46:32.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08fc70 2019-12-16T22:46:32.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36c55c000 2019-12-16T22:46:32.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721450 2019-12-16T22:46:32.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:46:32.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a36fd13930 2019-12-16T22:46:32.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:46:32.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a378399c20 2019-12-16T22:46:32.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:46:32.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a3798111e0 2019-12-16T22:46:32.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51040 2019-12-16T22:46:32.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:32.102+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51a00 2019-12-16T22:46:32.107 INFO:teuthology.orchestra.run.smithi177.stdout:2414 trunc from 0xd31858f to 0xbbb22dd 2019-12-16T22:46:32.124 INFO:teuthology.orchestra.run.smithi177.stdout:2302 write 0xd71e7c9 thru 0xd7249c8 (0x6200 bytes) 2019-12-16T22:46:32.145 INFO:teuthology.orchestra.run.smithi177.stdout:2303 write 0x93216fc thru 0x932c944 (0xb249 bytes) 2019-12-16T22:46:32.153 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0bd780d0 2019-12-16T22:46:32.153 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0c2d1190 2019-12-16T22:46:32.153 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0e045670 2019-12-16T22:46:32.153 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0eebb810 2019-12-16T22:46:32.153 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a5b0 2019-12-16T22:46:32.154 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a8f0 2019-12-16T22:46:32.154 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55b790 2019-12-16T22:46:32.154 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55c700 2019-12-16T22:46:32.154 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.154+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdede10 2019-12-16T22:46:32.178 INFO:teuthology.orchestra.run.smithi177.stdout:2304 write 0x1c5a937 thru 0x1c61d4b (0x7415 bytes) 2019-12-16T22:46:32.184 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a12ba1cf0 2019-12-16T22:46:32.185 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a13addc70 2019-12-16T22:46:32.187 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a150c84e0 2019-12-16T22:46:32.188 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a150c9ba0 2019-12-16T22:46:32.188 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a182b81a0 2019-12-16T22:46:32.188 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a182b89c0 2019-12-16T22:46:32.188 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a182ba080 2019-12-16T22:46:32.188 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a196ad110 2019-12-16T22:46:32.188 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a196aebe0 2019-12-16T22:46:32.189 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a197b6750 2019-12-16T22:46:32.189 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e5b0 2019-12-16T22:46:32.189 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:32.189 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9d40 2019-12-16T22:46:32.189 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:32.189 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:32.189 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1e5c6b10 2019-12-16T22:46:32.190 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fb520 2019-12-16T22:46:32.190 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:32.190 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a24378750 2019-12-16T22:46:32.190 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a2437be90 2019-12-16T22:46:32.190 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a249dc630 2019-12-16T22:46:32.190 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a2686ac30 2019-12-16T22:46:32.190 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:32.191 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.186+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:32.204 INFO:teuthology.orchestra.run.smithi177.stdout:2580 write 0x71c6ea0 thru 0x71cf459 (0x85ba bytes) 2019-12-16T22:46:32.213 INFO:teuthology.orchestra.run.smithi177.stdout:2415 write 0x1ce3289 thru 0x1ceb3c9 (0x8141 bytes) 2019-12-16T22:46:32.213 INFO:teuthology.orchestra.run.smithi177.stdout:2817 write 0x662e76d thru 0x6632149 (0x39dd bytes) 2019-12-16T22:46:32.225 INFO:teuthology.orchestra.run.smithi177.stdout:2315 trunc from 0x88036c5 to 0x3e83e 2019-12-16T22:46:32.225 INFO:teuthology.orchestra.run.smithi177.stdout:2416 read 0x4385d19 thru 0x438c731 (0x6a19 bytes) 2019-12-16T22:46:32.228 INFO:teuthology.orchestra.run.smithi177.stdout:2417 write 0x3e2c253 thru 0x3e31493 (0x5241 bytes) 2019-12-16T22:46:32.242 INFO:teuthology.orchestra.run.smithi177.stdout:2581 read 0x6e30a3 thru 0x6e89af (0x590d bytes) 2019-12-16T22:46:32.242 INFO:teuthology.orchestra.run.smithi177.stdout:2305 write 0xcd0b03d thru 0xcd123b9 (0x737d bytes) 2019-12-16T22:46:32.244 INFO:teuthology.orchestra.run.smithi177.stdout:2582 read 0x59b3f41 thru 0x59bacf7 (0x6db7 bytes) 2019-12-16T22:46:32.245 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.247 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.247 INFO:teuthology.orchestra.run.smithi177.stdout:2819 read 0x36b5a19 thru 0x36c29be (0xcfa6 bytes) 2019-12-16T22:46:32.269 INFO:teuthology.orchestra.run.smithi177.stdout:2306 trunc from 0xd7249c9 to 0x82ff38f 2019-12-16T22:46:32.291 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.286+0000 7f85ca542700 -1 reset not still connected to 0x559a0b442150 2019-12-16T22:46:32.291 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.286+0000 7f85ca542700 -1 reset not still connected to 0x559a0bbbe680 2019-12-16T22:46:32.292 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.286+0000 7f85ca542700 -1 reset not still connected to 0x559a0e045670 2019-12-16T22:46:32.296 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.290+0000 7f85ca542700 -1 reset not still connected to 0x559a0eebb810 2019-12-16T22:46:32.303 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.298+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55b790 2019-12-16T22:46:32.314 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdede10 2019-12-16T22:46:32.315 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdedfb0 2019-12-16T22:46:32.315 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a12ba1cf0 2019-12-16T22:46:32.315 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a13addc70 2019-12-16T22:46:32.315 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a150c84e0 2019-12-16T22:46:32.316 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a150c9ba0 2019-12-16T22:46:32.316 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a182b81a0 2019-12-16T22:46:32.316 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a182b89c0 2019-12-16T22:46:32.317 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a182ba080 2019-12-16T22:46:32.317 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a196ad110 2019-12-16T22:46:32.317 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a196aebe0 2019-12-16T22:46:32.317 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a197b6750 2019-12-16T22:46:32.318 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e5b0 2019-12-16T22:46:32.318 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:32.318 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9450 2019-12-16T22:46:32.318 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9d40 2019-12-16T22:46:32.319 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:32.319 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:32.319 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:32.319 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1e5c79b0 2019-12-16T22:46:32.319 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fb520 2019-12-16T22:46:32.320 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:32.320 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:32.320 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a24379110 2019-12-16T22:46:32.320 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a2437be90 2019-12-16T22:46:32.321 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a2686ac30 2019-12-16T22:46:32.321 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.306+0000 7f85ca542700 -1 reset not still connected to 0x559a2686be10 2019-12-16T22:46:32.321 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.310+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:32.321 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:32.310+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:32.421 INFO:teuthology.orchestra.run.smithi177.stdout:2584 write 0xba4b5dd thru 0xba54684 (0x90a8 bytes) 2019-12-16T22:46:32.424 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~0s 2019-12-16T22:46:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:2308 read 0x57d28c0 thru 0x57df20e (0xc94f bytes) 2019-12-16T22:46:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:2309 punch from 0x1f5d3ad to 0x1f69005, (0xbc58 bytes) 2019-12-16T22:46:32.520 INFO:teuthology.orchestra.run.smithi177.stdout:2310 write 0x47f6985 thru 0x4801812 (0xae8e bytes) 2019-12-16T22:46:32.560 INFO:teuthology.orchestra.run.smithi177.stdout:2312 trunc from 0x82ff38f to 0xae9f2df 2019-12-16T22:46:32.615 INFO:teuthology.orchestra.run.smithi177.stdout:2313 trunc from 0xae9f2df to 0xc6accb7 2019-12-16T22:46:32.641 INFO:teuthology.orchestra.run.smithi177.stdout:2820 write 0xaeade07 thru 0xaeb4bbf (0x6db9 bytes) 2019-12-16T22:46:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.664 INFO:teuthology.orchestra.run.smithi177.stdout:2316 write 0xc06a46c thru 0xc06e886 (0x441b bytes) 2019-12-16T22:46:32.710 INFO:teuthology.orchestra.run.smithi177.stdout:2585 trunc from 0xba54685 to 0xdbd5e99 2019-12-16T22:46:32.751 INFO:teuthology.orchestra.run.smithi177.stdout:2317 writesame 0xdfc0b7e thru 0xdfcced5 data_size 0x5e(0xc358 bytes) 2019-12-16T22:46:32.754 INFO:teuthology.orchestra.run.smithi177.stdout:2318 read 0xdc8cf9b thru 0xdc940fa (0x7160 bytes) 2019-12-16T22:46:32.755 INFO:teuthology.orchestra.run.smithi177.stdout:2319 writesame 0xd432656 thru 0xd43ed58 data_size 0x1(0xc703 bytes) 2019-12-16T22:46:32.811 INFO:teuthology.orchestra.run.smithi177.stdout:2321 trunc from 0xdfcced6 to 0xb52f86e 2019-12-16T22:46:32.815 INFO:teuthology.orchestra.run.smithi177.stdout:2586 write 0x38ef05e thru 0x38f4132 (0x50d5 bytes) 2019-12-16T22:46:32.820 INFO:teuthology.orchestra.run.smithi177.stdout:2821 writesame 0xe8f5bed thru 0xe8f9226 data_size 0xb(0x363a bytes) 2019-12-16T22:46:32.827 INFO:teuthology.orchestra.run.smithi177.stdout:2823 punch from 0xe7d1375 to 0xe7d98de, (0x8569 bytes) 2019-12-16T22:46:32.827 INFO:teuthology.orchestra.run.smithi177.stdout:2824 write 0x1e172e2 thru 0x1e251b3 (0xded2 bytes) 2019-12-16T22:46:32.843 INFO:teuthology.orchestra.run.smithi177.stdout:2825 write 0x5345cdc thru 0x535287c (0xcba1 bytes) 2019-12-16T22:46:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:2587 punch from 0x8099d39 to 0x80a0bab, (0x6e72 bytes) 2019-12-16T22:46:32.844 INFO:teuthology.orchestra.run.smithi177.stdout:2589 write 0x6e66e1 thru 0x6f401a (0xd93a bytes) 2019-12-16T22:46:32.855 INFO:teuthology.orchestra.run.smithi177.stdout:2591 write 0x7cfbee6 thru 0x7d0594d (0x9a68 bytes) 2019-12-16T22:46:32.855 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.855 INFO:teuthology.orchestra.run.smithi177.stdout:2827 writesame 0x27b7e26 thru 0x27c797c data_size 0x25(0xfb57 bytes) 2019-12-16T22:46:32.858 INFO:teuthology.orchestra.run.smithi177.stdout:2326 read 0x8d6574e thru 0x8d6b4fe (0x5db1 bytes) 2019-12-16T22:46:32.858 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.858 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.872 INFO:teuthology.orchestra.run.smithi177.stdout:2829 writesame 0x1dafb31 thru 0x1db4a34 data_size 0x2(0x4f04 bytes) 2019-12-16T22:46:32.882 INFO:teuthology.orchestra.run.smithi177.stdout:2593 writesame 0x8b1df37 thru 0x8b29a8c data_size 0x2(0xbb56 bytes) 2019-12-16T22:46:32.886 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.887 INFO:teuthology.orchestra.run.smithi177.stdout:2329 writesame 0xea88a9d thru 0xea93cc8 data_size 0x7e(0xb22c bytes) 2019-12-16T22:46:32.889 INFO:teuthology.orchestra.run.smithi177.stdout:2316 write 0xafc9778 thru 0xafcb9f9 (0x2282 bytes) 2019-12-16T22:46:32.890 INFO:teuthology.orchestra.run.smithi177.stdout:2332 punch from 0xcf3e761 to 0xcf486cb, (0x9f6a bytes) 2019-12-16T22:46:32.890 INFO:teuthology.orchestra.run.smithi177.stdout:2333 read 0xbb38265 thru 0xbb47b00 (0xf89c bytes) 2019-12-16T22:46:32.890 INFO:teuthology.orchestra.run.smithi177.stdout:2334 write 0xd3c3bea thru 0xd3c602e (0x2445 bytes) 2019-12-16T22:46:32.905 INFO:teuthology.orchestra.run.smithi177.stdout:2335 writesame 0x2c6e63c thru 0x2c79fb9 data_size 0x1(0xb97e bytes) 2019-12-16T22:46:32.907 INFO:teuthology.orchestra.run.smithi177.stdout:2831 trunc from 0xe8f9227 to 0x121833c 2019-12-16T22:46:32.919 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:32.919 INFO:teuthology.orchestra.run.smithi177.stdout:2596 read 0x4cbbbdd thru 0x4ccafb2 (0xf3d6 bytes) 2019-12-16T22:46:32.920 INFO:teuthology.orchestra.run.smithi177.stdout:2318 writesame 0x9135703 thru 0x9136365 data_size 0x7(0xc63 bytes) 2019-12-16T22:46:32.920 INFO:teuthology.orchestra.run.smithi177.stdout:2599 punch from 0x36bb16e to 0x36c1627, (0x64b9 bytes) 2019-12-16T22:46:32.921 INFO:teuthology.orchestra.run.smithi177.stdout:2600 write 0x4fd4c6c thru 0x4fda361 (0x56f6 bytes) 2019-12-16T22:46:32.936 INFO:teuthology.orchestra.run.smithi177.stdout:2319 trunc from 0xafcb9fa to 0xa97f93f 2019-12-16T22:46:32.951 INFO:teuthology.orchestra.run.smithi177.stdout:2601 write 0x153847 thru 0x159ec1 (0x667b bytes) 2019-12-16T22:46:32.962 INFO:teuthology.orchestra.run.smithi177.stdout:2602 writesame 0x2bbe5f0 thru 0x2bca8ad data_size 0x15(0xc2be bytes) 2019-12-16T22:46:32.974 INFO:teuthology.orchestra.run.smithi177.stdout:2320 punch from 0x3906c87 to 0x390e145, (0x74be bytes) 2019-12-16T22:46:32.975 INFO:teuthology.orchestra.run.smithi177.stdout:2321 read 0x68491d6 thru 0x6856d09 (0xdb34 bytes) 2019-12-16T22:46:32.975 INFO:teuthology.orchestra.run.smithi177.stdout:2322 writesame 0x973d61 thru 0x976e57 data_size 0x17(0x30f7 bytes) 2019-12-16T22:46:33.008 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.008 INFO:teuthology.orchestra.run.smithi177.stdout:2605 punch from 0xdbb52d4 to 0xdbb6427, (0x1153 bytes) 2019-12-16T22:46:33.009 INFO:teuthology.orchestra.run.smithi177.stdout:2607 punch from 0xcb73307 to 0xcb73fb4, (0xcad bytes) 2019-12-16T22:46:33.009 INFO:teuthology.orchestra.run.smithi177.stdout:2608 write 0x4a30230 thru 0x4a3f97f (0xf750 bytes) 2019-12-16T22:46:33.015 INFO:teuthology.orchestra.run.smithi177.stdout:2323 trunc from 0xa97f93f to 0x569ad74 2019-12-16T22:46:33.026 INFO:teuthology.orchestra.run.smithi177.stdout:2336 trunc from 0xea93cc9 to 0x6549400 2019-12-16T22:46:33.058 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.058+0000 7f85b793d700 -1 osd.1 pg_epoch: 93 pg[2.22( v 93'1002 (0'0,93'1002] local-lis/les=13/14 n=98 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [1,2] r=0 lpr=13 luod=93'1001 crt=93'1002 lcod 92'1000 mlcod 92'1000 active+clean+snaptrim trimq=[f1~1] ps=[e2~1,e4~4,ed~4,f2~1]] removing snap head 2019-12-16T22:46:33.081 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.090 INFO:teuthology.orchestra.run.smithi177.stdout:2325 trunc from 0x569ad74 to 0x5fbda2e 2019-12-16T22:46:33.096 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.096 INFO:teuthology.orchestra.run.smithi177.stdout:2338 write 0x14a6ec0 thru 0x14b1cee (0xae2f bytes) 2019-12-16T22:46:33.100 INFO:teuthology.orchestra.run.smithi177.stdout:2610 trunc from 0xdbd5e99 to 0x547b76c 2019-12-16T22:46:33.108 INFO:teuthology.orchestra.run.smithi177.stdout:2326 read 0x3193f2f thru 0x319402d (0xff bytes) 2019-12-16T22:46:33.137 INFO:teuthology.orchestra.run.smithi177.stdout:2327 writesame 0x8530ff6 thru 0x853425f data_size 0x9(0x326a bytes) 2019-12-16T22:46:33.150 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.150 INFO:teuthology.orchestra.run.smithi177.stdout:2330 read 0x82e1bbd thru 0x82e5246 (0x368a bytes) 2019-12-16T22:46:33.150 INFO:teuthology.orchestra.run.smithi177.stdout:2331 writesame 0x371391b thru 0x372077b data_size 0xb(0xce61 bytes) 2019-12-16T22:46:33.173 INFO:teuthology.orchestra.run.smithi177.stdout:2341 punch from 0x322fc77 to 0x323e536, (0xe8bf bytes) 2019-12-16T22:46:33.197 INFO:teuthology.orchestra.run.smithi177.stdout:2342 writesame 0x9d7e235 thru 0x9d8e151 data_size 0x1(0xff1d bytes) 2019-12-16T22:46:33.204 INFO:teuthology.orchestra.run.smithi177.stdout:2343 read 0x643fce8 thru 0x6446686 (0x699f bytes) 2019-12-16T22:46:33.467 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a5b0 2019-12-16T22:46:33.467 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55a8f0 2019-12-16T22:46:33.468 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55b790 2019-12-16T22:46:33.468 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a0f55c700 2019-12-16T22:46:33.468 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a0fdedfb0 2019-12-16T22:46:33.468 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a0ff37450 2019-12-16T22:46:33.468 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a12ba1cf0 2019-12-16T22:46:33.468 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a13addc70 2019-12-16T22:46:33.468 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a150c84e0 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a150cb260 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a196ad110 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a196aebe0 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a197b6750 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e5b0 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9450 2019-12-16T22:46:33.469 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9d40 2019-12-16T22:46:33.470 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:33.470 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:33.470 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:33.470 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1e5c79b0 2019-12-16T22:46:33.470 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fb520 2019-12-16T22:46:33.470 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:33.470 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:33.471 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a24378750 2019-12-16T22:46:33.471 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a24379110 2019-12-16T22:46:33.471 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a249dc630 2019-12-16T22:46:33.471 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a2686be10 2019-12-16T22:46:33.471 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:33.471 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:33.471 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a0aa57110 2019-12-16T22:46:33.472 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a150c84e0 2019-12-16T22:46:33.472 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:33.472 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:33.462+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:33.476 INFO:teuthology.orchestra.run.smithi177.stdout:2419 read 0x7c36553 thru 0x7c398d8 (0x3386 bytes) 2019-12-16T22:46:33.476 INFO:teuthology.orchestra.run.smithi177.stdout:2332 read 0x2789523 thru 0x278bb4c (0x262a bytes) 2019-12-16T22:46:33.478 INFO:teuthology.orchestra.run.smithi177.stdout:2420 write 0x589982 thru 0x58d9c6 (0x4045 bytes) 2019-12-16T22:46:33.505 INFO:teuthology.orchestra.run.smithi177.stdout:2344 trunc from 0x9d8e152 to 0x1925316 2019-12-16T22:46:33.506 INFO:teuthology.orchestra.run.smithi177.stdout:2422 punch from 0x142a515 to 0x142e485, (0x3f70 bytes) 2019-12-16T22:46:33.506 INFO:teuthology.orchestra.run.smithi177.stdout:2423 read 0x2589fa thru 0x25d146 (0x474d bytes) 2019-12-16T22:46:33.506 INFO:teuthology.orchestra.run.smithi177.stdout:2424 write 0x7e035a3 thru 0x7e0638b (0x2de9 bytes) 2019-12-16T22:46:33.506 INFO:teuthology.orchestra.run.smithi177.stdout:2834 write 0x4e6a8d0 thru 0x4e7641e (0xbb4f bytes) 2019-12-16T22:46:33.512 INFO:teuthology.orchestra.run.smithi177.stdout:2611 punch from 0x21fefbc to 0x2202156, (0x319a bytes) 2019-12-16T22:46:33.512 INFO:teuthology.orchestra.run.smithi177.stdout:2614 read 0x6279af thru 0x6346c6 (0xcd18 bytes) 2019-12-16T22:46:33.516 INFO:teuthology.orchestra.run.smithi177.stdout:2615 read 0x8fec13 thru 0x90cf3b (0xe329 bytes) 2019-12-16T22:46:33.520 INFO:teuthology.orchestra.run.smithi177.stdout:2835 punch from 0x184add to 0x18a181, (0x56a4 bytes) 2019-12-16T22:46:33.520 INFO:teuthology.orchestra.run.smithi177.stdout:2837 read 0x261575f thru 0x26256d4 (0xff76 bytes) 2019-12-16T22:46:33.520 INFO:teuthology.orchestra.run.smithi177.stdout:2425 trunc from 0xbbb22dd to 0x8df369d 2019-12-16T22:46:33.531 INFO:teuthology.orchestra.run.smithi177.stdout:2333 write 0xb9f5b15 thru 0xba0382c (0xdd18 bytes) 2019-12-16T22:46:33.535 INFO:teuthology.orchestra.run.smithi177.stdout:2840 trunc from 0x4e7641f to 0xc78f58f 2019-12-16T22:46:33.580 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #16, image image_cluster1.client.mirror.1-clone16 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent17 2019-12-16T22:46:33.592 INFO:teuthology.orchestra.run.smithi177.stdout:2616 writesame 0xa0b5288 thru 0xa0b6e21 data_size 0x1(0x1b9a bytes) 2019-12-16T22:46:33.608 INFO:teuthology.orchestra.run.smithi177.stdout:2617 write 0x7001d2 thru 0x70c543 (0xc372 bytes) 2019-12-16T22:46:33.629 INFO:teuthology.orchestra.run.smithi177.stdout:2334 read 0x1aee7f0 thru 0x1af6e09 (0x861a bytes) 2019-12-16T22:46:33.630 INFO:teuthology.orchestra.run.smithi177.stdout:2335 punch from 0x6db0d89 to 0x6dbfaea, (0xed61 bytes) 2019-12-16T22:46:33.640 INFO:teuthology.orchestra.run.smithi177.stdout:2426 write 0x42c1fbf thru 0x42c57c5 (0x3807 bytes) 2019-12-16T22:46:33.647 INFO:teuthology.orchestra.run.smithi177.stdout:2618 write 0x3e5c88 thru 0x3efe3f (0xa1b8 bytes) 2019-12-16T22:46:33.652 INFO:teuthology.orchestra.run.smithi177.stdout:2427 writesame 0xf00d9f thru 0xf07c9f data_size 0x1(0x6f01 bytes) 2019-12-16T22:46:33.656 INFO:teuthology.orchestra.run.smithi177.stdout:2841 punch from 0x57c483b to 0x57c9847, (0x500c bytes) 2019-12-16T22:46:33.656 INFO:teuthology.orchestra.run.smithi177.stdout:2842 read 0x603a17e thru 0x604702a (0xcead bytes) 2019-12-16T22:46:33.657 INFO:teuthology.orchestra.run.smithi177.stdout:2843 write 0x76b969c thru 0x76bab56 (0x14bb bytes) 2019-12-16T22:46:33.668 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.669 INFO:teuthology.orchestra.run.smithi177.stdout:2620 read 0x8fdae4a thru 0x8fe31bd (0x8374 bytes) 2019-12-16T22:46:33.669 INFO:teuthology.orchestra.run.smithi177.stdout:2621 write 0x55bf6db thru 0x55c2539 (0x2e5f bytes) 2019-12-16T22:46:33.673 INFO:teuthology.orchestra.run.smithi177.stdout:2336 write 0xc3a6cf6 thru 0xc3b57aa (0xeab5 bytes) 2019-12-16T22:46:33.683 INFO:teuthology.orchestra.run.smithi177.stdout:2844 punch from 0x69b6814 to 0x69bd783, (0x6f6f bytes) 2019-12-16T22:46:33.683 INFO:teuthology.orchestra.run.smithi177.stdout:2845 write 0xaf45e06 thru 0xaf526ec (0xc8e7 bytes) 2019-12-16T22:46:33.690 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.690 INFO:teuthology.orchestra.run.smithi177.stdout:2429 punch from 0xe8a9c0 to 0xe8bd8e, (0x13ce bytes) 2019-12-16T22:46:33.691 INFO:teuthology.orchestra.run.smithi177.stdout:2430 write 0x81018b9 thru 0x81108eb (0xf033 bytes) 2019-12-16T22:46:33.703 INFO:teuthology.orchestra.run.smithi177.stdout:2848 punch from 0x461ec2d to 0x4628ce2, (0xa0b5 bytes) 2019-12-16T22:46:33.703 INFO:teuthology.orchestra.run.smithi177.stdout:2849 punch from 0x71067b3 to 0x7110703, (0x9f50 bytes) 2019-12-16T22:46:33.703 INFO:teuthology.orchestra.run.smithi177.stdout:2850 writesame 0x606cbab thru 0x6078498 data_size 0x1(0xb8ee bytes) 2019-12-16T22:46:33.716 INFO:teuthology.orchestra.run.smithi177.stdout:2431 read 0x48cc3c4 thru 0x48d62ee (0x9f2b bytes) 2019-12-16T22:46:33.716 INFO:teuthology.orchestra.run.smithi177.stdout:2622 writesame 0x28ea25a thru 0x28eeaed data_size 0xa(0x4894 bytes) 2019-12-16T22:46:33.723 INFO:teuthology.orchestra.run.smithi177.stdout:2432 writesame 0x622f1c1 thru 0x623d97f data_size 0x1(0xe7bf bytes) 2019-12-16T22:46:33.736 INFO:teuthology.orchestra.run.smithi177.stdout:2623 trunc from 0xa0b6e22 to 0xd8fb4a2 2019-12-16T22:46:33.744 INFO:teuthology.orchestra.run.smithi177.stdout:2345 trunc from 0x1925316 to 0x78e2225 2019-12-16T22:46:33.755 INFO:teuthology.orchestra.run.smithi177.stdout:2337 read 0x348fc0b thru 0x349de94 (0xe28a bytes) 2019-12-16T22:46:33.755 INFO:teuthology.orchestra.run.smithi177.stdout:2851 punch from 0x9e854b1 to 0x9e88faf, (0x3afe bytes) 2019-12-16T22:46:33.756 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.756 INFO:teuthology.orchestra.run.smithi177.stdout:2856 writesame 0x4821d18 thru 0x4825994 data_size 0x13(0x3c7d bytes) 2019-12-16T22:46:33.757 INFO:teuthology.orchestra.run.smithi177.stdout:2339 read 0x8b49d2d thru 0x8b4bad3 (0x1da7 bytes) 2019-12-16T22:46:33.757 INFO:teuthology.orchestra.run.smithi177.stdout:2340 write 0x5861904 thru 0x58682de (0x69db bytes) 2019-12-16T22:46:33.771 INFO:teuthology.orchestra.run.smithi177.stdout:2859 punch from 0x509cd61 to 0x50a713d, (0xa3dc bytes) 2019-12-16T22:46:33.786 INFO:teuthology.orchestra.run.smithi177.stdout:2624 write 0xa2fecd6 thru 0xa30cf43 (0xe26e bytes) 2019-12-16T22:46:33.790 INFO:teuthology.orchestra.run.smithi177.stdout:2341 read 0x951700d thru 0x9521e9e (0xae92 bytes) 2019-12-16T22:46:33.791 INFO:teuthology.orchestra.run.smithi177.stdout:2346 write 0xc82ce5e thru 0xc82e239 (0x13dc bytes) 2019-12-16T22:46:33.791 INFO:teuthology.orchestra.run.smithi177.stdout:2344 writesame 0xaf9e7f2 thru 0xafa680e data_size 0x1(0x801d bytes) 2019-12-16T22:46:33.795 INFO:teuthology.orchestra.run.smithi177.stdout:2435 write 0xd4cf6c1 thru 0xd4d40ae (0x49ee bytes) 2019-12-16T22:46:33.802 INFO:teuthology.orchestra.run.smithi177.stdout:2860 writesame 0xdb8c870 thru 0xdb8d12d data_size 0x3(0x8be bytes) 2019-12-16T22:46:33.811 INFO:teuthology.orchestra.run.smithi177.stdout:2861 trunc from 0xdb8d12e to 0xaaf1684 2019-12-16T22:46:33.830 INFO:teuthology.orchestra.run.smithi177.stdout:2625 writesame 0x57a19a thru 0x5817e7 data_size 0x13(0x764e bytes) 2019-12-16T22:46:33.839 INFO:teuthology.orchestra.run.smithi177.stdout:2626 writesame 0x5cfbfc9 thru 0x5d064bc data_size 0x99(0xa4f4 bytes) 2019-12-16T22:46:33.846 INFO:teuthology.orchestra.run.smithi177.stdout:2347 write 0xe78aabe thru 0xe7985aa (0xdaed bytes) 2019-12-16T22:46:33.853 INFO:teuthology.orchestra.run.smithi177.stdout:2439 write 0xdec44ab thru 0xded1527 (0xd07d bytes) 2019-12-16T22:46:33.869 INFO:teuthology.orchestra.run.smithi177.stdout:2628 write 0xad384c1 thru 0xad44387 (0xbec7 bytes) 2019-12-16T22:46:33.872 INFO:teuthology.orchestra.run.smithi177.stdout:2345 write 0xcb902e2 thru 0xcb967f6 (0x6515 bytes) 2019-12-16T22:46:33.874 INFO:teuthology.orchestra.run.smithi177.stdout:2349 write 0x46a6ffa thru 0x46adb78 (0x6b7f bytes) 2019-12-16T22:46:33.877 INFO:teuthology.orchestra.run.smithi177.stdout:2862 trunc from 0xaaf1684 to 0x143ea7c 2019-12-16T22:46:33.893 INFO:teuthology.orchestra.run.smithi177.stdout:2440 trunc from 0xded1528 to 0x420c05b 2019-12-16T22:46:33.894 INFO:teuthology.orchestra.run.smithi177.stdout:2350 read 0xd376766 thru 0xd37dc9b (0x7536 bytes) 2019-12-16T22:46:33.894 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:33.904 INFO:teuthology.orchestra.run.smithi177.stdout:2629 punch from 0x533f3ba to 0x534714b, (0x7d91 bytes) 2019-12-16T22:46:33.908 INFO:teuthology.orchestra.run.smithi177.stdout:2353 trunc from 0xe7985ab to 0x70e3f8c 2019-12-16T22:46:33.910 INFO:teuthology.orchestra.run.smithi177.stdout:2347 write 0x63a9d59 thru 0x63b418f (0xa437 bytes) 2019-12-16T22:46:33.917 INFO:teuthology.orchestra.run.smithi177.stdout:3374 read 0x5afbb1c thru 0x5b034a1 (0x7986 bytes) 2019-12-16T22:46:33.922 INFO:teuthology.orchestra.run.smithi177.stdout:2630 trunc from 0xd8fb4a2 to 0x2f8b64e 2019-12-16T22:46:34.062 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.075 INFO:teuthology.orchestra.run.smithi177.stdout:2350 trunc from 0xcb967f7 to 0x2b5e52b 2019-12-16T22:46:34.104 INFO:teuthology.orchestra.run.smithi177.stdout:2633 read 0x18769b9 thru 0x1879f02 (0x354a bytes) 2019-12-16T22:46:34.105 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.131 INFO:teuthology.orchestra.run.smithi177.stdout:3375 read 0x5394fdd thru 0x53951f6 (0x21a bytes) 2019-12-16T22:46:34.132 INFO:teuthology.orchestra.run.smithi177.stdout:3376 write 0x4f9ccc8 thru 0x4fa8f5f (0xc298 bytes) 2019-12-16T22:46:34.146 INFO:teuthology.orchestra.run.smithi177.stdout:2354 read 0x6b3df00 thru 0x6b4830a (0xa40b bytes) 2019-12-16T22:46:34.146 INFO:teuthology.orchestra.run.smithi177.stdout:2355 read 0x6f09f71 thru 0x6f0c215 (0x22a5 bytes) 2019-12-16T22:46:34.169 INFO:teuthology.orchestra.run.smithi177.stdout:2635 write 0x417e09d thru 0x418c005 (0xdf69 bytes) 2019-12-16T22:46:34.210 INFO:teuthology.orchestra.run.smithi177.stdout:2863 write 0x955605a thru 0x955eb37 (0x8ade bytes) 2019-12-16T22:46:34.226 INFO:teuthology.orchestra.run.smithi177.stdout:3377 read 0xbc70 thru 0x19c5c (0xdfed bytes) 2019-12-16T22:46:34.267 INFO:teuthology.orchestra.run.smithi177.stdout:2636 read 0x1352b4b thru 0x135690e (0x3dc4 bytes) 2019-12-16T22:46:34.267 INFO:teuthology.orchestra.run.smithi177.stdout:2637 punch from 0x1afcafa to 0x1b031ae, (0x66b4 bytes) 2019-12-16T22:46:34.278 INFO:teuthology.orchestra.run.smithi177.stdout:2864 write 0x84089dc thru 0x840adb9 (0x23de bytes) 2019-12-16T22:46:34.285 INFO:teuthology.orchestra.run.smithi177.stdout:2351 punch from 0x2041d4c to 0x204939a, (0x764e bytes) 2019-12-16T22:46:34.285 INFO:teuthology.orchestra.run.smithi177.stdout:2352 read 0x17e4188 thru 0x17ecb72 (0x89eb bytes) 2019-12-16T22:46:34.285 INFO:teuthology.orchestra.run.smithi177.stdout:2353 punch from 0x7609d to 0x7cae9, (0x6a4c bytes) 2019-12-16T22:46:34.301 INFO:teuthology.orchestra.run.smithi177.stdout:2356 write 0x9cb10d8 thru 0x9cbb475 (0xa39e bytes) 2019-12-16T22:46:34.308 INFO:teuthology.orchestra.run.smithi177.stdout:3380 writesame 0x8cad1ab thru 0x8cb4ee9 data_size 0x1(0x7d3f bytes) 2019-12-16T22:46:34.315 INFO:teuthology.orchestra.run.smithi177.stdout:2638 write 0xccc6b8d thru 0xccc8fd5 (0x2449 bytes) 2019-12-16T22:46:34.319 INFO:teuthology.orchestra.run.smithi177.stdout:3382 write 0x3a3f8f3 thru 0x3a4b60e (0xbd1c bytes) 2019-12-16T22:46:34.320 INFO:teuthology.orchestra.run.smithi177.stdout:2357 writesame 0x651a6d5 thru 0x65285b0 data_size 0x22(0xdedc bytes) 2019-12-16T22:46:34.343 INFO:teuthology.orchestra.run.smithi177.stdout:2354 write 0xc67433c thru 0xc67f790 (0xb455 bytes) 2019-12-16T22:46:34.347 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.347 INFO:teuthology.orchestra.run.smithi177.stdout:2361 punch from 0x9c8eb41 to 0x9c9a2ae, (0xb76d bytes) 2019-12-16T22:46:34.347 INFO:teuthology.orchestra.run.smithi177.stdout:2362 read 0x62353a3 thru 0x623d292 (0x7ef0 bytes) 2019-12-16T22:46:34.348 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.348 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.348 INFO:teuthology.orchestra.run.smithi177.stdout:2367 punch from 0x9021325 to 0x902d94d, (0xc628 bytes) 2019-12-16T22:46:34.348 INFO:teuthology.orchestra.run.smithi177.stdout:2368 read 0x22f0e98 thru 0x22f1ceb (0xe54 bytes) 2019-12-16T22:46:34.348 INFO:teuthology.orchestra.run.smithi177.stdout:2369 punch from 0x8136e11 to 0x813cecc, (0x60bb bytes) 2019-12-16T22:46:34.348 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.355 INFO:teuthology.orchestra.run.smithi177.stdout:2639 trunc from 0xccc8fd6 to 0x68245d8 2019-12-16T22:46:34.362 INFO:teuthology.orchestra.run.smithi177.stdout:2371 trunc from 0x9cbb476 to 0x1ffed98 2019-12-16T22:46:34.375 INFO:teuthology.orchestra.run.smithi177.stdout:3383 read 0x25fbfe6 thru 0x260990a (0xd925 bytes) 2019-12-16T22:46:34.380 INFO:teuthology.orchestra.run.smithi177.stdout:3384 punch from 0x52cb2df to 0x52d3a1f, (0x8740 bytes) 2019-12-16T22:46:34.380 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.380 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.380 INFO:teuthology.orchestra.run.smithi177.stdout:3387 read 0x8b3e648 thru 0x8b4ddc2 (0xf77b bytes) 2019-12-16T22:46:34.381 INFO:teuthology.orchestra.run.smithi177.stdout:3388 punch from 0x41fd4fb to 0x420b314, (0xde19 bytes) 2019-12-16T22:46:34.401 INFO:teuthology.orchestra.run.smithi177.stdout:2866 write 0xba43869 thru 0xba4f579 (0xbd11 bytes) 2019-12-16T22:46:34.419 INFO:teuthology.orchestra.run.smithi177.stdout:2356 read 0x8159b67 thru 0x8160b17 (0x6fb1 bytes) 2019-12-16T22:46:34.424 INFO:teuthology.orchestra.run.smithi177.stdout:2357 trunc from 0xc67f791 to 0x9d2e2e4 2019-12-16T22:46:34.426 INFO:teuthology.orchestra.run.smithi177.stdout:3391 write 0xa47ccb3 thru 0xa480220 (0x356e bytes) 2019-12-16T22:46:34.432 INFO:teuthology.orchestra.run.smithi177.stdout:2640 write 0x5ad6c8d thru 0x5ae1eef (0xb263 bytes) 2019-12-16T22:46:34.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:34.434+0000 7f1b501e4700 -1 rbd::mirror::image_replayer::CreateImageRequest: 0x5574649a1e40 handle_clone_image: failed to clone image mirror/10d32d7dc78 to image_cluster1.client.mirror.1-clone18 2019-12-16T22:46:34.445 INFO:teuthology.orchestra.run.smithi177.stdout:2373 trunc from 0x1ffed98 to 0xd770d81 2019-12-16T22:46:34.460 INFO:teuthology.orchestra.run.smithi177.stdout:2867 write 0xe2946a8 thru 0xe29c181 (0x7ada bytes) 2019-12-16T22:46:34.471 INFO:teuthology.orchestra.run.smithi177.stdout:2642 read 0x50fb036 thru 0x5102b1f (0x7aea bytes) 2019-12-16T22:46:34.472 INFO:teuthology.orchestra.run.smithi177.stdout:2643 write 0x3cbee7c thru 0x3ccd3fb (0xe580 bytes) 2019-12-16T22:46:34.473 INFO:teuthology.orchestra.run.smithi177.stdout:2868 read 0xccf11cc thru 0xccf9d43 (0x8b78 bytes) 2019-12-16T22:46:34.473 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.473 INFO:teuthology.orchestra.run.smithi177.stdout:2870 punch from 0xdc5b8cc to 0xdc66e20, (0xb554 bytes) 2019-12-16T22:46:34.473 INFO:teuthology.orchestra.run.smithi177.stdout:2871 punch from 0xa2b16b6 to 0xa2c0857, (0xf1a1 bytes) 2019-12-16T22:46:34.473 INFO:teuthology.orchestra.run.smithi177.stdout:2873 read 0x55f4fff thru 0x55f590d (0x90f bytes) 2019-12-16T22:46:34.474 INFO:teuthology.orchestra.run.smithi177.stdout:2874 read 0x98f4306 thru 0x98f6ddd (0x2ad8 bytes) 2019-12-16T22:46:34.474 INFO:teuthology.orchestra.run.smithi177.stdout:2875 read 0x1c3ceee thru 0x1c3dc50 (0xd63 bytes) 2019-12-16T22:46:34.474 INFO:teuthology.orchestra.run.smithi177.stdout:2876 read 0xa273058 thru 0xa279fda (0x6f83 bytes) 2019-12-16T22:46:34.474 INFO:teuthology.orchestra.run.smithi177.stdout:2877 read 0x9e62d75 thru 0x9e6d91d (0xaba9 bytes) 2019-12-16T22:46:34.474 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.474 INFO:teuthology.orchestra.run.smithi177.stdout:2361 read 0x56ef28d thru 0x56ef53f (0x2b3 bytes) 2019-12-16T22:46:34.475 INFO:teuthology.orchestra.run.smithi177.stdout:2375 punch from 0x3adba27 to 0x3ae4f00, (0x94d9 bytes) 2019-12-16T22:46:34.475 INFO:teuthology.orchestra.run.smithi177.stdout:2376 read 0xabe9034 thru 0xabf791c (0xe8e9 bytes) 2019-12-16T22:46:34.475 INFO:teuthology.orchestra.run.smithi177.stdout:2377 write 0x6b21b10 thru 0x6b26314 (0x4805 bytes) 2019-12-16T22:46:34.476 INFO:teuthology.orchestra.run.smithi177.stdout:3392 writesame 0xbbf3377 thru 0xbbfa810 data_size 0x32(0x749a bytes) 2019-12-16T22:46:34.483 INFO:teuthology.orchestra.run.smithi177.stdout:2362 trunc from 0x9d2e2e4 to 0x4400314 2019-12-16T22:46:34.485 INFO:teuthology.orchestra.run.smithi177.stdout:2378 write 0x445ae1e thru 0x446a301 (0xf4e4 bytes) 2019-12-16T22:46:34.491 INFO:teuthology.orchestra.run.smithi177.stdout:3393 write 0x5fffd08 thru 0x60077dc (0x7ad5 bytes) 2019-12-16T22:46:34.512 INFO:teuthology.orchestra.run.smithi177.stdout:2379 read 0x2f932c thru 0x2ff6e5 (0x63ba bytes) 2019-12-16T22:46:34.515 INFO:teuthology.orchestra.run.smithi177.stdout:2382 write 0x772ef8c thru 0x772fcf0 (0xd65 bytes) 2019-12-16T22:46:34.518 INFO:teuthology.orchestra.run.smithi177.stdout:2879 write 0xec4f861 thru 0xec572c8 (0x7a68 bytes) 2019-12-16T22:46:34.523 INFO:teuthology.orchestra.run.smithi177.stdout:3395 trunc from 0xbbfa811 to 0x60e0c63 2019-12-16T22:46:34.523 INFO:teuthology.orchestra.run.smithi177.stdout:2384 read 0x750fc75 thru 0x7517b36 (0x7ec2 bytes) 2019-12-16T22:46:34.523 INFO:teuthology.orchestra.run.smithi177.stdout:2385 write 0xd4c38b8 thru 0xd4ca668 (0x6db1 bytes) 2019-12-16T22:46:34.528 INFO:teuthology.orchestra.run.smithi177.stdout:2644 trunc from 0x68245d8 to 0xdba19c3 2019-12-16T22:46:34.531 INFO:teuthology.orchestra.run.smithi177.stdout:2881 write 0x9742ca thru 0x980f37 (0xcc6e bytes) 2019-12-16T22:46:34.540 INFO:teuthology.orchestra.run.smithi177.stdout:2387 write 0xaea2307 thru 0xaea85b8 (0x62b2 bytes) 2019-12-16T22:46:34.584 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.585 INFO:teuthology.orchestra.run.smithi177.stdout:2646 read 0xbe6c634 thru 0xbe71edf (0x58ac bytes) 2019-12-16T22:46:34.585 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.585 INFO:teuthology.orchestra.run.smithi177.stdout:2648 punch from 0x899fb42 to 0x89af864, (0xfd22 bytes) 2019-12-16T22:46:34.585 INFO:teuthology.orchestra.run.smithi177.stdout:2649 writesame 0x9db8f8c thru 0x9dbb911 data_size 0x5(0x2986 bytes) 2019-12-16T22:46:34.586 INFO:teuthology.orchestra.run.smithi177.stdout:2363 write 0xb4e6c20 thru 0xb4e6d32 (0x113 bytes) 2019-12-16T22:46:34.586 INFO:teuthology.orchestra.run.smithi177.stdout:2388 write 0x4d1eba9 thru 0x4d2db86 (0xefde bytes) 2019-12-16T22:46:34.595 INFO:teuthology.orchestra.run.smithi177.stdout:3396 write 0x32852b1 thru 0x32938d7 (0xe627 bytes) 2019-12-16T22:46:34.604 INFO:teuthology.orchestra.run.smithi177.stdout:2365 trunc from 0xb4e6d33 to 0xdfde0c3 2019-12-16T22:46:34.608 INFO:teuthology.orchestra.run.smithi177.stdout:2651 write 0x9e1dbc3 thru 0x9e20dca (0x3208 bytes) 2019-12-16T22:46:34.646 INFO:teuthology.orchestra.run.smithi177.stdout:2882 write 0xd6d571 thru 0xd7caca (0xf55a bytes) 2019-12-16T22:46:34.706 INFO:teuthology.orchestra.run.smithi177.stdout:2653 writesame 0x8965e05 thru 0x896d9ac data_size 0xc(0x7ba8 bytes) 2019-12-16T22:46:34.712 INFO:teuthology.orchestra.run.smithi177.stdout:2366 write 0x821bddf thru 0x822b5c7 (0xf7e9 bytes) 2019-12-16T22:46:34.717 INFO:teuthology.orchestra.run.smithi177.stdout:2389 read 0xaf5bf48 thru 0xaf685bf (0xc678 bytes) 2019-12-16T22:46:34.720 INFO:teuthology.orchestra.run.smithi177.stdout:2391 trunc from 0xd770d81 to 0xe2ff44b 2019-12-16T22:46:34.763 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.776 INFO:teuthology.orchestra.run.smithi177.stdout:2655 trunc from 0xdba19c3 to 0x7735279 2019-12-16T22:46:34.788 INFO:teuthology.orchestra.run.smithi177.stdout:3398 write 0x9f8a3ab thru 0x9f9227a (0x7ed0 bytes) 2019-12-16T22:46:34.795 INFO:teuthology.orchestra.run.smithi177.stdout:2367 punch from 0x8b2b70b to 0x8b38e82, (0xd777 bytes) 2019-12-16T22:46:34.795 INFO:teuthology.orchestra.run.smithi177.stdout:2368 write 0x37aa151 thru 0x37b0bc7 (0x6a77 bytes) 2019-12-16T22:46:34.804 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:34.808 INFO:teuthology.orchestra.run.smithi177.stdout:3400 trunc from 0x9f9227b to 0x82e83c2 2019-12-16T22:46:34.858 INFO:teuthology.orchestra.run.smithi177.stdout:2883 read 0xaf6429c thru 0xaf681a6 (0x3f0b bytes) 2019-12-16T22:46:34.858 INFO:teuthology.orchestra.run.smithi177.stdout:2884 write 0x1cf1ec4 thru 0x1cfd290 (0xb3cd bytes) 2019-12-16T22:46:34.861 INFO:teuthology.orchestra.run.smithi177.stdout:2656 read 0x69e53df thru 0x69e8f3f (0x3b61 bytes) 2019-12-16T22:46:34.861 INFO:teuthology.orchestra.run.smithi177.stdout:2657 punch from 0x6a55b52 to 0x6a6534b, (0xf7f9 bytes) 2019-12-16T22:46:34.861 INFO:teuthology.orchestra.run.smithi177.stdout:2658 read 0x12a286d thru 0x12acd5a (0xa4ee bytes) 2019-12-16T22:46:34.862 INFO:teuthology.orchestra.run.smithi177.stdout:2659 read 0x862056 thru 0x863500 (0x14ab bytes) 2019-12-16T22:46:34.876 INFO:teuthology.orchestra.run.smithi177.stdout:2393 punch from 0x687c1cf to 0x6889dd1, (0xdc02 bytes) 2019-12-16T22:46:34.876 INFO:teuthology.orchestra.run.smithi177.stdout:2394 punch from 0xafa0a0 to 0xb04869, (0xa7c9 bytes) 2019-12-16T22:46:34.876 INFO:teuthology.orchestra.run.smithi177.stdout:2396 punch from 0x5258da9 to 0x525ab8a, (0x1de1 bytes) 2019-12-16T22:46:34.876 INFO:teuthology.orchestra.run.smithi177.stdout:2397 writesame 0x2596178 thru 0x2597a1c data_size 0x3(0x18a5 bytes) 2019-12-16T22:46:34.909 INFO:teuthology.orchestra.run.smithi177.stdout:2886 trunc from 0xec572c9 to 0xa208565 2019-12-16T22:46:34.919 INFO:teuthology.orchestra.run.smithi177.stdout:2399 read 0xb340c0c thru 0xb3494dc (0x88d1 bytes) 2019-12-16T22:46:34.919 INFO:teuthology.orchestra.run.smithi177.stdout:2400 punch from 0xa7c3437 to 0xa7d29f3, (0xf5bc bytes) 2019-12-16T22:46:34.919 INFO:teuthology.orchestra.run.smithi177.stdout:2401 read 0xaad5ea1 thru 0xaae0555 (0xa6b5 bytes) 2019-12-16T22:46:34.919 INFO:teuthology.orchestra.run.smithi177.stdout:2402 write 0x797f64a thru 0x798d883 (0xe23a bytes) 2019-12-16T22:46:34.942 INFO:teuthology.orchestra.run.smithi177.stdout:2404 writesame 0xad4ba78 thru 0xad5add0 data_size 0x1(0xf359 bytes) 2019-12-16T22:46:35.008 INFO:teuthology.orchestra.run.smithi177.stdout:2405 read 0xba7938f thru 0xba87749 (0xe3bb bytes) 2019-12-16T22:46:35.008 INFO:teuthology.orchestra.run.smithi177.stdout:2406 read 0x92df16d thru 0x92e5d1f (0x6bb3 bytes) 2019-12-16T22:46:35.009 INFO:teuthology.orchestra.run.smithi177.stdout:2407 punch from 0xce5d40c to 0xce64d40, (0x7934 bytes) 2019-12-16T22:46:35.009 INFO:teuthology.orchestra.run.smithi177.stdout:2408 writesame 0xb867063 thru 0xb86715a data_size 0x4(0xf8 bytes) 2019-12-16T22:46:35.015 INFO:teuthology.orchestra.run.smithi177.stdout:2409 read 0xc62b339 thru 0xc635a09 (0xa6d1 bytes) 2019-12-16T22:46:35.016 INFO:teuthology.orchestra.run.smithi177.stdout:2410 read 0x4dbb5ce thru 0x4dcaa8e (0xf4c1 bytes) 2019-12-16T22:46:35.483 INFO:teuthology.orchestra.run.smithi177.stdout:2660 writesame 0x36d8e1a thru 0x36de600 data_size 0xd(0x57e7 bytes) 2019-12-16T22:46:35.486 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:35.487 INFO:teuthology.orchestra.run.smithi177.stdout:2370 write 0x5a845d8 thru 0x5a932a1 (0xecca bytes) 2019-12-16T22:46:35.490 INFO:teuthology.orchestra.run.smithi177.stdout:2413 trunc from 0xe2ff44b to 0xcb4997a 2019-12-16T22:46:35.560 INFO:teuthology.orchestra.run.smithi177.stdout:2661 write 0x86d161d thru 0x86d3770 (0x2154 bytes) 2019-12-16T22:46:35.572 INFO:teuthology.orchestra.run.smithi177.stdout:2664 write 0xba3d84 thru 0xbab565 (0x77e2 bytes) 2019-12-16T22:46:35.573 INFO:teuthology.orchestra.run.smithi177.stdout:3401 writesame 0x40e980a thru 0x40f78dd data_size 0x2(0xe0d4 bytes) 2019-12-16T22:46:35.576 INFO:teuthology.orchestra.run.smithi177.stdout:2887 read 0x17c7e4f thru 0x17cd380 (0x5532 bytes) 2019-12-16T22:46:35.576 INFO:teuthology.orchestra.run.smithi177.stdout:2888 punch from 0x851a09d to 0x851c48b, (0x23ee bytes) 2019-12-16T22:46:35.586 INFO:teuthology.orchestra.run.smithi177.stdout:2372 trunc from 0xdfde0c3 to 0x50c98a7 2019-12-16T22:46:35.594 INFO:teuthology.orchestra.run.smithi177.stdout:2890 trunc from 0xa208565 to 0x1268c1e 2019-12-16T22:46:35.601 INFO:teuthology.orchestra.run.smithi177.stdout:2414 trunc from 0xcb4997a to 0x310c120 2019-12-16T22:46:35.605 INFO:teuthology.orchestra.run.smithi177.stdout:3403 read 0x590cea1 thru 0x59167ee (0x994e bytes) 2019-12-16T22:46:35.617 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:35.638 INFO:teuthology.orchestra.run.smithi177.stdout:2666 write 0x2f0cf12 thru 0x2f0f122 (0x2211 bytes) 2019-12-16T22:46:35.656 INFO:teuthology.orchestra.run.smithi177.stdout:2667 write 0x472efff thru 0x47329f3 (0x39f5 bytes) 2019-12-16T22:46:35.665 INFO:teuthology.orchestra.run.smithi177.stdout:2418 write 0x16e3c74 thru 0x16eb025 (0x73b2 bytes) 2019-12-16T22:46:35.670 INFO:teuthology.orchestra.run.smithi177.stdout:2668 punch from 0x49c3f3f to 0x49c80ff, (0x41c0 bytes) 2019-12-16T22:46:35.671 INFO:teuthology.orchestra.run.smithi177.stdout:2891 read 0xbc721c thru 0xbd6de5 (0xfbca bytes) 2019-12-16T22:46:35.671 INFO:teuthology.orchestra.run.smithi177.stdout:3406 write 0x8bfffb3 thru 0x8c0fa7f (0xfacd bytes) 2019-12-16T22:46:35.674 INFO:teuthology.orchestra.run.smithi177.stdout:2373 trunc from 0x50c98a7 to 0x888a909 2019-12-16T22:46:35.677 INFO:teuthology.orchestra.run.smithi177.stdout:2419 read 0xccfc2 thru 0xd9325 (0xc364 bytes) 2019-12-16T22:46:35.678 INFO:teuthology.orchestra.run.smithi177.stdout:2892 punch from 0xd10d1a to 0xd20276, (0xf55c bytes) 2019-12-16T22:46:35.678 INFO:teuthology.orchestra.run.smithi177.stdout:2893 read 0xfa85c4 thru 0xfaa2a7 (0x1ce4 bytes) 2019-12-16T22:46:35.678 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:35.681 INFO:teuthology.orchestra.run.smithi177.stdout:2669 trunc from 0x86d3771 to 0xd4be168 2019-12-16T22:46:35.684 INFO:teuthology.orchestra.run.smithi177.stdout:3407 writesame 0x80d8684 thru 0x80e31dd data_size 0x9(0xab5a bytes) 2019-12-16T22:46:35.696 INFO:teuthology.orchestra.run.smithi177.stdout:3409 trunc from 0x8c0fa80 to 0x704aed1 2019-12-16T22:46:35.704 INFO:teuthology.orchestra.run.smithi177.stdout:2420 trunc from 0x310c120 to 0xc243a67 2019-12-16T22:46:35.718 INFO:teuthology.orchestra.run.smithi177.stdout:2670 write 0x830af42 thru 0x83127ac (0x786b bytes) 2019-12-16T22:46:35.733 INFO:teuthology.orchestra.run.smithi177.stdout:2374 write 0xd721f1d thru 0xd722895 (0x979 bytes) 2019-12-16T22:46:35.735 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:35.739 INFO:teuthology.orchestra.run.smithi177.stdout:2421 trunc from 0xc243a67 to 0xed31a11 2019-12-16T22:46:35.761 INFO:teuthology.orchestra.run.smithi177.stdout:2672 writesame 0xe473fde thru 0xe48271e data_size 0x1(0xe741 bytes) 2019-12-16T22:46:35.763 INFO:teuthology.orchestra.run.smithi177.stdout:2674 punch from 0x7f0dde to 0x7ffa89, (0xecab bytes) 2019-12-16T22:46:35.763 INFO:teuthology.orchestra.run.smithi177.stdout:2675 read 0x46d78ad thru 0x46da3de (0x2b32 bytes) 2019-12-16T22:46:35.763 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:35.763 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:35.764 INFO:teuthology.orchestra.run.smithi177.stdout:2679 read 0x213201b thru 0x213ff59 (0xdf3f bytes) 2019-12-16T22:46:35.764 INFO:teuthology.orchestra.run.smithi177.stdout:2680 writesame 0x3671e5e thru 0x367dfc2 data_size 0x3(0xc165 bytes) 2019-12-16T22:46:35.785 INFO:teuthology.orchestra.run.smithi177.stdout:2682 read 0x87fa25c thru 0x88037f8 (0x959d bytes) 2019-12-16T22:46:35.785 INFO:teuthology.orchestra.run.smithi177.stdout:2683 write 0x7d5dc88 thru 0x7d6608c (0x8405 bytes) 2019-12-16T22:46:35.786 INFO:teuthology.orchestra.run.smithi177.stdout:2422 trunc from 0xed31a11 to 0x208f40 2019-12-16T22:46:36.025 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:46:36.010+0000 7fa7ae19d700 -1 osd.2 pg_epoch: 76 pg[2.1( v 75'61 (0'0,75'61] local-lis/les=13/14 n=29 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [2,1] r=0 lpr=13 crt=75'61 lcod 74'60 mlcod 74'60 active+clean+snaptrim trimq=[a8~1] ps=[96~1,a4~4]] removing snap head 2019-12-16T22:46:36.035 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:46:36.026+0000 7fa7a7990700 -1 osd.2 pg_epoch: 76 pg[2.1e( v 74'136 (0'0,74'136] local-lis/les=13/14 n=30 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [2,0] r=0 lpr=13 crt=74'136 lcod 74'135 mlcod 74'135 active+clean+snaptrim trimq=[a8~1] ps=[96~1,a4~4]] removing snap head 2019-12-16T22:46:36.035 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:46:36.026+0000 7fa7a9994700 -1 osd.2 pg_epoch: 76 pg[2.12( v 75'174 (0'0,75'174] local-lis/les=13/14 n=37 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [2,1] r=0 lpr=13 crt=75'174 lcod 74'173 mlcod 74'173 active+clean+snaptrim trimq=[a8~1] ps=[96~1,a4~4]] removing snap head 2019-12-16T22:46:36.040 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-16T22:46:36.034+0000 7fa7a9994700 -1 osd.2 pg_epoch: 76 pg[2.32( v 74'137 (0'0,74'137] local-lis/les=13/14 n=34 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [2,1] r=0 lpr=13 crt=74'137 lcod 74'136 mlcod 74'136 active+clean+snaptrim trimq=[a8~1] ps=[96~1,a4~4]] removing snap head 2019-12-16T22:46:36.218 INFO:teuthology.orchestra.run.smithi177.stdout:2686 read 0x503150d thru 0x5040647 (0xf13b bytes) 2019-12-16T22:46:36.218 INFO:teuthology.orchestra.run.smithi177.stdout:2375 trunc from 0xd722896 to 0xd02db2a 2019-12-16T22:46:36.220 INFO:teuthology.orchestra.run.smithi177.stdout:2687 trunc from 0xe48271f to 0xdb703cd 2019-12-16T22:46:36.230 INFO:teuthology.orchestra.run.smithi177.stdout:2897 write 0xea32c11 thru 0xea371a1 (0x4591 bytes) 2019-12-16T22:46:36.263 INFO:teuthology.orchestra.run.smithi177.stdout:2898 writesame 0xd0ec78d thru 0xd0f0eeb data_size 0xb(0x475f bytes) 2019-12-16T22:46:36.265 INFO:teuthology.orchestra.run.smithi177.stdout:3410 write 0xaffdf7d thru 0xb008cd1 (0xad55 bytes) 2019-12-16T22:46:36.274 INFO:teuthology.orchestra.run.smithi177.stdout:2688 write 0x3a1626b thru 0x3a20bce (0xa964 bytes) 2019-12-16T22:46:36.287 INFO:teuthology.orchestra.run.smithi177.stdout:2899 write 0xab8b69c thru 0xab935ed (0x7f52 bytes) 2019-12-16T22:46:36.288 INFO:teuthology.orchestra.run.smithi177.stdout:3411 write 0x22adbff thru 0x22b18a6 (0x3ca8 bytes) 2019-12-16T22:46:36.300 INFO:teuthology.orchestra.run.smithi177.stdout:3412 read 0x38ee47a thru 0x38f2d70 (0x48f7 bytes) 2019-12-16T22:46:36.302 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.302 INFO:teuthology.orchestra.run.smithi177.stdout:3415 write 0x42454b7 thru 0x4255442 (0xff8c bytes) 2019-12-16T22:46:36.306 INFO:teuthology.orchestra.run.smithi177.stdout:2376 read 0x7e3103 thru 0x7e7d2d (0x4c2b bytes) 2019-12-16T22:46:36.310 INFO:teuthology.orchestra.run.smithi177.stdout:2377 read 0x3343b0e thru 0x33500c9 (0xc5bc bytes) 2019-12-16T22:46:36.311 INFO:teuthology.orchestra.run.smithi177.stdout:2378 punch from 0xa691e1a to 0xa695826, (0x3a0c bytes) 2019-12-16T22:46:36.311 INFO:teuthology.orchestra.run.smithi177.stdout:2900 read 0xaf56147 thru 0xaf59333 (0x31ed bytes) 2019-12-16T22:46:36.312 INFO:teuthology.orchestra.run.smithi177.stdout:2441 punch from 0x8fb05b to 0x901e61, (0x6e06 bytes) 2019-12-16T22:46:36.312 INFO:teuthology.orchestra.run.smithi177.stdout:2443 read 0x149bb9b thru 0x14a126e (0x56d4 bytes) 2019-12-16T22:46:36.313 INFO:teuthology.orchestra.run.smithi177.stdout:2901 trunc from 0xea371a2 to 0xddeebf0 2019-12-16T22:46:36.314 INFO:teuthology.orchestra.run.smithi177.stdout:2689 write 0xdaf88c9 thru 0xdb032e2 (0xaa1a bytes) 2019-12-16T22:46:36.319 INFO:teuthology.orchestra.run.smithi177.stdout:2380 trunc from 0xd02db2a to 0x8df1049 2019-12-16T22:46:36.327 INFO:teuthology.orchestra.run.smithi177.stdout:3419 trunc from 0xb008cd2 to 0x69a2494 2019-12-16T22:46:36.336 INFO:teuthology.orchestra.run.smithi177.stdout:2690 read 0x917db65 thru 0x9189ea1 (0xc33d bytes) 2019-12-16T22:46:36.337 INFO:teuthology.orchestra.run.smithi177.stdout:2691 write 0x7f9dfbe thru 0x7fa3e4f (0x5e92 bytes) 2019-12-16T22:46:36.349 INFO:teuthology.orchestra.run.smithi177.stdout:2692 read 0x31752e1 thru 0x31786df (0x33ff bytes) 2019-12-16T22:46:36.349 INFO:teuthology.orchestra.run.smithi177.stdout:2693 writesame 0xbc467fc thru 0xbc4c200 data_size 0xb(0x5a05 bytes) 2019-12-16T22:46:36.350 INFO:teuthology.orchestra.run.smithi177.stdout:2902 punch from 0x3249003 to 0x324fe4c, (0x6e49 bytes) 2019-12-16T22:46:36.350 INFO:teuthology.orchestra.run.smithi177.stdout:2904 read 0x6053d77 thru 0x605adb5 (0x703f bytes) 2019-12-16T22:46:36.350 INFO:teuthology.orchestra.run.smithi177.stdout:2908 read 0x2f37db0 thru 0x2f39ed3 (0x2124 bytes) 2019-12-16T22:46:36.350 INFO:teuthology.orchestra.run.smithi177.stdout:2910 read 0x5bc8f0b thru 0x5bc96f2 (0x7e8 bytes) 2019-12-16T22:46:36.351 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.351 INFO:teuthology.orchestra.run.smithi177.stdout:2912 read 0x9aa842b thru 0x9aaa949 (0x251f bytes) 2019-12-16T22:46:36.351 INFO:teuthology.orchestra.run.smithi177.stdout:2913 writesame 0xd7a10fe thru 0xd7a6905 data_size 0x24(0x5808 bytes) 2019-12-16T22:46:36.359 INFO:teuthology.orchestra.run.smithi177.stdout:2444 write 0xddae542 thru 0xddb5ffa (0x7ab9 bytes) 2019-12-16T22:46:36.359 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.360 INFO:teuthology.orchestra.run.smithi177.stdout:2915 punch from 0xc2b2a9a to 0xc2c12cd, (0xe833 bytes) 2019-12-16T22:46:36.360 INFO:teuthology.orchestra.run.smithi177.stdout:2918 read 0x31f4660 thru 0x31fdbed (0x958e bytes) 2019-12-16T22:46:36.360 INFO:teuthology.orchestra.run.smithi177.stdout:2919 read 0xdc2aa82 thru 0xdc2de10 (0x338f bytes) 2019-12-16T22:46:36.360 INFO:teuthology.orchestra.run.smithi177.stdout:2920 writesame 0x456895b thru 0x456ecb2 data_size 0x11(0x6358 bytes) 2019-12-16T22:46:36.369 INFO:teuthology.orchestra.run.smithi177.stdout:2446 writesame 0x5d58f30 thru 0x5d5d131 data_size 0x22(0x4202 bytes) 2019-12-16T22:46:36.369 INFO:teuthology.orchestra.run.smithi177.stdout:2694 write 0xd2b5539 thru 0xd2be5b7 (0x907f bytes) 2019-12-16T22:46:36.374 INFO:teuthology.orchestra.run.smithi177.stdout:2381 trunc from 0x8df1049 to 0x241ce7 2019-12-16T22:46:36.375 INFO:teuthology.orchestra.run.smithi177.stdout:2921 read 0x81ba0b0 thru 0x81c5d8f (0xbce0 bytes) 2019-12-16T22:46:36.375 INFO:teuthology.orchestra.run.smithi177.stdout:2922 write 0xc5a943b thru 0xc5ade9f (0x4a65 bytes) 2019-12-16T22:46:36.379 INFO:teuthology.orchestra.run.smithi177.stdout:2449 writesame 0xabd4ded thru 0xabda36d data_size 0x7(0x5581 bytes) 2019-12-16T22:46:36.393 INFO:teuthology.orchestra.run.smithi177.stdout:2923 read 0x5a255aa thru 0x5a33004 (0xda5b bytes) 2019-12-16T22:46:36.395 INFO:teuthology.orchestra.run.smithi177.stdout:2450 write 0x5b4119f thru 0x5b47e0a (0x6c6c bytes) 2019-12-16T22:46:36.406 INFO:teuthology.orchestra.run.smithi177.stdout:2697 write 0xce2c7e9 thru 0xce3465f (0x7e77 bytes) 2019-12-16T22:46:36.407 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.412 INFO:teuthology.orchestra.run.smithi177.stdout:2452 write 0x9567954 thru 0x956d49c (0x5b49 bytes) 2019-12-16T22:46:36.413 INFO:teuthology.orchestra.run.smithi177.stdout:2924 trunc from 0xddeebf0 to 0x6ea7190 2019-12-16T22:46:36.413 INFO:teuthology.orchestra.run.smithi177.stdout:3420 write 0xa834e53 thru 0xa83e7fa (0x99a8 bytes) 2019-12-16T22:46:36.425 INFO:teuthology.orchestra.run.smithi177.stdout:2453 read 0xcbd910a thru 0xcbdb05c (0x1f53 bytes) 2019-12-16T22:46:36.425 INFO:teuthology.orchestra.run.smithi177.stdout:2454 read 0x963e0d5 thru 0x963ef74 (0xea0 bytes) 2019-12-16T22:46:36.426 INFO:teuthology.orchestra.run.smithi177.stdout:2455 trunc from 0xddb5ffb to 0xe8907d5 2019-12-16T22:46:36.426 INFO:teuthology.orchestra.run.smithi177.stdout:2698 write 0x4b9b45c thru 0x4b9ee9b (0x3a40 bytes) 2019-12-16T22:46:36.436 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.444 INFO:teuthology.orchestra.run.smithi177.stdout:2699 read 0x6435c49 thru 0x6440e9a (0xb252 bytes) 2019-12-16T22:46:36.444 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.454 INFO:teuthology.orchestra.run.smithi177.stdout:3422 write 0xd45b258 thru 0xd462e45 (0x7bee bytes) 2019-12-16T22:46:36.455 INFO:teuthology.orchestra.run.smithi177.stdout:2383 write 0x55bde1 thru 0x55ed78 (0x2f98 bytes) 2019-12-16T22:46:36.456 INFO:teuthology.orchestra.run.smithi177.stdout:2701 trunc from 0xdb703cd to 0x84e725e 2019-12-16T22:46:36.460 INFO:teuthology.orchestra.run.smithi177.stdout:2925 punch from 0x1d0a875 to 0x1d1556e, (0xacf9 bytes) 2019-12-16T22:46:36.460 INFO:teuthology.orchestra.run.smithi177.stdout:2928 read 0x30792a1 thru 0x307b528 (0x2288 bytes) 2019-12-16T22:46:36.460 INFO:teuthology.orchestra.run.smithi177.stdout:2929 clone 19 order 24 su 131072 sc 8 2019-12-16T22:46:36.461 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.462 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.462 INFO:teuthology.orchestra.run.smithi177.stdout:2459 writesame 0x3170f80 thru 0x31713f7 data_size 0xd(0x478 bytes) 2019-12-16T22:46:36.469 INFO:teuthology.orchestra.run.smithi177.stdout:3425 write 0x5edac29 thru 0x5ee1814 (0x6bec bytes) 2019-12-16T22:46:36.477 INFO:teuthology.orchestra.run.smithi177.stdout:2460 punch from 0x58fd0bd to 0x59018cb, (0x480e bytes) 2019-12-16T22:46:36.477 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.477 INFO:teuthology.orchestra.run.smithi177.stdout:2463 writesame 0x6c1ebc thru 0x6c9da8 data_size 0x1(0x7eed bytes) 2019-12-16T22:46:36.494 INFO:teuthology.orchestra.run.smithi177.stdout:2385 read 0xf3fed thru 0x103981 (0xf995 bytes) 2019-12-16T22:46:36.496 INFO:teuthology.orchestra.run.smithi177.stdout:3427 trunc from 0xd462e46 to 0xd5fdbd9 2019-12-16T22:46:36.512 INFO:teuthology.orchestra.run.smithi177.stdout:2464 trunc from 0xe8907d5 to 0xb0b718a 2019-12-16T22:46:36.518 INFO:teuthology.orchestra.run.smithi177.stdout:2386 trunc from 0x55ed79 to 0xa8f97e6 2019-12-16T22:46:36.527 INFO:teuthology.orchestra.run.smithi177.stdout:3429 read 0x31b92 thru 0x3d117 (0xb586 bytes) 2019-12-16T22:46:36.532 INFO:teuthology.orchestra.run.smithi177.stdout:3430 write 0x5c70a37 thru 0x5c7dcbc (0xd286 bytes) 2019-12-16T22:46:36.551 INFO:teuthology.orchestra.run.smithi177.stdout:2702 write 0xc28bc15 thru 0xc28e971 (0x2d5d bytes) 2019-12-16T22:46:36.552 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.552 INFO:teuthology.orchestra.run.smithi177.stdout:2389 punch from 0x8264a5a to 0x8268884, (0x3e2a bytes) 2019-12-16T22:46:36.552 INFO:teuthology.orchestra.run.smithi177.stdout:2394 writesame 0x11eff39 thru 0x11fe9db data_size 0x1(0xeaa3 bytes) 2019-12-16T22:46:36.562 INFO:teuthology.orchestra.run.smithi177.stdout:3432 trunc from 0xd5fdbd9 to 0x2385975 2019-12-16T22:46:36.563 INFO:teuthology.orchestra.run.smithi177.stdout:2466 trunc from 0xb0b718a to 0x286d37d 2019-12-16T22:46:36.573 INFO:teuthology.orchestra.run.smithi177.stdout:2703 trunc from 0xc28e972 to 0xe81869b 2019-12-16T22:46:36.613 INFO:teuthology.orchestra.run.smithi177.stdout:2395 writesame 0x43e6d79 thru 0x43ee311 data_size 0x1(0x7599 bytes) 2019-12-16T22:46:36.629 INFO:teuthology.orchestra.run.smithi177.stdout:2704 write 0xce5ea4 thru 0xcebafd (0x5c5a bytes) 2019-12-16T22:46:36.650 INFO:teuthology.orchestra.run.smithi177.stdout:2705 read 0x6c3a926 thru 0x6c3e019 (0x36f4 bytes) 2019-12-16T22:46:36.651 INFO:teuthology.orchestra.run.smithi177.stdout:2706 write 0x8fc5dcd thru 0x8fd1c03 (0xbe37 bytes) 2019-12-16T22:46:36.665 INFO:teuthology.orchestra.run.smithi177.stdout:2467 write 0x86bb187 thru 0x86bf255 (0x40cf bytes) 2019-12-16T22:46:36.666 INFO:teuthology.orchestra.run.smithi177.stdout:2396 write 0x2f39f62 thru 0x2f48914 (0xe9b3 bytes) 2019-12-16T22:46:36.677 INFO:teuthology.orchestra.run.smithi177.stdout:3433 write 0xeb4e778 thru 0xeb54f0b (0x6794 bytes) 2019-12-16T22:46:36.682 INFO:teuthology.orchestra.run.smithi177.stdout:2707 read 0xcdc7918 thru 0xcdcef49 (0x7632 bytes) 2019-12-16T22:46:36.684 INFO:teuthology.orchestra.run.smithi177.stdout:2708 flatten 2019-12-16T22:46:36.692 INFO:teuthology.orchestra.run.smithi177.stdout:2423 punch from 0x45c3b to 0x5456f, (0xe934 bytes) 2019-12-16T22:46:36.699 INFO:teuthology.orchestra.run.smithi177.stdout:3434 trunc from 0xeb54f0c to 0xadc345e 2019-12-16T22:46:36.701 INFO:teuthology.orchestra.run.smithi177.stdout:2468 trunc from 0x86bf256 to 0x645c0b 2019-12-16T22:46:36.704 INFO:teuthology.orchestra.run.smithi177.stdout:2397 write 0x7fbd3af thru 0x7fc8070 (0xacc2 bytes) 2019-12-16T22:46:36.727 INFO:teuthology.orchestra.run.smithi177.stdout:2424 write 0x23f70e4 thru 0x23f736e (0x28b bytes) 2019-12-16T22:46:36.733 INFO:teuthology.orchestra.run.smithi177.stdout:2709 read 0x34c2360 thru 0x34c3d0e (0x19af bytes) 2019-12-16T22:46:36.734 INFO:teuthology.orchestra.run.smithi177.stdout:2710 read 0xa9a224d thru 0xa9aad74 (0x8b28 bytes) 2019-12-16T22:46:36.735 INFO:teuthology.orchestra.run.smithi177.stdout:2713 writesame 0xc6cb660 thru 0xc6cec30 data_size 0x1(0x35d1 bytes) 2019-12-16T22:46:36.741 INFO:teuthology.orchestra.run.smithi177.stdout:3436 read 0x55ab20e thru 0x55b71c6 (0xbfb9 bytes) 2019-12-16T22:46:36.741 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.741 INFO:teuthology.orchestra.run.smithi177.stdout:3438 writesame 0x7f86952 thru 0x7f8f4ca data_size 0x25(0x8b79 bytes) 2019-12-16T22:46:36.751 INFO:teuthology.orchestra.run.smithi177.stdout:3440 read 0x36bfeca thru 0x36c3dcb (0x3f02 bytes) 2019-12-16T22:46:36.752 INFO:teuthology.orchestra.run.smithi177.stdout:3441 read 0x3dd97da thru 0x3de3d79 (0xa5a0 bytes) 2019-12-16T22:46:36.752 INFO:teuthology.orchestra.run.smithi177.stdout:3442 read 0x3641a39 thru 0x364363c (0x1c04 bytes) 2019-12-16T22:46:36.753 INFO:teuthology.orchestra.run.smithi177.stdout:3444 read 0x4b2aefb thru 0x4b354ff (0xa605 bytes) 2019-12-16T22:46:36.753 INFO:teuthology.orchestra.run.smithi177.stdout:2399 punch from 0x2c07a53 to 0x2c10849, (0x8df6 bytes) 2019-12-16T22:46:36.754 INFO:teuthology.orchestra.run.smithi177.stdout:2400 write 0x2a25008 thru 0x2a2504e (0x47 bytes) 2019-12-16T22:46:36.754 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.754 INFO:teuthology.orchestra.run.smithi177.stdout:3446 read 0x3c34cf7 thru 0x3c41cc1 (0xcfcb bytes) 2019-12-16T22:46:36.755 INFO:teuthology.orchestra.run.smithi177.stdout:3447 trunc from 0xadc345e to 0xb22e684 2019-12-16T22:46:36.765 INFO:teuthology.orchestra.run.smithi177.stdout:2716 trunc from 0xe81869b to 0x9b6abed 2019-12-16T22:46:36.767 INFO:teuthology.orchestra.run.smithi177.stdout:2401 trunc from 0xa8f97e6 to 0xe72051a 2019-12-16T22:46:36.771 INFO:teuthology.orchestra.run.smithi177.stdout:2469 trunc from 0x645c0b to 0x501fab9 2019-12-16T22:46:36.775 INFO:teuthology.orchestra.run.smithi177.stdout:3449 punch from 0x5035ebc to 0x503d3a9, (0x74ed bytes) 2019-12-16T22:46:36.775 INFO:teuthology.orchestra.run.smithi177.stdout:3453 punch from 0x450114d to 0x4504347, (0x31fa bytes) 2019-12-16T22:46:36.775 INFO:teuthology.orchestra.run.smithi177.stdout:3454 read 0x3525bb5 thru 0x352ee71 (0x92bd bytes) 2019-12-16T22:46:36.779 INFO:teuthology.orchestra.run.smithi177.stdout:3455 trunc from 0xb22e684 to 0xce1501f 2019-12-16T22:46:36.781 INFO:teuthology.orchestra.run.smithi177.stdout:2425 write 0xa7a147c thru 0xa7aeb0b (0xd690 bytes) 2019-12-16T22:46:36.790 INFO:teuthology.orchestra.run.smithi177.stdout:2470 read 0xc6929 thru 0xc9c46 (0x331e bytes) 2019-12-16T22:46:36.790 INFO:teuthology.orchestra.run.smithi177.stdout:2402 read 0xdef6569 thru 0xdf0148c (0xaf24 bytes) 2019-12-16T22:46:36.791 INFO:teuthology.orchestra.run.smithi177.stdout:2403 writesame 0xae35603 thru 0xae4238a data_size 0x4(0xcd88 bytes) 2019-12-16T22:46:36.791 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.796 INFO:teuthology.orchestra.run.smithi177.stdout:3456 read 0x752c526 thru 0x75356dd (0x91b8 bytes) 2019-12-16T22:46:36.796 INFO:teuthology.orchestra.run.smithi177.stdout:3458 write 0x1e3d88e thru 0x1e4cbfd (0xf370 bytes) 2019-12-16T22:46:36.797 INFO:teuthology.orchestra.run.smithi177.stdout:2427 write 0x5ad40cf thru 0x5add350 (0x9282 bytes) 2019-12-16T22:46:36.804 INFO:teuthology.orchestra.run.smithi177.stdout:2717 clone 24 order 19 su 2048 sc 11 2019-12-16T22:46:36.812 INFO:teuthology.orchestra.run.smithi177.stdout:2428 write 0x99e2e21 thru 0x99ecdad (0x9f8d bytes) 2019-12-16T22:46:36.831 INFO:teuthology.orchestra.run.smithi177.stdout:2473 writesame 0xa82690b thru 0xa82e995 data_size 0x7(0x808b bytes) 2019-12-16T22:46:36.834 INFO:teuthology.orchestra.run.smithi177.stdout:2474 read 0x774da10 thru 0x7757db4 (0xa3a5 bytes) 2019-12-16T22:46:36.834 INFO:teuthology.orchestra.run.smithi177.stdout:2475 writesame 0x269c1b3 thru 0x26a11ee data_size 0x14(0x503c bytes) 2019-12-16T22:46:36.840 INFO:teuthology.orchestra.run.smithi177.stdout:2429 punch from 0x766e21c to 0x767564d, (0x7431 bytes) 2019-12-16T22:46:36.840 INFO:teuthology.orchestra.run.smithi177.stdout:2430 read 0x793071f thru 0x79397a2 (0x9084 bytes) 2019-12-16T22:46:36.840 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.840 INFO:teuthology.orchestra.run.smithi177.stdout:2434 read 0x9802664 thru 0x980a497 (0x7e34 bytes) 2019-12-16T22:46:36.841 INFO:teuthology.orchestra.run.smithi177.stdout:2436 read 0x162e21f thru 0x1636df6 (0x8bd8 bytes) 2019-12-16T22:46:36.841 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.841 INFO:teuthology.orchestra.run.smithi177.stdout:2439 write 0xb8221f thru 0xb86858 (0x463a bytes) 2019-12-16T22:46:36.842 INFO:teuthology.orchestra.run.smithi177.stdout:3460 write 0xd235b09 thru 0xd23d1d3 (0x76cb bytes) 2019-12-16T22:46:36.842 INFO:teuthology.orchestra.run.smithi177.stdout:2476 writesame 0x9fdf549 thru 0x9fe11d8 data_size 0x8(0x1c90 bytes) 2019-12-16T22:46:36.842 INFO:teuthology.orchestra.run.smithi177.stdout:2404 writesame 0x85853e0 thru 0x8590914 data_size 0x15(0xb535 bytes) 2019-12-16T22:46:36.846 INFO:teuthology.orchestra.run.smithi177.stdout:3461 punch from 0xf228d6 to 0xf22b94, (0x2be bytes) 2019-12-16T22:46:36.846 INFO:teuthology.orchestra.run.smithi177.stdout:3462 write 0xa583dfd thru 0xa58b037 (0x723b bytes) 2019-12-16T22:46:36.852 INFO:teuthology.orchestra.run.smithi177.stdout:2441 read 0x37aaf00 thru 0x37afc52 (0x4d53 bytes) 2019-12-16T22:46:36.855 INFO:teuthology.orchestra.run.smithi177.stdout:2442 trunc from 0xa7aeb0c to 0x944c3eb 2019-12-16T22:46:36.861 INFO:teuthology.orchestra.run.smithi177.stdout:3464 punch from 0x8f88957 to 0x8f983de, (0xfa87 bytes) 2019-12-16T22:46:36.861 INFO:teuthology.orchestra.run.smithi177.stdout:3465 read 0x7c5115b thru 0x7c5237b (0x1221 bytes) 2019-12-16T22:46:36.861 INFO:teuthology.orchestra.run.smithi177.stdout:3466 writesame 0x4ff122 thru 0x4ffd1c data_size 0x1(0xbfb bytes) 2019-12-16T22:46:36.870 INFO:teuthology.orchestra.run.smithi177.stdout:3467 write 0xc8a25b7 thru 0xc8b0c80 (0xe6ca bytes) 2019-12-16T22:46:36.873 INFO:teuthology.orchestra.run.smithi177.stdout:2477 trunc from 0xa82e996 to 0x6613ad 2019-12-16T22:46:36.887 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.887 INFO:teuthology.orchestra.run.smithi177.stdout:2406 punch from 0x66a333e to 0x66a8112, (0x4dd4 bytes) 2019-12-16T22:46:36.887 INFO:teuthology.orchestra.run.smithi177.stdout:2407 read 0x592bcb3 thru 0x5939bcb (0xdf19 bytes) 2019-12-16T22:46:36.896 INFO:teuthology.orchestra.run.smithi177.stdout:2408 trunc from 0xe72051a to 0x9a7501f 2019-12-16T22:46:36.903 INFO:teuthology.orchestra.run.smithi177.stdout:3468 write 0xeb83ed3 thru 0xeb8a7c4 (0x68f2 bytes) 2019-12-16T22:46:36.910 INFO:teuthology.orchestra.run.smithi177.stdout:3470 read 0x3164e38 thru 0x3170f0c (0xc0d5 bytes) 2019-12-16T22:46:36.911 INFO:teuthology.orchestra.run.smithi177.stdout:3471 read 0xbee61a8 thru 0xbee9c30 (0x3a89 bytes) 2019-12-16T22:46:36.912 INFO:teuthology.orchestra.run.smithi177.stdout:3473 writesame 0x22ee562 thru 0x22f1447 data_size 0x45(0x2ee6 bytes) 2019-12-16T22:46:36.912 INFO:teuthology.orchestra.run.smithi177.stdout:2478 read 0x1d2d9f thru 0x1db15a (0x83bc bytes) 2019-12-16T22:46:36.913 INFO:teuthology.orchestra.run.smithi177.stdout:2481 read 0x589b0e thru 0x598abd (0xefb0 bytes) 2019-12-16T22:46:36.923 INFO:teuthology.orchestra.run.smithi177.stdout:3474 read 0x227ba20 thru 0x227f488 (0x3a69 bytes) 2019-12-16T22:46:36.923 INFO:teuthology.orchestra.run.smithi177.stdout:3475 writesame 0x211148b thru 0x2117c91 data_size 0x21(0x6807 bytes) 2019-12-16T22:46:36.923 INFO:teuthology.orchestra.run.smithi177.stdout:3476 clone 19 order 23 su 65536 sc 15 2019-12-16T22:46:36.925 INFO:teuthology.orchestra.run.smithi177.stdout:2443 writesame 0xd9dd9ac thru 0xd9e2afa data_size 0x17(0x514f bytes) 2019-12-16T22:46:36.927 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.927 INFO:teuthology.orchestra.run.smithi177.stdout:2446 read 0x188a586 thru 0x1896d8e (0xc809 bytes) 2019-12-16T22:46:36.930 INFO:teuthology.orchestra.run.smithi177.stdout:2409 read 0x86807a3 thru 0x868695f (0x61bd bytes) 2019-12-16T22:46:36.932 INFO:teuthology.orchestra.run.smithi177.stdout:2483 write 0xae83b5 thru 0xaef491 (0x70dd bytes) 2019-12-16T22:46:36.947 INFO:teuthology.orchestra.run.smithi177.stdout:2410 trunc from 0x9a7501f to 0xd7d0448 2019-12-16T22:46:36.953 INFO:teuthology.orchestra.run.smithi177.stdout:2484 trunc from 0xaef492 to 0x7f64b46 2019-12-16T22:46:36.959 INFO:teuthology.orchestra.run.smithi177.stdout:2447 trunc from 0xd9e2afb to 0x22b47e 2019-12-16T22:46:36.964 INFO:teuthology.orchestra.run.smithi177.stdout:2412 read 0x8f9acd2 thru 0x8f9f08c (0x43bb bytes) 2019-12-16T22:46:36.965 INFO:teuthology.orchestra.run.smithi177.stdout:2413 writesame 0xa41d772 thru 0xa428706 data_size 0x1(0xaf95 bytes) 2019-12-16T22:46:36.975 INFO:teuthology.orchestra.run.smithi177.stdout:2489 write 0x705c93f thru 0x7060953 (0x4015 bytes) 2019-12-16T22:46:36.987 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.987 INFO:teuthology.orchestra.run.smithi177.stdout:2491 writesame 0x45a15e8 thru 0x45a9c6d data_size 0x43(0x8686 bytes) 2019-12-16T22:46:36.994 INFO:teuthology.orchestra.run.smithi177.stdout:2492 write 0x89afcf thru 0x8a775b (0xc78d bytes) 2019-12-16T22:46:36.994 INFO:teuthology.orchestra.run.smithi177.stdout:2448 read 0x1c6537 thru 0x1ca4a0 (0x3f6a bytes) 2019-12-16T22:46:36.997 INFO:teuthology.orchestra.run.smithi177.stdout:2449 read 0x131ea5 thru 0x139bac (0x7d08 bytes) 2019-12-16T22:46:36.998 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.998 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:36.998 INFO:teuthology.orchestra.run.smithi177.stdout:2453 read 0x32ecd thru 0x3fb8e (0xccc2 bytes) 2019-12-16T22:46:36.999 INFO:teuthology.orchestra.run.smithi177.stdout:2454 punch from 0x3210d to 0x3511f, (0x3012 bytes) 2019-12-16T22:46:37.003 INFO:teuthology.orchestra.run.smithi177.stdout:2494 writesame 0x13cf881 thru 0x13d0107 data_size 0x1(0x887 bytes) 2019-12-16T22:46:37.005 INFO:teuthology.orchestra.run.smithi177.stdout:2414 punch from 0x5da94a1 to 0x5db6a46, (0xd5a5 bytes) 2019-12-16T22:46:37.006 INFO:teuthology.orchestra.run.smithi177.stdout:2415 clone 25 order 19 su 262144 sc 5 2019-12-16T22:46:37.008 INFO:teuthology.orchestra.run.smithi177.stdout:2495 punch from 0x4b19e06 to 0x4b1ad9e, (0xf98 bytes) 2019-12-16T22:46:37.008 INFO:teuthology.orchestra.run.smithi177.stdout:2496 read 0x1dc4705 thru 0x1dc56c8 (0xfc4 bytes) 2019-12-16T22:46:37.009 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.009 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.009 INFO:teuthology.orchestra.run.smithi177.stdout:2500 write 0x1738653 thru 0x173d352 (0x4d00 bytes) 2019-12-16T22:46:37.013 INFO:teuthology.orchestra.run.smithi177.stdout:2501 punch from 0x51d36eb to 0x51e36e6, (0xfffb bytes) 2019-12-16T22:46:37.013 INFO:teuthology.orchestra.run.smithi177.stdout:2502 write 0x463ff40 thru 0x4647211 (0x72d2 bytes) 2019-12-16T22:46:37.017 INFO:teuthology.orchestra.run.smithi177.stdout:2504 write 0x16f6dc6 thru 0x1701dff (0xb03a bytes) 2019-12-16T22:46:37.022 INFO:teuthology.orchestra.run.smithi177.stdout:2505 punch from 0x3d24be0 to 0x3d2e940, (0x9d60 bytes) 2019-12-16T22:46:37.044 INFO:teuthology.orchestra.run.smithi177.stdout:2455 writesame 0xe8ab91f thru 0xe8b4dcf data_size 0x17(0x94b1 bytes) 2019-12-16T22:46:37.046 INFO:teuthology.orchestra.run.smithi177.stdout:2457 read 0x5489309 thru 0x548e123 (0x4e1b bytes) 2019-12-16T22:46:37.047 INFO:teuthology.orchestra.run.smithi177.stdout:2458 write 0xb3a9a82 thru 0xb3b8361 (0xe8e0 bytes) 2019-12-16T22:46:37.053 INFO:teuthology.orchestra.run.smithi177.stdout:2506 writesame 0xbf7d78b thru 0xbf8c38a data_size 0x40(0xec00 bytes) 2019-12-16T22:46:37.057 INFO:teuthology.orchestra.run.smithi177.stdout:2507 punch from 0x8ddd3b5 to 0x8de7124, (0x9d6f bytes) 2019-12-16T22:46:37.058 INFO:teuthology.orchestra.run.smithi177.stdout:2508 write 0x6c66446 thru 0x6c6e06e (0x7c29 bytes) 2019-12-16T22:46:37.072 INFO:teuthology.orchestra.run.smithi177.stdout:2509 punch from 0x4a3c084 to 0x4a48481, (0xc3fd bytes) 2019-12-16T22:46:37.072 INFO:teuthology.orchestra.run.smithi177.stdout:2510 write 0x76e58ef thru 0x76e89c9 (0x30db bytes) 2019-12-16T22:46:37.076 INFO:teuthology.orchestra.run.smithi177.stdout:2511 read 0x332a5e9 thru 0x333989a (0xf2b2 bytes) 2019-12-16T22:46:37.077 INFO:teuthology.orchestra.run.smithi177.stdout:2512 punch from 0x1717d67 to 0x1719071, (0x130a bytes) 2019-12-16T22:46:37.078 INFO:teuthology.orchestra.run.smithi177.stdout:2460 trunc from 0xe8b4dd0 to 0xad54b8a 2019-12-16T22:46:37.088 INFO:teuthology.orchestra.run.smithi177.stdout:2513 trunc from 0xbf8c38b to 0x76d9d98 2019-12-16T22:46:37.117 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.118+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:37.119 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.118+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:37.119 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.118+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:37.121 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.122+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:37.121 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.122+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:37.150 INFO:teuthology.orchestra.run.smithi177.stdout:2461 read 0x38688e3 thru 0x3876781 (0xde9f bytes) 2019-12-16T22:46:37.159 INFO:teuthology.orchestra.run.smithi177.stdout:2514 punch from 0x6afbc97 to 0x6afcc7a, (0xfe3 bytes) 2019-12-16T22:46:37.162 INFO:teuthology.orchestra.run.smithi177.stdout:2515 trunc from 0x76d9d98 to 0x6122fbc 2019-12-16T22:46:37.189 INFO:teuthology.orchestra.run.smithi177.stdout:2462 writesame 0xb489c79 thru 0xb48a171 data_size 0x1(0x4f9 bytes) 2019-12-16T22:46:37.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a362d2fb50 2019-12-16T22:46:37.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a3630afee0 2019-12-16T22:46:37.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a3645047d0 2019-12-16T22:46:37.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a3686f4150 2019-12-16T22:46:37.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a368b908a0 2019-12-16T22:46:37.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:46:37.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36a9fba00 2019-12-16T22:46:37.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:46:37.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc72b60 2019-12-16T22:46:37.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:46:37.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:46:37.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36c55c000 2019-12-16T22:46:37.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:46:37.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a36fd13930 2019-12-16T22:46:37.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:46:37.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a378399c20 2019-12-16T22:46:37.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:46:37.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a3798111e0 2019-12-16T22:46:37.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.198+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51040 2019-12-16T22:46:37.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:46:37.202+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51a00 2019-12-16T22:46:37.202 INFO:teuthology.orchestra.run.smithi177.stdout:2516 trunc from 0x6122fbc to 0x7b59986 2019-12-16T22:46:37.202 INFO:teuthology.orchestra.run.smithi177.stdout:2463 read 0x699981e thru 0x699e43e (0x4c21 bytes) 2019-12-16T22:46:37.203 INFO:teuthology.orchestra.run.smithi177.stdout:2464 writesame 0xa70ce30 thru 0xa71a4f1 data_size 0x77(0xd6c2 bytes) 2019-12-16T22:46:37.220 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a12ba1cf0 2019-12-16T22:46:37.220 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a13addc70 2019-12-16T22:46:37.220 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a150c84e0 2019-12-16T22:46:37.220 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a150c8ea0 2019-12-16T22:46:37.220 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a150c9ba0 2019-12-16T22:46:37.221 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a150cb260 2019-12-16T22:46:37.221 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a182b89c0 2019-12-16T22:46:37.221 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a182ba080 2019-12-16T22:46:37.221 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a196ad110 2019-12-16T22:46:37.221 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a196aebe0 2019-12-16T22:46:37.222 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a197b6750 2019-12-16T22:46:37.222 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e5b0 2019-12-16T22:46:37.222 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:37.222 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9450 2019-12-16T22:46:37.222 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9d40 2019-12-16T22:46:37.222 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:37.222 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:37.223 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:37.223 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1e5c6b10 2019-12-16T22:46:37.223 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fb520 2019-12-16T22:46:37.223 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:37.223 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:37.223 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a24378750 2019-12-16T22:46:37.224 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a24379110 2019-12-16T22:46:37.224 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a249dc630 2019-12-16T22:46:37.224 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a2686be10 2019-12-16T22:46:37.224 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:37.224 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:37.218+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:37.232 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.233 INFO:teuthology.orchestra.run.smithi177.stdout:2467 write 0x130956b thru 0x1314e44 (0xb8da bytes) 2019-12-16T22:46:37.239 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.239 INFO:teuthology.orchestra.run.smithi177.stdout:2518 trunc from 0x7b59986 to 0x7c12689 2019-12-16T22:46:37.248 INFO:teuthology.orchestra.run.smithi177.stdout:2468 write 0x1dd16a4 thru 0x1dd2c30 (0x158d bytes) 2019-12-16T22:46:37.255 INFO:teuthology.orchestra.run.smithi177.stdout:2471 read 0x9b50ea6 thru 0x9b5d1ae (0xc309 bytes) 2019-12-16T22:46:37.256 INFO:teuthology.orchestra.run.smithi177.stdout:2472 punch from 0xb1d858f to 0xb1e0e85, (0x88f6 bytes) 2019-12-16T22:46:37.256 INFO:teuthology.orchestra.run.smithi177.stdout:2473 punch from 0x3974742 to 0x39773e2, (0x2ca0 bytes) 2019-12-16T22:46:37.256 INFO:teuthology.orchestra.run.smithi177.stdout:2476 write 0xec9183 thru 0xec95fb (0x479 bytes) 2019-12-16T22:46:37.262 INFO:teuthology.orchestra.run.smithi177.stdout:2520 read 0x45fe0ef thru 0x4609467 (0xb379 bytes) 2019-12-16T22:46:37.262 INFO:teuthology.orchestra.run.smithi177.stdout:2477 punch from 0x85a4aea to 0x85b17f7, (0xcd0d bytes) 2019-12-16T22:46:37.262 INFO:teuthology.orchestra.run.smithi177.stdout:2522 read 0x68824a9 thru 0x688909d (0x6bf5 bytes) 2019-12-16T22:46:37.263 INFO:teuthology.orchestra.run.smithi177.stdout:2523 write 0x6528dc1 thru 0x652d61b (0x485b bytes) 2019-12-16T22:46:37.273 INFO:teuthology.orchestra.run.smithi177.stdout:2526 read 0x2b17b94 thru 0x2b1f999 (0x7e06 bytes) 2019-12-16T22:46:37.273 INFO:teuthology.orchestra.run.smithi177.stdout:2528 read 0x1172c5b thru 0x1174018 (0x13be bytes) 2019-12-16T22:46:37.274 INFO:teuthology.orchestra.run.smithi177.stdout:2530 read 0x9b0d70 thru 0x9ba5a6 (0x9837 bytes) 2019-12-16T22:46:37.274 INFO:teuthology.orchestra.run.smithi177.stdout:2531 write 0x1e1450 thru 0x1eb420 (0x9fd1 bytes) 2019-12-16T22:46:37.284 INFO:teuthology.orchestra.run.smithi177.stdout:2532 read 0xfa7941 thru 0xfad7c8 (0x5e88 bytes) 2019-12-16T22:46:37.285 INFO:teuthology.orchestra.run.smithi177.stdout:2534 punch from 0x4df7904 to 0x4e01c4e, (0xa34a bytes) 2019-12-16T22:46:37.285 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.285 INFO:teuthology.orchestra.run.smithi177.stdout:2536 clone 25 order 24 su 262144 sc 14 2019-12-16T22:46:37.292 INFO:teuthology.orchestra.run.smithi177.stdout:2478 write 0xcc51a01 thru 0xcc5c28b (0xa88b bytes) 2019-12-16T22:46:37.296 INFO:teuthology.orchestra.run.smithi177.stdout:truncating image image_cluster1.client.mirror.2-clone24 from 0xd7d0448 (overlap 0x3e83e) to 0x19018 2019-12-16T22:46:37.317 INFO:teuthology.orchestra.run.smithi177.stdout:2479 write 0xc1a0382 thru 0xc1a254b (0x21ca bytes) 2019-12-16T22:46:37.331 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.331 INFO:teuthology.orchestra.run.smithi177.stdout:2483 write 0x27ae98 thru 0x27b919 (0xa82 bytes) 2019-12-16T22:46:37.340 INFO:teuthology.orchestra.run.smithi177.stdout:2485 punch from 0xb2494d to 0xb3425c, (0xf90f bytes) 2019-12-16T22:46:37.340 INFO:teuthology.orchestra.run.smithi177.stdout:2486 write 0x1f30419 thru 0x1f31738 (0x1320 bytes) 2019-12-16T22:46:37.352 INFO:teuthology.orchestra.run.smithi177.stdout:2487 write 0xb308a2a thru 0xb30ecdc (0x62b3 bytes) 2019-12-16T22:46:37.362 INFO:teuthology.orchestra.run.smithi177.stdout:2490 writesame 0xb67059a thru 0xb670c1c data_size 0x1(0x683 bytes) 2019-12-16T22:46:37.371 INFO:teuthology.orchestra.run.smithi177.stdout:2491 write 0x3b2a2f5 thru 0x3b30f57 (0x6c63 bytes) 2019-12-16T22:46:37.384 INFO:teuthology.orchestra.run.smithi177.stdout:2492 writesame 0x510005f thru 0x51067f0 data_size 0x1b(0x6792 bytes) 2019-12-16T22:46:37.392 INFO:teuthology.orchestra.run.smithi177.stdout:2494 write 0xfdabfb thru 0xfe0dba (0x61c0 bytes) 2019-12-16T22:46:37.401 INFO:teuthology.orchestra.run.smithi177.stdout:2495 read 0x5760d8d thru 0x576891b (0x7b8f bytes) 2019-12-16T22:46:37.401 INFO:teuthology.orchestra.run.smithi177.stdout:2501 writesame 0x457d226 thru 0x45885cc data_size 0x1(0xb3a7 bytes) 2019-12-16T22:46:37.408 INFO:teuthology.orchestra.run.smithi177.stdout:leaving image image_cluster1.client.mirror.5-clone18 intact 2019-12-16T22:46:37.422 INFO:teuthology.orchestra.run.smithi177.stdout:2503 flatten 2019-12-16T22:46:37.575 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #22, image image_cluster1.client.mirror.3-clone22 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.3-parent23 2019-12-16T22:46:37.595 INFO:teuthology.orchestra.run.smithi177.stdout:2504 trunc from 0xcc5c28c to 0x6967f27 2019-12-16T22:46:37.626 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #23, image image_cluster1.client.mirror.2-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.2-parent24 2019-12-16T22:46:37.632 INFO:teuthology.orchestra.run.smithi177.stdout:2505 trunc from 0x6967f27 to 0xb973027 2019-12-16T22:46:37.645 INFO:teuthology.orchestra.run.smithi177.stdout:2506 write 0x84dadd3 thru 0x84deed2 (0x4100 bytes) 2019-12-16T22:46:37.654 INFO:teuthology.orchestra.run.smithi177.stdout:2507 read 0xaba4fc0 thru 0xabaf93a (0xa97b bytes) 2019-12-16T22:46:37.654 INFO:teuthology.orchestra.run.smithi177.stdout:2509 punch from 0xa1ecfbe to 0xa1f6c63, (0x9ca5 bytes) 2019-12-16T22:46:37.654 INFO:teuthology.orchestra.run.smithi177.stdout:2510 write 0x53956ce thru 0x53992a7 (0x3bda bytes) 2019-12-16T22:46:37.662 INFO:teuthology.orchestra.run.smithi177.stdout:2511 writesame 0x71da6c5 thru 0x71e8bb0 data_size 0xe(0xe4ec bytes) 2019-12-16T22:46:37.670 INFO:teuthology.orchestra.run.smithi177.stdout:2416 read 0x39629c7 thru 0x3966439 (0x3a73 bytes) 2019-12-16T22:46:37.681 INFO:teuthology.orchestra.run.smithi177.stdout:2513 trunc from 0xb973027 to 0xdb16a22 2019-12-16T22:46:37.682 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.683 INFO:teuthology.orchestra.run.smithi177.stdout:2420 punch from 0x547b95c to 0x5484ae5, (0x9189 bytes) 2019-12-16T22:46:37.683 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.704 INFO:teuthology.orchestra.run.smithi177.stdout:2422 trunc from 0xd7d0448 to 0x1f0aad3 2019-12-16T22:46:37.711 INFO:teuthology.orchestra.run.smithi177.stdout:2514 read 0x3f14287 thru 0x3f1c033 (0x7dad bytes) 2019-12-16T22:46:37.725 INFO:teuthology.orchestra.run.smithi177.stdout:2515 trunc from 0xdb16a22 to 0x9648025 2019-12-16T22:46:37.807 INFO:teuthology.orchestra.run.smithi177.stdout:2516 punch from 0x5e8488f to 0x5e887f6, (0x3f67 bytes) 2019-12-16T22:46:37.807 INFO:teuthology.orchestra.run.smithi177.stdout:2517 read 0x2d10dba thru 0x2d15981 (0x4bc8 bytes) 2019-12-16T22:46:37.807 INFO:teuthology.orchestra.run.smithi177.stdout:2520 punch from 0x56ea5 to 0x5fcbb, (0x8e16 bytes) 2019-12-16T22:46:37.808 INFO:teuthology.orchestra.run.smithi177.stdout:2521 writesame 0x2849a49 thru 0x2857221 data_size 0x3(0xd7d9 bytes) 2019-12-16T22:46:37.827 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~5s 2019-12-16T22:46:37.842 INFO:teuthology.orchestra.run.smithi177.stdout:2522 read 0x465d2c7 thru 0x4666413 (0x914d bytes) 2019-12-16T22:46:37.842 INFO:teuthology.orchestra.run.smithi177.stdout:2523 writesame 0x6a9865d thru 0x6aa6bef data_size 0x1(0xe593 bytes) 2019-12-16T22:46:37.894 INFO:teuthology.orchestra.run.smithi177.stdout:2525 punch from 0x91de39b to 0x91e35c0, (0x5225 bytes) 2019-12-16T22:46:37.894 INFO:teuthology.orchestra.run.smithi177.stdout:2526 read 0x6300b61 thru 0x630b7e2 (0xac82 bytes) 2019-12-16T22:46:37.895 INFO:teuthology.orchestra.run.smithi177.stdout:2527 read 0x1c5e990 thru 0x1c6c5f1 (0xdc62 bytes) 2019-12-16T22:46:37.895 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:37.906 INFO:teuthology.orchestra.run.smithi177.stdout:2423 trunc from 0x1f0aad3 to 0x5e11f78 2019-12-16T22:46:37.947 INFO:teuthology.orchestra.run.smithi177.stdout:2529 write 0xd738eff thru 0xd739913 (0xa15 bytes) 2019-12-16T22:46:37.954 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #17, image image_cluster1.client.mirror.5-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.5-parent18 2019-12-16T22:46:37.955 INFO:teuthology.orchestra.run.smithi177.stdout:2530 write 0xb520411 thru 0xb52f3d6 (0xefc6 bytes) 2019-12-16T22:46:37.988 INFO:teuthology.orchestra.run.smithi177.stdout:2532 write 0x2971293 thru 0x297fc93 (0xea01 bytes) 2019-12-16T22:46:38.062 INFO:teuthology.orchestra.run.smithi177.stdout:2424 writesame 0xafc7803 thru 0xafc9be5 data_size 0x1(0x23e3 bytes) 2019-12-16T22:46:38.077 INFO:teuthology.orchestra.run.smithi177.stdout:2533 trunc from 0xd739914 to 0x453997d 2019-12-16T22:46:38.091 INFO:teuthology.orchestra.run.smithi177.stdout:2425 read 0x695058e thru 0x695f8ff (0xf372 bytes) 2019-12-16T22:46:38.092 INFO:teuthology.orchestra.run.smithi177.stdout:truncating to largest ever: 0xed2a56e 2019-12-16T22:46:38.098 INFO:teuthology.orchestra.run.smithi177.stdout:2426 trunc from 0xafc9be6 to 0xed2a56e 2019-12-16T22:46:38.168 INFO:teuthology.orchestra.run.smithi177.stdout:2930 punch from 0x2985540 to 0x29947b4, (0xf274 bytes) 2019-12-16T22:46:38.186 INFO:teuthology.orchestra.run.smithi177.stdout:2428 write 0x57d9454 thru 0x57e156c (0x8119 bytes) 2019-12-16T22:46:38.189 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.190 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.197 INFO:teuthology.orchestra.run.smithi177.stdout:2931 punch from 0x30780ec to 0x307c2a3, (0x41b7 bytes) 2019-12-16T22:46:38.199 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.199 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.199 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.200 INFO:teuthology.orchestra.run.smithi177.stdout:2935 read 0x4e017ed thru 0x4e02125 (0x939 bytes) 2019-12-16T22:46:38.218 INFO:teuthology.orchestra.run.smithi177.stdout:2429 write 0x531548a thru 0x5315f70 (0xae7 bytes) 2019-12-16T22:46:38.232 INFO:teuthology.orchestra.run.smithi177.stdout:2431 read 0x8542ff0 thru 0x854a7a5 (0x77b6 bytes) 2019-12-16T22:46:38.232 INFO:teuthology.orchestra.run.smithi177.stdout:2432 write 0x6f25233 thru 0x6f29bf8 (0x49c6 bytes) 2019-12-16T22:46:38.248 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.255 INFO:teuthology.orchestra.run.smithi177.stdout:2536 write 0x96a4325 thru 0x96b35db (0xf2b7 bytes) 2019-12-16T22:46:38.255 INFO:teuthology.orchestra.run.smithi177.stdout:2434 trunc from 0xed2a56e to 0x97da4c7 2019-12-16T22:46:38.256 INFO:teuthology.orchestra.run.smithi177.stdout:2936 writesame 0xdbff7ec thru 0xdc0e732 data_size 0x1(0xef47 bytes) 2019-12-16T22:46:38.265 INFO:teuthology.orchestra.run.smithi177.stdout:2937 writesame 0x5a47427 thru 0x5a48fb3 data_size 0x1(0x1b8d bytes) 2019-12-16T22:46:38.280 INFO:teuthology.orchestra.run.smithi177.stdout:2537 punch from 0x2b2187c to 0x2b25a72, (0x41f6 bytes) 2019-12-16T22:46:38.280 INFO:teuthology.orchestra.run.smithi177.stdout:2539 read 0x621a1a7 thru 0x6229049 (0xeea3 bytes) 2019-12-16T22:46:38.280 INFO:teuthology.orchestra.run.smithi177.stdout:2540 read 0x65fb8af thru 0x6608b58 (0xd2aa bytes) 2019-12-16T22:46:38.281 INFO:teuthology.orchestra.run.smithi177.stdout:2542 write 0x2092233 thru 0x20a1422 (0xf1f0 bytes) 2019-12-16T22:46:38.382 INFO:teuthology.orchestra.run.smithi177.stdout:2543 write 0x3194624 thru 0x319cace (0x84ab bytes) 2019-12-16T22:46:38.432 INFO:teuthology.orchestra.run.smithi177.stdout:2544 read 0x554fa89 thru 0x55509d6 (0xf4e bytes) 2019-12-16T22:46:38.433 INFO:teuthology.orchestra.run.smithi177.stdout:2546 writesame 0x81b6643 thru 0x81c1f91 data_size 0x15(0xb94f bytes) 2019-12-16T22:46:38.433 INFO:teuthology.orchestra.run.smithi177.stdout:2436 read 0xb60770 thru 0xb66da8 (0x6639 bytes) 2019-12-16T22:46:38.462 INFO:teuthology.orchestra.run.smithi177.stdout:2547 trunc from 0x96b35dc to 0x8cd0f89 2019-12-16T22:46:38.522 INFO:teuthology.orchestra.run.smithi177.stdout:2437 writesame 0xaa5b752 thru 0xaa5edd8 data_size 0x2f(0x3687 bytes) 2019-12-16T22:46:38.529 INFO:teuthology.orchestra.run.smithi177.stdout:2438 write 0x3c2c7f6 thru 0x3c37993 (0xb19e bytes) 2019-12-16T22:46:38.541 INFO:teuthology.orchestra.run.smithi177.stdout:2439 writesame 0x64e96e4 thru 0x64f3761 data_size 0x1(0xa07e bytes) 2019-12-16T22:46:38.545 INFO:teuthology.orchestra.run.smithi177.stdout:2548 clone 21 order 22 su 2097152 sc 14 2019-12-16T22:46:38.572 INFO:teuthology.orchestra.run.smithi177.stdout:2440 read 0x93cd295 thru 0x93cf72e (0x249a bytes) 2019-12-16T22:46:38.572 INFO:teuthology.orchestra.run.smithi177.stdout:2442 read 0x540cca2 thru 0x540cda4 (0x103 bytes) 2019-12-16T22:46:38.572 INFO:teuthology.orchestra.run.smithi177.stdout:2443 writesame 0x55f14d4 thru 0x56002f5 data_size 0x22(0xee22 bytes) 2019-12-16T22:46:38.583 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.618 INFO:teuthology.orchestra.run.smithi177.stdout:2447 write 0xc0f6913 thru 0xc106627 (0xfd15 bytes) 2019-12-16T22:46:38.630 INFO:teuthology.orchestra.run.smithi177.stdout:2448 read 0xa594545 thru 0xa5955cc (0x1088 bytes) 2019-12-16T22:46:38.630 INFO:teuthology.orchestra.run.smithi177.stdout:2450 read 0x56cd990 thru 0x56d3591 (0x5c02 bytes) 2019-12-16T22:46:38.630 INFO:teuthology.orchestra.run.smithi177.stdout:2451 punch from 0x4bced98 to 0x4bd70b1, (0x8319 bytes) 2019-12-16T22:46:38.631 INFO:teuthology.orchestra.run.smithi177.stdout:2452 write 0x4fb7102 thru 0x4fb777d (0x67c bytes) 2019-12-16T22:46:38.649 INFO:teuthology.orchestra.run.smithi177.stdout:2938 write 0xbedb4f0 thru 0xbeead06 (0xf817 bytes) 2019-12-16T22:46:38.661 INFO:teuthology.orchestra.run.smithi177.stdout:2453 read 0xaea823a thru 0xaeaface (0x7895 bytes) 2019-12-16T22:46:38.661 INFO:teuthology.orchestra.run.smithi177.stdout:2455 punch from 0x1a39c79 to 0x1a40083, (0x640a bytes) 2019-12-16T22:46:38.667 INFO:teuthology.orchestra.run.smithi177.stdout:2939 read 0xc3ded07 thru 0xc3e3c35 (0x4f2f bytes) 2019-12-16T22:46:38.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:38.666+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557466e5e0f0 finish: resending after timeout 2019-12-16T22:46:38.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:38.666+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55746731d0c0 finish: resending after timeout 2019-12-16T22:46:38.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:38.666+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557463d80940 finish: resending after timeout 2019-12-16T22:46:38.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:46:38.670+0000 7f1b76a31700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x557464ada1c0 finish: resending after timeout 2019-12-16T22:46:38.671 INFO:teuthology.orchestra.run.smithi177.stdout:2940 read 0x12e47 thru 0x1b659 (0x8813 bytes) 2019-12-16T22:46:38.678 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.678 INFO:teuthology.orchestra.run.smithi177.stdout:2942 read 0x3494088 thru 0x349bd3f (0x7cb8 bytes) 2019-12-16T22:46:38.679 INFO:teuthology.orchestra.run.smithi177.stdout:2943 writesame 0x9b72685 thru 0x9b7c1b4 data_size 0x34(0x9b30 bytes) 2019-12-16T22:46:38.689 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.1-clone18 2019-12-16T22:46:38.689 INFO:teuthology.orchestra.run.smithi177.stdout:2944 trunc from 0xdc0e733 to 0xebb8ef4 2019-12-16T22:46:38.718 INFO:teuthology.orchestra.run.smithi177.stdout:2456 write 0xdea5eb5 thru 0xdead485 (0x75d1 bytes) 2019-12-16T22:46:38.731 INFO:teuthology.orchestra.run.smithi177.stdout:flattening image image_cluster1.client.mirror.0-clone24 2019-12-16T22:46:38.747 INFO:teuthology.orchestra.run.smithi177.stdout:2457 read 0x889d327 thru 0x88a9e59 (0xcb33 bytes) 2019-12-16T22:46:38.747 INFO:teuthology.orchestra.run.smithi177.stdout:2458 read 0xe5d0d6 thru 0xe69c79 (0xcba4 bytes) 2019-12-16T22:46:38.756 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.756 INFO:teuthology.orchestra.run.smithi177.stdout:2946 read 0xb74b9ca thru 0xb754a23 (0x905a bytes) 2019-12-16T22:46:38.757 INFO:teuthology.orchestra.run.smithi177.stdout:2947 write 0xae8e873 thru 0xae8f835 (0xfc3 bytes) 2019-12-16T22:46:38.763 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.764 INFO:teuthology.orchestra.run.smithi177.stdout:2952 write 0x9d57cc3 thru 0x9d5d48f (0x57cd bytes) 2019-12-16T22:46:38.771 INFO:teuthology.orchestra.run.smithi177.stdout:2953 writesame 0x683d9f2 thru 0x684a7d7 data_size 0x69(0xcde6 bytes) 2019-12-16T22:46:38.776 INFO:teuthology.orchestra.run.smithi177.stdout:2460 trunc from 0xdead486 to 0x2b834e0 2019-12-16T22:46:38.951 INFO:teuthology.orchestra.run.smithi177.stdout:2461 write 0x17b4040 thru 0x17beb35 (0xaaf6 bytes) 2019-12-16T22:46:38.961 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:38.962 INFO:teuthology.orchestra.run.smithi177.stdout:2463 punch from 0x1bcad19 to 0x1bcdb14, (0x2dfb bytes) 2019-12-16T22:46:38.962 INFO:teuthology.orchestra.run.smithi177.stdout:2465 read 0x109ef2e thru 0x10aba5b (0xcb2e bytes) 2019-12-16T22:46:38.981 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #17, image image_cluster1.client.mirror.1-clone17 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.1-parent18 2019-12-16T22:46:39.009 INFO:teuthology.orchestra.run.smithi177.stdout:2467 writesame 0x73fec23 thru 0x74070f2 data_size 0x55(0x84d0 bytes) 2019-12-16T22:46:39.011 INFO:teuthology.orchestra.run.smithi177.stdout:2468 read 0x6231ac7 thru 0x6236b5b (0x5095 bytes) 2019-12-16T22:46:39.014 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #23, image image_cluster1.client.mirror.0-clone23 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.0-parent24 2019-12-16T22:46:39.073 INFO:teuthology.orchestra.run.smithi177.stdout:2469 writesame 0x90f7602 thru 0x90f7d2d data_size 0x6(0x72c bytes) 2019-12-16T22:46:39.076 INFO:teuthology.orchestra.run.smithi177.stdout:2470 punch from 0x58cf875 to 0x58dc690, (0xce1b bytes) 2019-12-16T22:46:39.077 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:39.077 INFO:teuthology.orchestra.run.smithi177.stdout:2474 punch from 0x7ba2a6d to 0x7bb0fe1, (0xe574 bytes) 2019-12-16T22:46:39.077 INFO:teuthology.orchestra.run.smithi177.stdout:2475 write 0x895b3b7 thru 0x8967482 (0xc0cc bytes) 2019-12-16T22:46:39.101 INFO:teuthology.orchestra.run.smithi177.stdout:2476 trunc from 0x90f7d2e to 0x7948185 2019-12-16T22:46:39.147 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:39.147 INFO:teuthology.orchestra.run.smithi177.stdout:2957 read 0x65734a9 thru 0x657769a (0x41f2 bytes) 2019-12-16T22:46:39.148 INFO:teuthology.orchestra.run.smithi177.stdout:2959 read 0xda32444 thru 0xda3b0a8 (0x8c65 bytes) 2019-12-16T22:46:39.148 INFO:teuthology.orchestra.run.smithi177.stdout:2960 read 0x2502c99 thru 0x250e78b (0xbaf3 bytes) 2019-12-16T22:46:39.148 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:39.156 INFO:teuthology.orchestra.run.smithi177.stdout:2962 trunc from 0xebb8ef4 to 0xabd6798 2019-12-16T22:46:39.224 INFO:teuthology.orchestra.run.smithi177.stdout:2477 write 0x8a3c3c6 thru 0x8a459c8 (0x9603 bytes) 2019-12-16T22:46:39.240 INFO:teuthology.orchestra.run.smithi177.stdout:2478 read 0x6c0215 thru 0x6c7193 (0x6f7f bytes) 2019-12-16T22:46:39.242 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:39.242 INFO:teuthology.orchestra.run.smithi177.stdout:2480 punch from 0x3acdc57 to 0x3ad6b75, (0x8f1e bytes) 2019-12-16T22:46:39.243 INFO:teuthology.orchestra.run.smithi177.stdout:2966 writesame 0xc2aac0d thru 0xc2b8540 data_size 0x2(0xd934 bytes) 2019-12-16T22:46:39.245 INFO:teuthology.orchestra.run.smithi177.stdout:2967 read 0x95c0aab thru 0x95ceea0 (0xe3f6 bytes) 2019-12-16T22:46:39.246 INFO:teuthology.orchestra.run.smithi177.stdout:2968 writesame 0x29c1a8c thru 0x29c6a0c data_size 0x1(0x4f81 bytes) 2019-12-16T22:46:39.304 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:39.304 INFO:teuthology.orchestra.run.smithi177.stdout:3478 write 0x3ccb9db thru 0x3cccaed (0x1113 bytes) 2019-12-16T22:46:39.445 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:39.445 INFO:teuthology.orchestra.run.smithi177.stdout:3483 write 0x3c14a5f thru 0x3c175e4 (0x2b86 bytes) 2019-12-16T22:46:39.483 INFO:teuthology.orchestra.run.smithi177.stdout:3484 write 0x21a1560 thru 0x21a8c11 (0x76b2 bytes) 2019-12-16T22:46:39.552 INFO:teuthology.orchestra.run.smithi177.stdout:3486 trunc from 0xeb8a7c5 to 0x19d9393 2019-12-16T22:46:39.555 INFO:teuthology.orchestra.run.smithi177.stdout:2482 writesame 0xaf30f4e thru 0xaf3a8a4 data_size 0x5(0x9957 bytes) 2019-12-16T22:46:39.557 INFO:teuthology.orchestra.run.smithi177.stdout:2484 read 0x2a276cb thru 0x2a2d7b6 (0x60ec bytes) 2019-12-16T22:46:39.558 INFO:teuthology.orchestra.run.smithi177.stdout:2485 writesame 0x1c9e318 thru 0x1ca3184 data_size 0x1(0x4e6d bytes) 2019-12-16T22:46:39.605 INFO:teuthology.orchestra.run.smithi177.stdout:2486 punch from 0x82ad270 to 0x82bb14e, (0xdede bytes) 2019-12-16T22:46:39.606 INFO:teuthology.orchestra.run.smithi177.stdout:2487 write 0x406baaf thru 0x406d0b7 (0x1609 bytes) 2019-12-16T22:46:39.795 INFO:teuthology.orchestra.run.smithi177.stdout:2488 punch from 0x63508 to 0x70e75, (0xd96d bytes) 2019-12-16T22:46:39.811 INFO:teuthology.orchestra.run.smithi177.stdout:2491 trunc from 0xaf3a8a5 to 0x6aa427b 2019-12-16T22:46:40.257 INFO:teuthology.orchestra.run.smithi177.stdout:2492 punch from 0x108143a to 0x1089582, (0x8148 bytes) 2019-12-16T22:46:40.257 INFO:teuthology.orchestra.run.smithi177.stdout:2493 read 0x6714a89 thru 0x67245da (0xfb52 bytes) 2019-12-16T22:46:40.257 INFO:teuthology.orchestra.run.smithi177.stdout:2494 writesame 0x43b9b8d thru 0x43be18e data_size 0x1d(0x4602 bytes) 2019-12-16T22:46:40.259 INFO:teuthology.orchestra.run.smithi177.stdout:2969 punch from 0x54b5e9 to 0x55ad72, (0xf789 bytes) 2019-12-16T22:46:40.259 INFO:teuthology.orchestra.run.smithi177.stdout:2970 write 0x9411e57 thru 0x941587b (0x3a25 bytes) 2019-12-16T22:46:40.269 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:40.270 INFO:teuthology.orchestra.run.smithi177.stdout:2972 read 0xce61c9 thru 0xced0ee (0x6f26 bytes) 2019-12-16T22:46:40.299 INFO:teuthology.orchestra.run.smithi177.stdout:3487 punch from 0x8b5762 to 0x8ba853, (0x50f1 bytes) 2019-12-16T22:46:40.302 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:40.315 INFO:teuthology.orchestra.run.smithi177.stdout:2973 writesame 0xebd083b thru 0xebd17e5 data_size 0x7(0xfab bytes) 2019-12-16T22:46:40.326 INFO:teuthology.orchestra.run.smithi177.stdout:2976 writesame 0xaadc0a2 thru 0xaae608f data_size 0xb(0x9fee bytes) 2019-12-16T22:46:40.338 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:40.344 INFO:teuthology.orchestra.run.smithi177.stdout:3491 write 0x9e9d7b9 thru 0x9ea6665 (0x8ead bytes) 2019-12-16T22:46:40.351 INFO:teuthology.orchestra.run.smithi177.stdout:2981 trunc from 0xebd17e6 to 0x642ce59 2019-12-16T22:46:40.354 INFO:teuthology.orchestra.run.smithi177.stdout:2495 write 0xc0cb6cc thru 0xc0cd7e8 (0x211d bytes) 2019-12-16T22:46:40.362 INFO:teuthology.orchestra.run.smithi177.stdout:3492 read 0x1007d27 thru 0x100a9f7 (0x2cd1 bytes) 2019-12-16T22:46:40.363 INFO:teuthology.orchestra.run.smithi177.stdout:3494 trunc from 0x9ea6666 to 0xa9eafa7 2019-12-16T22:46:40.367 INFO:teuthology.orchestra.run.smithi177.stdout:2498 writesame 0x97a80f4 thru 0x97ad0b8 data_size 0x3(0x4fc5 bytes) 2019-12-16T22:46:40.424 INFO:teuthology.orchestra.run.smithi177.stdout:2499 write 0x397226b thru 0x39760b4 (0x3e4a bytes) 2019-12-16T22:46:40.589 INFO:teuthology.orchestra.run.smithi177.stdout:2501 punch from 0x7ec3d78 to 0x7ece6ab, (0xa933 bytes) 2019-12-16T22:46:40.590 INFO:teuthology.orchestra.run.smithi177.stdout:2503 writesame 0x1ea8f0e thru 0x1eb1ef2 data_size 0x3(0x8fe5 bytes) 2019-12-16T22:46:40.643 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:40.650 INFO:teuthology.orchestra.run.smithi177.stdout:2508 write 0x3c7ad0c thru 0x3c7f817 (0x4b0c bytes) 2019-12-16T22:46:40.650 INFO:teuthology.orchestra.run.smithi177.stdout:2722 writesame 0x4bb976e thru 0x4bc7402 data_size 0x7(0xdc95 bytes) 2019-12-16T22:46:40.748 INFO:teuthology.orchestra.run.smithi177.stdout:2509 write 0x1aea202 thru 0x1af0d89 (0x6b88 bytes) 2019-12-16T22:46:40.761 INFO:teuthology.orchestra.run.smithi177.stdout:3496 writesame 0xb0c4072 thru 0xb0c7e6e data_size 0x1(0x3dfd bytes) 2019-12-16T22:46:40.765 INFO:teuthology.orchestra.run.smithi177.stdout:3498 read 0x4e7a070 thru 0x4e85834 (0xb7c5 bytes) 2019-12-16T22:46:40.767 INFO:teuthology.orchestra.run.smithi177.stdout:3503 write 0x9a3c4fd thru 0x9a46bad (0xa6b1 bytes) 2019-12-16T22:46:40.768 INFO:teuthology.orchestra.run.smithi177.stdout:2510 read 0x60ac6d0 thru 0x60b376a (0x709b bytes) 2019-12-16T22:46:40.769 INFO:teuthology.orchestra.run.smithi177.stdout:2513 punch from 0x77bfe27 to 0x77c93ed, (0x95c6 bytes) 2019-12-16T22:46:40.769 INFO:teuthology.orchestra.run.smithi177.stdout:2514 write 0x822d7e7 thru 0x8230799 (0x2fb3 bytes) 2019-12-16T22:46:40.785 INFO:teuthology.orchestra.run.smithi177.stdout:checking clone #19, image image_cluster1.client.mirror.4-clone19 against file /home/ubuntu/cephtest/archive/fsx-image_cluster1.client.mirror.4-parent20 2019-12-16T22:46:40.798 INFO:teuthology.orchestra.run.smithi177.stdout:2515 write 0x5902dd3 thru 0x590cde5 (0xa013 bytes) 2019-12-16T22:46:40.806 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:40.821 INFO:teuthology.orchestra.run.smithi177.stdout:3505 trunc from 0xb0c7e6f to 0x15a0081 2019-12-16T22:46:40.830 INFO:teuthology.orchestra.run.smithi177.stdout:2516 read 0x371126d thru 0x37116bf (0x453 bytes) 2019-12-16T22:46:40.830 INFO:teuthology.orchestra.run.smithi177.stdout:2517 punch from 0xd8a85b to 0xd8f6c5, (0x4e6a bytes) 2019-12-16T22:46:40.830 INFO:teuthology.orchestra.run.smithi177.stdout:2519 write 0x53bc72c thru 0x53c6d77 (0xa64c bytes) 2019-12-16T22:46:41.069 INFO:teuthology.orchestra.run.smithi177.stdout:3506 write 0x3a42d0 thru 0x3ada9e (0x97cf bytes) 2019-12-16T22:46:41.095 INFO:teuthology.orchestra.run.smithi177.stdout:2521 write 0x646eea6 thru 0x6477fe3 (0x913e bytes) 2019-12-16T22:46:41.194 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.190+0000 7f85ca542700 -1 reset not still connected to 0x559a182b89c0 2019-12-16T22:46:41.194 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.190+0000 7f85ca542700 -1 reset not still connected to 0x559a182ba080 2019-12-16T22:46:41.194 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.190+0000 7f85ca542700 -1 reset not still connected to 0x559a196aebe0 2019-12-16T22:46:41.194 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.190+0000 7f85ca542700 -1 reset not still connected to 0x559a1d27e820 2019-12-16T22:46:41.194 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.190+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3a9450 2019-12-16T22:46:41.194 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.190+0000 7f85ca542700 -1 reset not still connected to 0x559a1d3aa150 2019-12-16T22:46:41.195 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.190+0000 7f85ca542700 -1 reset not still connected to 0x559a1e266490 2019-12-16T22:46:41.205 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.198+0000 7f85ca542700 -1 reset not still connected to 0x559a1e4538e0 2019-12-16T22:46:41.212 INFO:teuthology.orchestra.run.smithi177.stdout:2724 writesame 0x441a4f7 thru 0x4428fc1 data_size 0x1(0xeacb bytes) 2019-12-16T22:46:41.215 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a1e5c6b10 2019-12-16T22:46:41.217 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fb520 2019-12-16T22:46:41.217 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a1e7fd400 2019-12-16T22:46:41.217 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a1e9aef70 2019-12-16T22:46:41.218 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a24378750 2019-12-16T22:46:41.218 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a24379110 2019-12-16T22:46:41.218 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a249dc630 2019-12-16T22:46:41.218 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a2686be10 2019-12-16T22:46:41.218 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a298ee8f0 2019-12-16T22:46:41.218 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.210+0000 7f85ca542700 -1 reset not still connected to 0x559a298f10c0 2019-12-16T22:46:41.225 INFO:teuthology.orchestra.run.smithi177.stdout:2522 writesame 0x80d1b47 thru 0x80dea34 data_size 0x1b(0xceee bytes) 2019-12-16T22:46:41.271 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:41.271 INFO:teuthology.orchestra.run.smithi177.stdout:2524 write 0x7d23d6f thru 0x7d24a47 (0xcd9 bytes) 2019-12-16T22:46:41.305 INFO:teuthology.orchestra.run.smithi177.stdout:3507 write 0x1ce1a10 thru 0x1ce891a (0x6f0b bytes) 2019-12-16T22:46:41.472 INFO:teuthology.orchestra.run.smithi177.stdout:3508 read 0xaa0890 thru 0xaaadec (0xa55d bytes) 2019-12-16T22:46:41.486 INFO:teuthology.orchestra.run.smithi177.stdout:3509 trunc from 0x1ce891b to 0x80079fd 2019-12-16T22:46:41.554 INFO:teuthology.orchestra.run.smithi177.stdout:compare and write disabled 2019-12-16T22:46:41.618 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.610+0000 7f85b713c700 -1 osd.1 pg_epoch: 98 pg[2.33( v 98'1264 (0'0,98'1264] local-lis/les=13/14 n=114 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [1,2] r=0 lpr=13 luod=98'1262 crt=98'1262 lcod 98'1261 mlcod 98'1261 active+clean ps=[e2~1,e4~4,ed~6,fb~5,10a~5]] bad op order, already applied 86769 > this 86696 2019-12-16T22:46:41.619 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f85b713c700 time 2019-12-16T22:46:41.614420+0000 2019-12-16T22:46:41.624 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-16T22:46:41.628 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:41.629 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x5599fc912140] 2019-12-16T22:46:41.629 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x5599fcaee729] 2019-12-16T22:46:41.629 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x5599fcaf2660] 2019-12-16T22:46:41.629 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x5599fcafd761] 2019-12-16T22:46:41.629 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5599fc98367b] 2019-12-16T22:46:41.629 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x5599fcbdd817] 2019-12-16T22:46:41.630 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5599fc99fb0c] 2019-12-16T22:46:41.630 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x5599fcfdf47c] 2019-12-16T22:46:41.630 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x5599fcfe26d0] 2019-12-16T22:46:41.630 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 10: (()+0x76db) [0x7f85db8876db] 2019-12-16T22:46:41.630 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 11: (clone()+0x3f) [0x7f85da62788f] 2019-12-16T22:46:41.631 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:*** Caught signal (Aborted) ** 2019-12-16T22:46:41.631 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: in thread 7f85b713c700 thread_name:tp_osd_tp 2019-12-16T22:46:41.631 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.618+0000 7f85b713c700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7f85b713c700 time 2019-12-16T22:46:41.614420+0000 2019-12-16T22:46:41.632 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-16T22:46:41.632 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2019-12-16T22:46:41.632 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:41.632 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x5599fc912140] 2019-12-16T22:46:41.632 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x5599fcaee729] 2019-12-16T22:46:41.632 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x5599fcaf2660] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x5599fcafd761] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5599fc98367b] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x5599fcbdd817] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5599fc99fb0c] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x5599fcfdf47c] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x5599fcfe26d0] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 10: (()+0x76db) [0x7f85db8876db] 2019-12-16T22:46:41.633 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 11: (clone()+0x3f) [0x7f85da62788f] 2019-12-16T22:46:41.634 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2019-12-16T22:46:41.634 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:41.634 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 1: (()+0x12890) [0x7f85db892890] 2019-12-16T22:46:41.634 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2: (gsignal()+0xc7) [0x7f85da544e97] 2019-12-16T22:46:41.634 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 3: (abort()+0x141) [0x7f85da546801] 2019-12-16T22:46:41.634 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x5599fc912211] 2019-12-16T22:46:41.634 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x5599fcaee729] 2019-12-16T22:46:41.635 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x5599fcaf2660] 2019-12-16T22:46:41.635 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x5599fcafd761] 2019-12-16T22:46:41.635 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5599fc98367b] 2019-12-16T22:46:41.635 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x5599fcbdd817] 2019-12-16T22:46:41.635 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5599fc99fb0c] 2019-12-16T22:46:41.635 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x5599fcfdf47c] 2019-12-16T22:46:41.635 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x5599fcfe26d0] 2019-12-16T22:46:41.636 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 13: (()+0x76db) [0x7f85db8876db] 2019-12-16T22:46:41.636 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 14: (clone()+0x3f) [0x7f85da62788f] 2019-12-16T22:46:41.636 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:2019-12-16T22:46:41.626+0000 7f85b713c700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:46:41.636 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: in thread 7f85b713c700 thread_name:tp_osd_tp 2019-12-16T22:46:41.636 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2019-12-16T22:46:41.636 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:41.636 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 1: (()+0x12890) [0x7f85db892890] 2019-12-16T22:46:41.637 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2: (gsignal()+0xc7) [0x7f85da544e97] 2019-12-16T22:46:41.637 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 3: (abort()+0x141) [0x7f85da546801] 2019-12-16T22:46:41.637 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x5599fc912211] 2019-12-16T22:46:41.637 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x5599fcaee729] 2019-12-16T22:46:41.637 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x5599fcaf2660] 2019-12-16T22:46:41.637 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x5599fcafd761] 2019-12-16T22:46:41.637 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5599fc98367b] 2019-12-16T22:46:41.638 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x5599fcbdd817] 2019-12-16T22:46:41.638 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5599fc99fb0c] 2019-12-16T22:46:41.638 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x5599fcfdf47c] 2019-12-16T22:46:41.638 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x5599fcfe26d0] 2019-12-16T22:46:41.638 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 13: (()+0x76db) [0x7f85db8876db] 2019-12-16T22:46:41.638 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 14: (clone()+0x3f) [0x7f85da62788f] 2019-12-16T22:46:41.638 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:46:41.639 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2019-12-16T22:46:41.654 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: -9243> 2019-12-16T22:46:41.626+0000 7f85b713c700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:46:41.672 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: in thread 7f85b713c700 thread_name:tp_osd_tp 2019-12-16T22:46:41.673 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2019-12-16T22:46:41.673 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:46:41.673 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 1: (()+0x12890) [0x7f85db892890] 2019-12-16T22:46:41.673 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2: (gsignal()+0xc7) [0x7f85da544e97] 2019-12-16T22:46:41.673 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 3: (abort()+0x141) [0x7f85da546801] 2019-12-16T22:46:41.673 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x5599fc912211] 2019-12-16T22:46:41.674 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x5599fcaee729] 2019-12-16T22:46:41.674 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x5599fcaf2660] 2019-12-16T22:46:41.676 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x5599fcafd761] 2019-12-16T22:46:41.676 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x5599fc98367b] 2019-12-16T22:46:41.676 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x5599fcbdd817] 2019-12-16T22:46:41.676 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x5599fc99fb0c] 2019-12-16T22:46:41.676 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x5599fcfdf47c] 2019-12-16T22:46:41.677 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x5599fcfe26d0] 2019-12-16T22:46:41.677 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 13: (()+0x76db) [0x7f85db8876db] 2019-12-16T22:46:41.677 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 14: (clone()+0x3f) [0x7f85da62788f] 2019-12-16T22:46:41.677 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:46:41.677 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr: 2019-12-16T22:46:43.231 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~11s 2019-12-16T22:46:44.508 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.873841287253) > weight (0.25) 2019-12-16T22:46:44.509 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.399164509277) > weight (0.25) 2019-12-16T22:46:44.509 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2019-12-16T22:46:44.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2019-12-16T22:46:44.509 INFO:tasks.rbd_mirror_thrash:waiting for 8 secs before reviving daemons 2019-12-16T22:46:44.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.smithi177.stderr:2019-12-16T22:46:44.510+0000 7f44b2458700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 14209) UID: 1000 2019-12-16T22:46:47.588 INFO:tasks.ceph.cluster1.osd.1.smithi106.stderr:daemon-helper: command crashed with signal 6 2019-12-16T22:46:48.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~0s 2019-12-16T22:46:48.535 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~16s 2019-12-16T22:46:51.502 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.949606161982) > weight (0.25) 2019-12-16T22:46:51.503 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2019-12-16T22:46:51.503 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2019-12-16T22:46:51.504 INFO:tasks.rbd_mirror_thrash:waiting for 7 secs before reviving daemons 2019-12-16T22:46:51.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:46:51.502+0000 7ffaa7c09700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 15969) UID: 1000 2019-12-16T22:46:52.511 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2019-12-16T22:46:52.511 INFO:teuthology.orchestra.run:waiting for 600 2019-12-16T22:46:53.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~5s 2019-12-16T22:46:53.848 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~22s 2019-12-16T22:46:58.484 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.474+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb0560 2019-12-16T22:46:58.484 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb0d80 2019-12-16T22:46:58.484 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f639cb1260 2019-12-16T22:46:58.485 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a680 2019-12-16T22:46:58.485 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a750 2019-12-16T22:46:58.489 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a820 2019-12-16T22:46:58.489 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84ab60 2019-12-16T22:46:58.489 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84aea0 2019-12-16T22:46:58.490 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84b040 2019-12-16T22:46:58.490 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84bba0 2019-12-16T22:46:58.490 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d9765b0 2019-12-16T22:46:58.491 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976750 2019-12-16T22:46:58.491 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976820 2019-12-16T22:46:58.491 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976b60 2019-12-16T22:46:58.491 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d976dd0 2019-12-16T22:46:58.492 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d977790 2019-12-16T22:46:58.492 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d977d40 2019-12-16T22:46:58.492 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d9782f0 2019-12-16T22:46:58.493 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d978560 2019-12-16T22:46:58.493 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63d979670 2019-12-16T22:46:58.493 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbec30 2019-12-16T22:46:58.493 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbbf6c0 2019-12-16T22:46:58.493 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc1c20 2019-12-16T22:46:58.494 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa76c0 2019-12-16T22:46:58.494 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa7930 2019-12-16T22:46:58.494 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa90c0 2019-12-16T22:46:58.494 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9190 2019-12-16T22:46:58.495 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9260 2019-12-16T22:46:58.495 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63dfa9400 2019-12-16T22:46:58.495 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34a000 2019-12-16T22:46:58.495 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34a410 2019-12-16T22:46:58.496 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34aea0 2019-12-16T22:46:58.497 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34b450 2019-12-16T22:46:58.497 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34b790 2019-12-16T22:46:58.498 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34be10 2019-12-16T22:46:58.498 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34c220 2019-12-16T22:46:58.498 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34cff0 2019-12-16T22:46:58.498 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34d260 2019-12-16T22:46:58.499 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34d400 2019-12-16T22:46:58.499 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34d810 2019-12-16T22:46:58.499 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34d9b0 2019-12-16T22:46:58.499 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e34dc20 2019-12-16T22:46:58.500 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e7204e0 2019-12-16T22:46:58.500 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e722080 2019-12-16T22:46:58.500 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e7227d0 2019-12-16T22:46:58.500 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e722cb0 2019-12-16T22:46:58.501 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63e723260 2019-12-16T22:46:58.501 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.478+0000 7fb660f13700 -1 reset not still connected to 0x55f63f3a6000 2019-12-16T22:46:58.501 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.482+0000 7fb660f13700 -1 reset not still connected to 0x55f63f6dcd80 2019-12-16T22:46:58.501 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.482+0000 7fb660f13700 -1 reset not still connected to 0x55f64055cd00 2019-12-16T22:46:58.502 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:46:58.482+0000 7fb660f13700 -1 reset not still connected to 0x55f64055f9b0 2019-12-16T22:46:58.505 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2019-12-16T22:46:58.505 INFO:teuthology.orchestra.run:waiting for 600 2019-12-16T22:46:59.151 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~11s 2019-12-16T22:46:59.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~27s 2019-12-16T22:47:04.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~16s 2019-12-16T22:47:04.455 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~32s 2019-12-16T22:47:09.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~21s 2019-12-16T22:47:09.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~37s 2019-12-16T22:47:15.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~27s 2019-12-16T22:47:15.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~43s 2019-12-16T22:47:17.435 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:47:17.434+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:18.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:47:18.486+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:18.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:47:18.554+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:20.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~32s 2019-12-16T22:47:20.370 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~48s 2019-12-16T22:47:25.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~37s 2019-12-16T22:47:25.674 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~53s 2019-12-16T22:47:30.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~42s 2019-12-16T22:47:30.977 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~59s 2019-12-16T22:47:36.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~48s 2019-12-16T22:47:36.280 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~64s 2019-12-16T22:47:40.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.138+0000 7fc0066ec700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aef188 handle_get_instance_locker: error retrieving instance locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.138+0000 7fc0066ec700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aeee08 handle_get_instance_locker: error retrieving instance locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.138+0000 7fc0066ec700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aef508 handle_get_instance_locker: error retrieving instance locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.138+0000 7fbffaed5700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aef508 handle_remove_instance_object: error removing rbd_mirror_instance.4351 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.142+0000 7fbffaed5700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aef188 handle_remove_instance_object: error removing rbd_mirror_instance.4313 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.142+0000 7fbffaed5700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aeee08 handle_remove_instance_object: error removing rbd_mirror_instance.4322 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.142+0000 7fbffaed5700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aef508 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.142+0000 7fbffaed5700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aef188 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:40.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:40.142+0000 7fbffaed5700 -1 rbd::mirror::InstanceWatcher: 0x5631f5aeee08 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:41.583 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~53s 2019-12-16T22:47:41.584 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~69s 2019-12-16T22:47:42.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:42.698+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:43.703 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:43.702+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:44.706 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:44.706+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c367e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:45.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:45.710+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:46.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:46.714+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c368c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:46.887 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~58s 2019-12-16T22:47:46.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~75s 2019-12-16T22:47:47.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:47:47.434+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:47.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:47.718+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:48.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:47:48.486+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:48.559 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:47:48.554+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:48.724 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:48.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c369a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:49.724 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:49.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:50.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:50.726+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:51.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:51.730+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:52.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~64s 2019-12-16T22:47:52.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~80s 2019-12-16T22:47:52.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:52.734+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:53.739 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:53.738+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:54.741 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:54.742+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:55.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:55.742+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:56.747 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:56.746+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:57.495 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~69s 2019-12-16T22:47:57.496 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~85s 2019-12-16T22:47:57.750 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:57.750+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:58.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:58.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:47:59.756 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:47:59.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:00.758 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:00.758+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:01.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:01.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:02.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:02.766+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:02.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~74s 2019-12-16T22:48:02.799 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~90s 2019-12-16T22:48:03.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.030+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.030+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.034+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_remove_instance_object: error removing rbd_mirror_instance.4313 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.034+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_remove_instance_object: error removing rbd_mirror_instance.4324 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.039 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.039 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.042+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_remove_instance_object: error removing rbd_mirror_instance.4322 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.046+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7ffaa7408700 time 2019-12-16T22:48:03.050616+0000 2019-12-16T22:48:03.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:03.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7ffaae2848f6] 2019-12-16T22:48:03.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:*** Caught signal (Aborted) ** 2019-12-16T22:48:03.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7ffaa7408700 thread_name:tp_journal 2019-12-16T22:48:03.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7ffaaddf9890] 2019-12-16T22:48:03.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7ffaacce9e97] 2019-12-16T22:48:03.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7ffaacceb801] 2019-12-16T22:48:03.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7ffaae284947] 2019-12-16T22:48:03.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.046+0000 7ffaa7408700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7ffaa7408700 time 2019-12-16T22:48:03.050616+0000 2019-12-16T22:48:03.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:03.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7ffaae2848f6] 2019-12-16T22:48:03.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:03.046+0000 7ffaa7408700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:48:03.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7ffaa7408700 thread_name:tp_journal 2019-12-16T22:48:03.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7ffaaddf9890] 2019-12-16T22:48:03.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7ffaacce9e97] 2019-12-16T22:48:03.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7ffaacceb801] 2019-12-16T22:48:03.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7ffaae284947] 2019-12-16T22:48:03.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:48:03.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -327> 2019-12-16T22:46:51.502+0000 7ffaa7c09700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 15969) UID: 1000 2019-12-16T22:48:03.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -41> 2019-12-16T22:48:03.030+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -38> 2019-12-16T22:48:03.030+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -35> 2019-12-16T22:48:03.034+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_remove_instance_object: error removing rbd_mirror_instance.4313 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -32> 2019-12-16T22:48:03.034+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -29> 2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_remove_instance_object: error removing rbd_mirror_instance.4324 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -25> 2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -22> 2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -14> 2019-12-16T22:48:03.042+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_remove_instance_object: error removing rbd_mirror_instance.4322 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -11> 2019-12-16T22:48:03.046+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1> 2019-12-16T22:48:03.046+0000 7ffaa7408700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7ffaa7408700 time 2019-12-16T22:48:03.050616+0000 2019-12-16T22:48:03.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:03.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7ffaae2848f6] 2019-12-16T22:48:03.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 0> 2019-12-16T22:48:03.046+0000 7ffaa7408700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:48:03.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7ffaa7408700 thread_name:tp_journal 2019-12-16T22:48:03.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7ffaaddf9890] 2019-12-16T22:48:03.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7ffaacce9e97] 2019-12-16T22:48:03.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7ffaacceb801] 2019-12-16T22:48:03.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7ffaae284947] 2019-12-16T22:48:03.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:48:03.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1244> 2019-12-16T22:46:51.502+0000 7ffaa7c09700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 15969) UID: 1000 2019-12-16T22:48:03.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1243> 2019-12-16T22:48:03.030+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1242> 2019-12-16T22:48:03.030+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1241> 2019-12-16T22:48:03.034+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_remove_instance_object: error removing rbd_mirror_instance.4313 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1240> 2019-12-16T22:48:03.034+0000 7ffaa7408700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_break_instance_lock: error breaking instance lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1239> 2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_remove_instance_object: error removing rbd_mirror_instance.4324 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1238> 2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3629188 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1237> 2019-12-16T22:48:03.038+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628708 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1236> 2019-12-16T22:48:03.042+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_remove_instance_object: error removing rbd_mirror_instance.4322 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1235> 2019-12-16T22:48:03.046+0000 7ffa9bbf1700 -1 rbd::mirror::InstanceWatcher: 0x563ee3628e08 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:03.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1234> 2019-12-16T22:48:03.046+0000 7ffaa7408700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7ffaa7408700 time 2019-12-16T22:48:03.050616+0000 2019-12-16T22:48:03.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:03.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7ffaae2848f6] 2019-12-16T22:48:03.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1233> 2019-12-16T22:48:03.046+0000 7ffaa7408700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:48:03.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7ffaa7408700 thread_name:tp_journal 2019-12-16T22:48:03.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:03.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7ffaaddf9890] 2019-12-16T22:48:03.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7ffaacce9e97] 2019-12-16T22:48:03.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7ffaacceb801] 2019-12-16T22:48:03.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7ffaae284947] 2019-12-16T22:48:03.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7ffaae284ad1] 2019-12-16T22:48:03.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x563edf4e5df4] 2019-12-16T22:48:03.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x563edf4955e8] 2019-12-16T22:48:03.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x563edf51e65f] 2019-12-16T22:48:03.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x563edf51d1aa] 2019-12-16T22:48:03.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x563edf4a9ce7] 2019-12-16T22:48:03.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7ffaae337a2a] 2019-12-16T22:48:03.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7ffaae338911] 2019-12-16T22:48:03.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7ffaaddee6db] 2019-12-16T22:48:03.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7ffaacdcc88f] 2019-12-16T22:48:03.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:48:03.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:03.199 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:daemon-helper: command crashed with signal 6 2019-12-16T22:48:04.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:04.034+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:05.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:05.038+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c370a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:05.629 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-16T22:48:05.630 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2019-12-16T22:48:05.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2019-12-16T22:48:05.630 INFO:teuthology.orchestra.run.smithi177:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2019-12-16T22:48:05.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2019-12-16T22:48:05.634 INFO:tasks.rbd_mirror_thrash:waiting for 82 secs before thrashing 2019-12-16T22:48:06.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:06.054+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:07.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:07.058+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:08.062 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:08.062+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c371f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:08.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~80s 2019-12-16T22:48:08.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~96s 2019-12-16T22:48:08.568 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a3686f4150 2019-12-16T22:48:08.568 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a368b8f450 2019-12-16T22:48:08.568 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a368b908a0 2019-12-16T22:48:08.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee8410 2019-12-16T22:48:08.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee9ba0 2019-12-16T22:48:08.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:48:08.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:48:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:48:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:48:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:48:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a37026d380 2019-12-16T22:48:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a37026e150 2019-12-16T22:48:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:48:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a370b76820 2019-12-16T22:48:08.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a378396f70 2019-12-16T22:48:08.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a3783988a0 2019-12-16T22:48:08.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a378399c20 2019-12-16T22:48:08.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:48:08.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a3798111e0 2019-12-16T22:48:08.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:08.570+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51040 2019-12-16T22:48:09.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:09.082+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:10.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:10.086+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c372d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:11.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:11.090+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:12.093 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:12.094+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c373b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:13.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:13.098+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:13.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~85s 2019-12-16T22:48:13.405 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~101s 2019-12-16T22:48:13.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:13.630+0000 7f66f9929700 -1 reset not still connected to 0x55a370046b60 2019-12-16T22:48:13.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:48:13.634+0000 7f66f9929700 -1 reset not still connected to 0x55a377f642f0 2019-12-16T22:48:14.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:14.186+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:15.189 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:15.190+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:16.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:16.194+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:17.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:17.202+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c375e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:17.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:48:17.434+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:18.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:18.202+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:18.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:48:18.486+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:18.558 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:48:18.558+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:18.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~90s 2019-12-16T22:48:18.723 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~106s 2019-12-16T22:48:19.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:19.206+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c376c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:20.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:20.218+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:21.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:21.218+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c377a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:22.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:22.222+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:23.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:23.226+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:24.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~95s 2019-12-16T22:48:24.026 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~112s 2019-12-16T22:48:24.342 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:24.342+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c378f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:25.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:25.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:26.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:26.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c379d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:27.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:27.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:28.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:28.354+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:29.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~101s 2019-12-16T22:48:29.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~117s 2019-12-16T22:48:29.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:29.374+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:30.376 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:30.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.034+0000 7f06f8b17700 -1 rbd::mirror::InstanceWatcher: 0x5607499fce08 handle_get_instance_locker: error retrieving instance locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.034+0000 7f06f8b17700 -1 rbd::mirror::InstanceWatcher: 0x5607499fd508 handle_get_instance_locker: error retrieving instance locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.034+0000 7f06ed300700 -1 rbd::mirror::InstanceWatcher: 0x5607499fce08 handle_remove_instance_object: error removing rbd_mirror_instance.4324 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.034+0000 7f06ed300700 -1 rbd::mirror::InstanceWatcher: 0x5607499fd508 handle_remove_instance_object: error removing rbd_mirror_instance.4351 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.034+0000 7f06ed300700 -1 rbd::mirror::InstanceWatcher: 0x5607499fce08 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.038+0000 7f06f8b17700 -1 rbd::mirror::InstanceWatcher: 0x5607499fd188 handle_get_instance_locker: error retrieving instance locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.038+0000 7f06ed300700 -1 rbd::mirror::InstanceWatcher: 0x5607499fd508 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.038+0000 7f06ed300700 -1 rbd::mirror::InstanceWatcher: 0x5607499fd188 handle_remove_instance_object: error removing rbd_mirror_instance.4313 object: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:31.038+0000 7f06ed300700 -1 rbd::mirror::InstanceWatcher: 0x5607499fd188 handle_unregister_instance: error unregistering instance: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:31.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:31.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:32.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:32.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:33.391 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:33.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:33.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:33.642+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:34.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:34.406+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:34.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~106s 2019-12-16T22:48:34.632 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~122s 2019-12-16T22:48:34.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:34.646+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:35.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:35.410+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:35.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:35.646+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:36.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:36.410+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:36.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:36.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:37.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:37.414+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:37.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:37.658+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:38.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:38.418+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:38.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:38.662+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:39.163 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7f1a0abe0700 time 2019-12-16T22:48:39.169206+0000 2019-12-16T22:48:39.163 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:39.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a11a5c8f6] 2019-12-16T22:48:39.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:39.166+0000 7f1a0abe0700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7f1a0abe0700 time 2019-12-16T22:48:39.169206+0000 2019-12-16T22:48:39.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:39.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a11a5c8f6] 2019-12-16T22:48:39.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:*** Caught signal (Aborted) ** 2019-12-16T22:48:39.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7f1a0abe0700 thread_name:tp_journal 2019-12-16T22:48:39.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7f1a115d1890] 2019-12-16T22:48:39.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7f1a104c1e97] 2019-12-16T22:48:39.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7f1a104c3801] 2019-12-16T22:48:39.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a11a5c947] 2019-12-16T22:48:39.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:2019-12-16T22:48:39.166+0000 7f1a0abe0700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:48:39.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7f1a0abe0700 thread_name:tp_journal 2019-12-16T22:48:39.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7f1a115d1890] 2019-12-16T22:48:39.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7f1a104c1e97] 2019-12-16T22:48:39.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7f1a104c3801] 2019-12-16T22:48:39.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a11a5c947] 2019-12-16T22:48:39.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -1> 2019-12-16T22:48:39.166+0000 7f1a0abe0700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7f1a0abe0700 time 2019-12-16T22:48:39.169206+0000 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a11a5c8f6] 2019-12-16T22:48:39.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 0> 2019-12-16T22:48:39.166+0000 7f1a0abe0700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:48:39.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7f1a0abe0700 thread_name:tp_journal 2019-12-16T22:48:39.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7f1a115d1890] 2019-12-16T22:48:39.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7f1a104c1e97] 2019-12-16T22:48:39.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7f1a104c3801] 2019-12-16T22:48:39.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a11a5c947] 2019-12-16T22:48:39.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:48:39.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -643> 2019-12-16T22:48:39.166+0000 7f1a0abe0700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: In function 'void rbd::mirror::NamespaceReplayer::handle_instances_removed(const std::vector >&) [with ImageCtxT = librbd::ImageCtx]' thread 7f1a0abe0700 time 2019-12-16T22:48:39.169206+0000 2019-12-16T22:48:39.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/tools/rbd_mirror/NamespaceReplayer.cc: 253: FAILED ceph_assert(m_image_map) 2019-12-16T22:48:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f1a11a5c8f6] 2019-12-16T22:48:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: -642> 2019-12-16T22:48:39.166+0000 7f1a0abe0700 -1 *** Caught signal (Aborted) ** 2019-12-16T22:48:39.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: in thread 7f1a0abe0700 thread_name:tp_journal 2019-12-16T22:48:39.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-16T22:48:39.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 1: (()+0x12890) [0x7f1a115d1890] 2019-12-16T22:48:39.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2: (gsignal()+0xc7) [0x7f1a104c1e97] 2019-12-16T22:48:39.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 3: (abort()+0x141) [0x7f1a104c3801] 2019-12-16T22:48:39.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 4: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x1a3) [0x7f1a11a5c947] 2019-12-16T22:48:39.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 5: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f1a11a5cad1] 2019-12-16T22:48:39.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 6: (rbd::mirror::NamespaceReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x254) [0x55a201db1df4] 2019-12-16T22:48:39.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 7: (rbd::mirror::PoolReplayer::handle_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x248) [0x55a201d615e8] 2019-12-16T22:48:39.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 8: (rbd::mirror::Instances::notify_instances_removed(std::vector, std::allocator >, std::allocator, std::allocator > > > const&)+0x27f) [0x55a201dea65f] 2019-12-16T22:48:39.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 9: (rbd::mirror::Instances::C_NotifyBase::finish(int)+0xa) [0x55a201de91aa] 2019-12-16T22:48:39.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 10: (ThreadPool::PointerWQ::_void_process(void*, ThreadPool::TPHandle&)+0x147) [0x55a201d75ce7] 2019-12-16T22:48:39.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 11: (ThreadPool::worker(ThreadPool::WorkThread*)+0x9fa) [0x7f1a11b0fa2a] 2019-12-16T22:48:39.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 12: (ThreadPool::WorkThread::entry()+0x11) [0x7f1a11b10911] 2019-12-16T22:48:39.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 13: (()+0x76db) [0x7f1a115c66db] 2019-12-16T22:48:39.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 14: (clone()+0x3f) [0x7f1a105a488f] 2019-12-16T22:48:39.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-16T22:48:39.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr: 2019-12-16T22:48:39.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.smithi177.stderr:daemon-helper: command crashed with signal 6 2019-12-16T22:48:39.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:39.422+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:39.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:39.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:39.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~111s 2019-12-16T22:48:39.936 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~128s 2019-12-16T22:48:40.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:40.426+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:40.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:40.674+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:41.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:41.430+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c388b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:41.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:41.678+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:42.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:42.434+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:42.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:42.682+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:43.435 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:43.438+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:43.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:43.690+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c91e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:44.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:44.722+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:44.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:44.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:45.244 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~117s 2019-12-16T22:48:45.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~133s 2019-12-16T22:48:45.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:45.722+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c92c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:45.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:45.726+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:46.724 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:46.726+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:46.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:46.730+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:47.451 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:48:47.454+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:47.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:47.726+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c93a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:47.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:47.734+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:48.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:48:48.486+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:48.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:48:48.562+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:48.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:48.734+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:48.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:48.742+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:49.739 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:49.742+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:49.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:49.746+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:50.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~122s 2019-12-16T22:48:50.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~138s 2019-12-16T22:48:50.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:50.742+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c94f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:50.748 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:50.750+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:51.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:51.746+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c95d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:51.756 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:51.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:52.751 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:52.750+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:52.759 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:52.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:53.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:53.754+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c96b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:53.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:53.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:54.757 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:54.758+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:54.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:54.766+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:55.759 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:55.762+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:55.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:55.770+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:55.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~127s 2019-12-16T22:48:55.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~144s 2019-12-16T22:48:56.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:56.762+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:56.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:56.774+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:57.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:57.766+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:57.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:57.782+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:58.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:58.770+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c98e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:58.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:58.786+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:59.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:48:59.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:48:59.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:48:59.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:00.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:00.782+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c99c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:00.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:00.794+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:01.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~133s 2019-12-16T22:49:01.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~149s 2019-12-16T22:49:01.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:01.786+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:01.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:01.794+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:02.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:02.790+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:02.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:02.802+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c391e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:03.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:03.790+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:03.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:03.802+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:04.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:04.794+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:04.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:04.806+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c392c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:05.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:05.798+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:05.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:05.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:06.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~138s 2019-12-16T22:49:06.461 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~154s 2019-12-16T22:49:06.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:06.802+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:06.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:06.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c393a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:07.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:07.806+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:07.816 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:07.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a28b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:08.807 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:08.810+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:08.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:08.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:09.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:09.810+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:09.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:09.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:10.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:10.814+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:10.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:10.826+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a27d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:11.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~143s 2019-12-16T22:49:11.766 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~159s 2019-12-16T22:49:11.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:11.818+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:11.828 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:11.830+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a23e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:12.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:12.826+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:12.830 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:12.834+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:13.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:13.834+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:13.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:13.994+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:14.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:14.838+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:14.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:14.998+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:15.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:15.974+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:16.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:16.002+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:16.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:16.978+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a01c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:17.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:17.006+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c85a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:17.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~149s 2019-12-16T22:49:17.069 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~165s 2019-12-16T22:49:17.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:49:17.454+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:17.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:17.982+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:18.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:18.006+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:18.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:49:18.490+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:18.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:49:18.562+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:18.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:18.986+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a21b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:19.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:19.010+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c83e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:19.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:19.990+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:20.011 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:20.014+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:20.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:20.994+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a72850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:21.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:21.014+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:21.996 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:21.998+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a75f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:22.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:22.018+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c68c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:22.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~154s 2019-12-16T22:49:22.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~170s 2019-12-16T22:49:23.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:23.002+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:23.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:23.022+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:24.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:24.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:24.024 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:24.026+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c69a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:25.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:25.010+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a758e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:25.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:25.030+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:26.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:26.010+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a72f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:26.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:26.034+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:27.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:27.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a739d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:27.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:27.038+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:27.635 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2019-12-16T22:49:27.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2019-12-16T22:49:27.636 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2019-12-16T22:49:27.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:49:27.638+0000 7f1b77232700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 14268) UID: 1000 2019-12-16T22:49:27.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~159s 2019-12-16T22:49:27.679 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~175s 2019-12-16T22:49:28.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:28.018+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:28.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:28.038+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:28.637 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2019-12-16T22:49:28.637 INFO:teuthology.orchestra.run:waiting for 600 2019-12-16T22:49:29.021 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:29.022+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a738f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:29.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:29.042+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:30.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:30.026+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:30.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:30.046+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:31.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:31.030+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:31.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:31.046+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:32.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:32.034+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a737a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:32.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:32.050+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:32.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~164s 2019-12-16T22:49:32.984 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~181s 2019-12-16T22:49:33.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:33.038+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:33.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:33.054+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:34.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:34.042+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:34.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:34.058+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:35.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:35.050+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a736c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:35.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:35.062+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:36.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:36.054+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a75330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:36.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:36.066+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:37.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:37.058+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:37.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:37.070+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c70a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:37.649 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:49:37.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a270 2019-12-16T22:49:37.649 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:49:37.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a5b0 2019-12-16T22:49:37.649 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:49:37.650+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84ad00 2019-12-16T22:49:38.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:38.058+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:38.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:38.074+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:38.327 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~170s 2019-12-16T22:49:38.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~186s 2019-12-16T22:49:39.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:39.062+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:39.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:39.078+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:40.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:40.122+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a732d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:40.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:40.126+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c71f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:41.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:41.130+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:41.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:41.130+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a733b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:42.131 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:42.130+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:42.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:42.134+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:43.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:43.134+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a753a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:43.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:43.138+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c73b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:43.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~175s 2019-12-16T22:49:43.631 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~191s 2019-12-16T22:49:44.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:44.138+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:44.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:44.138+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a747d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:45.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:45.166+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:45.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:45.174+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a72a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:46.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:46.170+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:46.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:46.174+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:47.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:47.258+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c75e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:47.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:47.258+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a727e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:47.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:49:47.454+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:48.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:48.258+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:48.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:48.266+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a75e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:48.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:49:48.490+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:48.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:49:48.566+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:48.933 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~180s 2019-12-16T22:49:48.935 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~197s 2019-12-16T22:49:49.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:49.266+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c81b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:49.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:49.270+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:50.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:50.269+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:50.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:50.273+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:51.271 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:51.277+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c84c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:51.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:51.277+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:52.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:52.277+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:52.278 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:52.281+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:53.277 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:53.280+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:53.283 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:53.284+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:54.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~186s 2019-12-16T22:49:54.242 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~202s 2019-12-16T22:49:54.282 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:54.284+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:54.286 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:54.288+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:55.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:55.352+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c60e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:55.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:55.352+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:56.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:56.352+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c61c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:56.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:56.356+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:57.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:57.355+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:57.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:57.355+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:58.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:58.359+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:58.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:58.359+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:59.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:49:59.363+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:59.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:49:59.367+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:49:59.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~191s 2019-12-16T22:49:59.547 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~207s 2019-12-16T22:50:00.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:00.363+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:00.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:00.367+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:01.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:01.371+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:01.373 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:01.375+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:02.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:02.378+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:02.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:02.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:03.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:03.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:03.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:03.382+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:04.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:04.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:04.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:04.386+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:04.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~196s 2019-12-16T22:50:04.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~213s 2019-12-16T22:50:05.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:05.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:05.395 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:05.394+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:06.399 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:06.398+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcf40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:06.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:06.402+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:07.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:07.401+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:07.405 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:07.401+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:08.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:08.405+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdf70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:08.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:08.405+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:09.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:09.413+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:09.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:09.461+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:10.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~202s 2019-12-16T22:50:10.153 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~218s 2019-12-16T22:50:10.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:10.549+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:10.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:10.549+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:11.551 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:11.553+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:11.554 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:11.553+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:12.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:12.553+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:12.558 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:12.561+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:13.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:13.556+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:13.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:13.564+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:14.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:14.560+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:14.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:14.568+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:15.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~207s 2019-12-16T22:50:15.464 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~223s 2019-12-16T22:50:15.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:15.596+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:15.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:15.596+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:16.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:16.604+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:16.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:16.604+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:17.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:50:17.456+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:17.607 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:17.608+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:17.608 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:17.608+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:18.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:50:18.492+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:18.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:50:18.572+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:18.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:18.608+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:18.611 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:18.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:19.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:19.612+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:19.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:19.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:20.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:20.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:20.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:20.615+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3debc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:20.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~212s 2019-12-16T22:50:20.769 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~228s 2019-12-16T22:50:21.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:21.619+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:21.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:21.619+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:22.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:22.623+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:22.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:22.623+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:23.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:23.627+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:23.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:23.631+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:24.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:24.631+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c369a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:24.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:24.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:25.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:25.635+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:25.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:25.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfe90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:26.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~218s 2019-12-16T22:50:26.072 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~234s 2019-12-16T22:50:26.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:26.639+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:26.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:26.643+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:27.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:27.647+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:27.656 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:27.651+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c378f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:28.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:28.650+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:28.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:28.650+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:29.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:29.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:29.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:29.654+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:30.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:30.750+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:30.757 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:30.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:31.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~223s 2019-12-16T22:50:31.376 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~239s 2019-12-16T22:50:31.758 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:31.754+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5174f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:31.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:31.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c379d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:32.761 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:32.758+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:32.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:32.758+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:33.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:33.758+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5176b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:33.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:33.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:34.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:34.762+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c91e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:34.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:34.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:35.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:35.806+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:35.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:35.806+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:36.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~228s 2019-12-16T22:50:36.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~244s 2019-12-16T22:50:36.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:36.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:36.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:36.814+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:37.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:37.818+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:37.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:37.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:38.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:38.822+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:38.827 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:38.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:39.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:39.821+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:39.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:39.821+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:40.830 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:40.825+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:40.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:40.825+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:41.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:41.829+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:41.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:41.829+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:41.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~233s 2019-12-16T22:50:41.985 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~250s 2019-12-16T22:50:42.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:42.829+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:42.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:42.833+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:43.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:43.833+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:43.843 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:43.837+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c372d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:44.843 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:44.841+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:44.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:44.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:45.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:45.845+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:45.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:45.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83402a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:46.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:46.849+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:46.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:46.849+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:47.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~239s 2019-12-16T22:50:47.294 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~255s 2019-12-16T22:50:47.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:50:47.461+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:47.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:47.853+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:47.855 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:47.853+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:48.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:50:48.493+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:48.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:50:48.577+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:48.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:48.853+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:48.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:48.857+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83404d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:49.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:49.857+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:49.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:49.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:50.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:50.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:50.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:50.865+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:51.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:51.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:51.870 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:51.869+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:52.598 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~244s 2019-12-16T22:50:52.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~260s 2019-12-16T22:50:52.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:52.865+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:52.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:52.869+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:53.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:53.868+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:53.875 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:53.872+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83424c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:54.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:54.872+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:54.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:54.876+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83411f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:55.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:55.916+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83403f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:55.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:55.916+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5140e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:56.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:56.928+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:56.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:56.928+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:57.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~249s 2019-12-16T22:50:57.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~266s 2019-12-16T22:50:57.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:57.932+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:57.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:57.932+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:58.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:58.932+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:58.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:58.936+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:59.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:50:59.936+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:50:59.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:50:59.940+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:00.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:00.984+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:00.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:00.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5153b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:01.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:01.988+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:01.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:01.988+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83426f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:02.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:02.992+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:02.998 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:02.996+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:03.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~255s 2019-12-16T22:51:03.215 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~271s 2019-12-16T22:51:04.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:03.996+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:04.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:03.996+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5178e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:05.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:05.000+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83407e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:05.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:05.004+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:06.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:06.072+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:06.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:06.076+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:07.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:07.076+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:07.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:07.080+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:08.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:08.076+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83431e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:08.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:08.084+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:08.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~260s 2019-12-16T22:51:08.519 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~276s 2019-12-16T22:51:09.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:09.080+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:09.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:09.084+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:10.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:10.084+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:10.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:10.088+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:11.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:11.356+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5148c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:11.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:11.356+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:12.363 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:12.359+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:12.363 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:12.359+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:13.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:13.359+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:13.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:13.363+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:13.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~265s 2019-12-16T22:51:13.828 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~282s 2019-12-16T22:51:14.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:14.363+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:14.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:14.367+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:15.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:15.867+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:16.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:16.339+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:16.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:16.871+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:17.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:17.343+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5175d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:17.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:51:17.459+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:17.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:17.875+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:18.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:18.407+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:18.499 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:51:18.495+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:18.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:51:18.575+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:18.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:18.879+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:19.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~271s 2019-12-16T22:51:19.132 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~287s 2019-12-16T22:51:19.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:19.411+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5158f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:19.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:19.883+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:20.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:20.411+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:20.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:20.887+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83428b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:21.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:21.415+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5149a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:21.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:21.891+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83436b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:22.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:22.419+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:22.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:22.895+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:23.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:23.451+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:23.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:23.899+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:24.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~276s 2019-12-16T22:51:24.436 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~292s 2019-12-16T22:51:24.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:24.451+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:24.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:24.899+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83434f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:25.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:25.455+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:25.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:25.903+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:26.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:26.463+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:26.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:26.903+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:27.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:27.479+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:27.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:27.907+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:28.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:28.479+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:28.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:28.911+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:29.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:29.483+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:29.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~281s 2019-12-16T22:51:29.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~297s 2019-12-16T22:51:29.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:29.915+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:30.491 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:30.487+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:30.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:30.915+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:31.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:31.487+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:31.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:31.919+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:32.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:32.503+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:32.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:32.923+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:33.600 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:33.595+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:33.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:33.927+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:34.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:34.599+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:34.938 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:34.931+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:35.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.1 is failed for ~287s 2019-12-16T22:51:35.045 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster1.osd.0 is failed for ~303s 2019-12-16T22:51:35.045 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-12-16T22:51:35.045 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/daemonwatchdog.py", line 37, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/daemonwatchdog.py", line 113, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/daemonwatchdog.py", line 53, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-12-16T22:51:35.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:35.599+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:35.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:35.934+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:36.608 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:36.602+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:36.941 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:36.934+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:37.611 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:37.606+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:37.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:37.938+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:38.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:38.606+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:38.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:38.942+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83413b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:39.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:39.614+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:39.950 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:39.942+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83421b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:40.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:40.618+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:40.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:40.946+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:41.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:41.618+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2773a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:41.955 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:41.950+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:42.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:42.626+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:42.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:42.950+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:43.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:43.626+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:43.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:43.954+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83408c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:44.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:44.634+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2743f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:44.964 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:44.958+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:45.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:45.638+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:45.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:45.962+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:46.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:46.638+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:46.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:46.966+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:47.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:51:47.458+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:47.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:47.642+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:47.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:47.970+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:48.584 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:51:48.574+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:48.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:48.646+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:48.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:51:48.666+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:48.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:48.974+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:49.656 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:49.650+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:49.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:49.978+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:50.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:50.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2772c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:50.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:50.982+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:51.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:51.658+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:51.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:51.990+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:52.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:52.662+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:53.002 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:52.994+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:53.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:53.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:54.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:53.998+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:54.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:54.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:55.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:55.002+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:55.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:55.670+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2758f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:56.013 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:56.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:56.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:56.674+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:57.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:57.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:57.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:57.674+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:58.021 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:58.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:58.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:58.678+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:59.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:51:59.018+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:51:59.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:51:59.682+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4300e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:00.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:00.022+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:00.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:00.686+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:01.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:01.022+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:01.694 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:01.686+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:02.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:02.194+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c375e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:02.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:02.690+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4302a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:03.204 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:03.198+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c385a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:03.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:03.694+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:03.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.739+0000 7f66f9929700 -1 reset not still connected to 0x55a3686f4150 2019-12-16T22:52:03.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.739+0000 7f66f9929700 -1 reset not still connected to 0x55a368b8f450 2019-12-16T22:52:03.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.739+0000 7f66f9929700 -1 reset not still connected to 0x55a368b908a0 2019-12-16T22:52:03.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.739+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:52:03.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.739+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:52:03.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:52:03.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:52:03.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a37026d380 2019-12-16T22:52:03.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a37026e150 2019-12-16T22:52:03.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:52:03.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a370b76820 2019-12-16T22:52:03.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a378396f70 2019-12-16T22:52:03.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a3783988a0 2019-12-16T22:52:03.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a378399c20 2019-12-16T22:52:03.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:52:03.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:52:03.743+0000 7f66f9929700 -1 reset not still connected to 0x55a3798111e0 2019-12-16T22:52:04.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:04.206+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c381b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:04.703 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:04.698+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:05.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:05.210+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c399c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:05.706 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:05.698+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4303f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:06.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:06.214+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c377a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:06.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:06.701+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4304d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:07.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:07.217+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:07.711 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:07.705+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:08.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:08.221+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c388b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:08.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:08.873+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4305b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:09.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:09.233+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c398e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:09.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:09.881+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:10.243 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:10.237+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c365b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:10.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:10.885+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:11.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:11.237+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:11.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:11.889+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:12.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:12.241+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:12.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:12.889+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4307e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:13.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:13.245+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:13.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:13.893+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:14.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:14.245+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:14.904 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:14.897+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4308c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:15.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:15.249+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:15.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:15.901+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:16.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:16.253+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:16.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:16.905+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:17.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:17.257+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c383e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:17.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:52:17.457+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:17.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:17.909+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:18.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:18.261+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:18.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:52:18.577+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:18.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:52:18.665+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:18.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:18.913+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:19.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:19.269+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:20.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:20.041+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:20.279 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:20.273+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:21.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:21.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:21.287 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:21.285+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:22.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:22.053+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:22.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:22.285+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3541490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:23.062 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:23.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:23.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:23.289+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:24.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:24.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:24.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:24.293+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83435d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:25.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:25.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:25.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:25.297+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:26.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:26.065+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:26.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:26.305+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83417a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:27.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:27.069+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:27.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:27.305+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:28.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:28.069+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:28.312 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:28.309+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:29.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:29.073+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:29.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:29.313+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:30.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:30.077+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4310a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:30.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:30.317+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:31.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:31.081+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:31.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:31.321+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a72460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:32.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:32.081+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4311f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:32.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:32.325+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:33.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:33.085+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:33.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:33.329+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:34.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:34.089+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4312d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:34.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:34.329+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a28b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:35.093 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:35.089+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:35.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:35.333+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:36.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:36.093+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4313b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:36.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:36.337+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:37.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:37.093+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:37.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:37.341+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a27d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:38.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:38.097+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:38.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:38.345+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a15e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:39.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:39.105+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:39.349 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:39.345+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:40.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:40.109+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4315e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:40.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:40.349+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:41.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:41.109+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:41.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:41.353+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:42.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:42.113+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:42.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:42.356+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:43.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:43.116+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4317a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:43.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:43.360+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:44.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:44.116+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:44.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:44.364+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:45.129 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:45.124+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:45.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:45.400+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:46.131 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:46.128+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4318f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:46.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:46.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:47.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:47.132+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4319d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:47.416 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:47.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:47.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:52:47.464+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:48.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:48.136+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:48.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:48.420+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a3170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:48.586 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:52:48.580+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:48.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:52:48.668+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:49.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:49.136+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:49.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:49.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:50.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:50.140+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:50.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:50.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a11f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:51.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:51.144+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:51.433 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:51.428+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:52.151 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:52.148+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:52.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:52.432+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a32c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:53.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:53.152+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:53.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:53.436+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:54.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:54.152+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:54.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:54.440+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:55.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:55.156+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:55.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:55.444+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:56.163 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:56.160+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:56.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:56.448+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a13b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:57.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:57.164+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:57.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:57.448+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:58.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:58.168+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:58.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:58.456+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a3250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:59.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:52:59.172+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:52:59.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:52:59.456+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:00.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:00.176+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:00.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:00.460+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a01c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:01.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:01.180+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4320d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:01.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:01.464+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:02.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:02.180+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4321b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:02.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:02.468+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:03.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:03.184+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:03.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:03.472+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:04.190 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:04.184+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:04.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:04.476+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a31e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:05.195 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:05.192+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:05.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:05.480+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:06.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:06.196+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:06.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:06.484+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a18f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:07.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:07.196+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:07.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:07.488+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:08.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:08.204+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4324c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:08.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:08.492+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a16c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:09.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:09.204+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:09.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:09.492+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a21b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:10.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:10.208+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4325a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:10.502 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:10.496+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:11.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:11.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:11.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:11.500+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:12.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:12.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4326f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:12.507 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:12.504+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a23e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:13.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:13.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:13.510 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:13.504+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a24c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:14.399 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:14.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4327d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:14.514 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:14.508+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:15.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:15.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:15.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:15.512+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a12d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:16.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:16.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4328b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:16.520 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:16.516+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:17.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:17.240+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:17.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:53:17.464+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:17.527 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:17.520+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:18.246 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:18.239+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:18.528 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:18.523+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:18.588 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:53:18.583+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:18.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:53:18.667+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:19.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:19.531+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:19.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:19.535+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:20.540 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:20.535+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:20.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:20.539+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:21.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:21.539+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:21.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:21.543+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:22.549 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:22.543+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:22.551 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:22.547+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:23.553 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:23.547+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:23.553 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:23.547+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:24.584 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:24.579+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:24.586 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:24.579+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:25.587 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:25.583+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:25.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:25.583+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:26.590 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:26.583+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4310a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:26.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:26.587+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:27.595 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:27.587+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:27.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:27.591+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c370a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:28.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:28.591+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:28.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:28.591+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4311f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:29.718 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:29.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:29.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:29.715+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:30.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:30.715+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c396b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:30.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:30.719+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:31.723 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:31.719+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c380d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:31.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:31.727+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:32.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:32.723+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c363f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:32.739 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:32.735+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:33.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:33.727+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:33.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:33.739+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4333a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:34.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:34.731+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:34.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:34.739+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:35.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:35.735+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:35.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:35.743+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:36.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:36.739+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:36.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:36.747+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:37.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:37.743+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:37.758 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:37.751+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:38.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:38.747+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:38.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:38.755+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:39.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:39.867+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:39.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:39.867+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4336b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:40.875 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:40.871+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:40.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:40.871+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c384c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:41.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:41.875+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:41.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:41.875+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:42.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:42.875+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:42.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:42.879+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:43.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:43.887+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:43.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:43.891+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:44.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:44.891+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:44.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:44.895+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:45.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:45.895+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:45.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:45.899+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:46.904 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:46.899+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:46.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:46.899+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:47.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:53:47.463+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:47.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:47.903+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:47.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:47.903+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:48.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:53:48.583+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:48.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:53:48.675+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:48.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:48.919+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4334f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:48.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:48.919+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:50.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:49.999+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:50.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:49.999+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4323e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:51.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:51.003+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4332c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:51.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:51.003+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:52.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:52.007+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:52.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:52.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:53.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:53.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:53.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:53.475+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:54.024 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:54.018+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:54.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:54.478+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:55.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:55.022+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:55.491 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:55.486+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:56.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:56.022+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:56.499 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:56.494+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:57.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:57.030+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:57.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:57.498+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:58.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:58.030+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:58.507 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:58.502+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:59.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:53:59.034+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:53:59.510 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:53:59.502+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4331e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:00.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:00.150+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3541570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:00.513 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:00.506+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:01.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:01.154+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3541730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:01.521 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:01.514+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:02.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:02.158+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:02.523 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:02.518+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:03.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:03.162+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:03.526 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:03.518+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:04.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:04.162+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:04.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:04.522+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:05.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:05.210+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:05.536 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:05.530+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4338e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:06.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:06.214+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83417a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:06.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:06.530+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:07.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:07.218+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:07.543 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:07.538+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c63f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:08.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:08.226+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:08.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:08.538+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:09.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:09.226+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:09.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:09.542+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:10.323 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:10.314+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:10.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:10.546+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:11.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:11.318+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:11.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:11.550+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c67e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:12.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:12.322+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:12.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:12.554+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:13.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:13.326+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:13.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:13.554+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:14.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:14.326+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83427d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:14.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:14.558+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:15.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:15.330+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83410a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:15.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:15.562+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:16.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:16.334+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:16.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:16.566+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:17.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:17.338+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:17.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:54:17.462+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:17.574 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:17.566+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c61c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:18.349 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:18.342+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:18.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:18.570+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:18.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:54:18.582+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:18.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:54:18.674+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:19.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:19.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:19.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:19.574+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:20.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:20.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83424c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:20.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:20.582+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:21.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:21.354+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:21.592 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:21.586+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:22.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:22.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:22.595 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:22.590+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c65b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:23.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:23.362+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:23.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:23.590+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:24.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:24.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:24.602 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:24.594+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:25.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:25.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:25.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:25.598+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:26.382 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:26.374+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:26.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:26.602+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:27.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:27.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83405b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:27.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:27.606+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:28.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:28.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:28.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:28.610+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:29.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:29.386+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:29.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:29.614+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c8140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:30.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:30.389+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:30.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:30.617+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:31.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:31.393+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83434f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:31.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:31.697+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:32.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:32.397+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:32.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:32.701+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:33.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:33.397+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:33.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:33.705+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:33.923 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:54:33.915+0000 7f66f9929700 -1 reset not still connected to 0x55a3785ab450 2019-12-16T22:54:34.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:34.401+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:34.717 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:34.709+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:35.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:35.405+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:35.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:35.713+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:36.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:36.409+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:36.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:36.717+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c73b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:37.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:37.409+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:37.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:37.721+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:38.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:38.413+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83432c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:38.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:38.725+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c72d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:39.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:39.417+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:39.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:39.729+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c70a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:40.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:40.421+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:40.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:40.729+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c7420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:41.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:41.425+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:41.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:41.733+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c6700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:42.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:42.429+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83423e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:42.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:42.737+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c9790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:43.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:43.433+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:43.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:43.737+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c88b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:44.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:44.441+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:44.748 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:44.745+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c0c76c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:45.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:45.441+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:45.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:45.757+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:46.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:46.445+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:46.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:46.761+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:47.451 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:47.449+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:47.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:54:47.465+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:47.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:47.765+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:48.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:48.449+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83428b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:48.592 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:54:48.589+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:48.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:54:48.677+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:48.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:48.765+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:49.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:49.453+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83411f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:49.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:49.769+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:50.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:50.457+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83416c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:50.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:50.777+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5140e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:51.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:51.461+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:51.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:51.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5161b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:52.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:52.461+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:52.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:52.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:53.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:53.465+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:53.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:53.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:54.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:54.469+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:54.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:54.793+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:55.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:55.469+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83415e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:55.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:55.797+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:56.478 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:56.473+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:56.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:56.801+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:57.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:57.477+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:57.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:57.805+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:58.484 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:58.481+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83439c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:58.814 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:58.809+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:59.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:54:59.485+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:54:59.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:54:59.817+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5178e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:00.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:00.082+0000 7f66f9929700 -1 reset not still connected to 0x55a370046dd0 2019-12-16T22:55:00.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:00.082+0000 7f66f9929700 -1 reset not still connected to 0x55a37026dee0 2019-12-16T22:55:00.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:00.082+0000 7f66f9929700 -1 reset not still connected to 0x55a370acc3c0 2019-12-16T22:55:00.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:00.082+0000 7f66f9929700 -1 reset not still connected to 0x55a3785aa340 2019-12-16T22:55:00.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:00.485+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:00.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:00.821+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:01.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:01.493+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83436b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:01.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:01.829+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:02.499 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:02.493+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:02.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:02.829+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:03.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:03.497+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:03.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:03.833+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5160d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:04.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:04.501+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83403f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:04.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:04.837+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:05.510 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:05.505+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:05.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:05.840+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:06.515 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:06.512+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:06.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:06.844+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:07.520 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:07.516+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:07.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:07.848+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:08.524 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:08.520+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:08.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:08.852+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5175d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:09.527 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:09.520+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:09.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:09.852+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:10.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:10.616+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:10.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:10.860+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:11.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:11.620+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:11.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:11.868+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:12.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:12.620+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:12.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:12.872+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:13.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:13.624+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83413b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:13.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:13.876+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:14.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:14.768+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83419d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:14.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:14.876+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:15.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:15.768+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83412d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:15.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:15.880+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5153b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:16.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:16.772+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:16.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:16.884+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:17.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:55:17.468+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:17.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:17.776+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:17.889 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:17.884+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:18.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:55:18.588+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:18.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:55:18.680+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:18.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:18.776+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:18.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:18.888+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:19.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:19.780+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:19.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:19.892+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:20.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:20.784+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:20.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:20.896+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:21.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:21.792+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:21.904 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:21.900+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:22.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:22.792+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:22.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:22.900+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:23.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:23.796+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:23.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:23.904+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:24.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:24.800+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:24.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:24.912+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:25.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:25.800+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:25.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:25.916+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5150a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:26.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:26.864+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:26.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:26.920+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5145b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:27.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:27.868+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:27.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:27.924+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:28.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:28.872+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:28.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:28.928+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:29.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:29.872+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:29.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:29.928+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5156c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:30.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:30.876+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:30.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:30.932+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:31.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:31.880+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:31.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:31.936+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5174f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:32.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:32.884+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:32.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:32.940+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:33.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:33.888+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:33.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:33.940+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:34.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:34.892+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ca80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:34.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:34.944+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:35.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:35.896+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ca10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:35.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:35.948+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:36.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:36.900+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cb60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:36.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:36.952+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:37.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:37.900+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852caf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:37.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:37.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5143f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:38.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:38.904+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cc40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:38.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:38.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:39.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:39.908+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cbd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:39.965 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:39.960+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:40.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:40.912+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cd20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:40.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:40.964+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:41.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:41.915+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ccb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:41.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:41.967+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:42.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:42.919+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ce00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:42.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:42.967+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:43.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:43.919+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cd90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:43.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:43.971+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:43.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.905+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b35f0 2019-12-16T22:55:43.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.905+0000 7f66f9929700 -1 reset not still connected to 0x55a362d2fb50 2019-12-16T22:55:43.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.977+0000 7f66f9929700 -1 reset not still connected to 0x55a3645047d0 2019-12-16T22:55:43.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.981+0000 7f66f9929700 -1 reset not still connected to 0x55a364504970 2019-12-16T22:55:43.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.981+0000 7f66f9929700 -1 reset not still connected to 0x55a364c4aff0 2019-12-16T22:55:43.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.981+0000 7f66f9929700 -1 reset not still connected to 0x55a3686f4150 2019-12-16T22:55:43.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.981+0000 7f66f9929700 -1 reset not still connected to 0x55a368b8f450 2019-12-16T22:55:43.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.981+0000 7f66f9929700 -1 reset not still connected to 0x55a368b908a0 2019-12-16T22:55:43.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.981+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee8410 2019-12-16T22:55:43.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.981+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee9ba0 2019-12-16T22:55:43.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.985+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.985+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a37026d380 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a37026e150 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a370b76820 2019-12-16T22:55:43.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a378396f70 2019-12-16T22:55:43.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a3783988a0 2019-12-16T22:55:43.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a378399c20 2019-12-16T22:55:43.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:55:43.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:55:43.989+0000 7f66f9929700 -1 reset not still connected to 0x55a3798111e0 2019-12-16T22:55:44.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:44.923+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:44.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:44.975+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:45.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:45.923+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ce70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:45.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:45.979+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:46.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:46.931+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cfc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:46.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:46.983+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5148c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:47.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:55:47.467+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:47.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:47.939+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:47.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:47.983+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5142a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:48.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:55:48.591+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:48.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:55:48.679+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:48.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:48.939+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:48.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:48.987+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5141c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:49.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:49.983+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:49.996 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:49.991+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5149a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:50.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:50.983+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:50.999 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:50.995+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:51.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:51.987+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:52.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:51.995+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:52.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:52.991+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:53.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:52.999+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5158f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:54.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:53.995+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:54.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:54.003+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:55.005 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:54.999+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:55.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:55.007+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:56.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:55.999+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:56.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:56.007+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5167d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:57.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:57.003+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:57.017 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:57.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:58.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:58.007+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:58.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:58.015+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:59.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:55:59.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:55:59.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:55:59.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5166f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:00.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:00.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:00.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:00.023+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5157a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:01.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:01.015+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:01.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:01.111+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:02.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:02.019+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:02.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:02.115+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5152d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:03.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:03.023+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:03.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:03.127+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:04.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:04.027+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:04.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:04.131+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:05.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:05.031+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:05.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:05.139+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5164c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:06.039 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:06.035+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:06.150 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:06.143+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:07.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:07.035+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:07.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:07.147+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:08.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:08.043+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:08.158 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:08.151+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:08.932 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.929+0000 7f66f9929700 -1 reset not still connected to 0x55a364504970 2019-12-16T22:56:08.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a3686f4150 2019-12-16T22:56:08.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a368b8f450 2019-12-16T22:56:08.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a368b908a0 2019-12-16T22:56:08.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee9ba0 2019-12-16T22:56:08.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:56:08.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:56:08.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:56:08.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:56:08.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.933+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:56:08.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a37026d380 2019-12-16T22:56:08.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a37026e150 2019-12-16T22:56:08.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:56:08.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a370b76820 2019-12-16T22:56:08.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a378396f70 2019-12-16T22:56:08.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a3783988a0 2019-12-16T22:56:08.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a378399c20 2019-12-16T22:56:08.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:56:08.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:08.937+0000 7f66f9929700 -1 reset not still connected to 0x55a3798111e0 2019-12-16T22:56:09.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:09.043+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:09.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:09.159+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:10.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:10.047+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:10.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:10.163+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:11.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:11.051+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852da40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:11.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:11.163+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5148c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:12.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:12.051+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:12.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:12.167+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:13.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:13.055+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852db20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:13.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:13.167+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:14.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:14.059+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:14.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:14.171+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:15.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:15.059+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:15.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:15.175+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:16.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:16.063+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852db90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:16.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:16.179+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:17.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:17.063+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:17.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:17.179+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:17.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:56:17.466+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:18.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:18.066+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:18.214 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:18.206+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5143f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:18.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:56:18.590+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:18.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:56:18.682+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:19.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:19.210+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:19.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:19.258+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ddc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:20.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:20.214+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:20.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:20.262+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:21.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:21.218+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:21.276 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:21.270+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:22.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:22.222+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:22.281 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:22.274+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852de30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:23.308 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:23.302+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:23.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:23.306+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5174f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:24.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:24.306+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:24.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:24.318+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:25.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:25.310+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:25.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:25.322+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5156c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:26.320 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:26.314+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:26.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:26.326+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:27.326 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:27.318+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:27.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:27.330+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5145b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:28.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:28.322+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:28.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:28.334+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5150a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:29.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:29.326+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:29.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:29.334+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:30.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:30.326+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:30.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:30.338+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:31.338 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:31.330+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:31.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:31.342+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:32.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:32.334+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:32.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:32.342+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:33.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:33.338+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:33.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:33.350+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:34.346 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:34.338+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:34.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:34.354+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:35.349 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:35.342+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:35.363 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:35.354+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:36.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:36.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:36.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:36.358+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:37.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:37.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:37.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:37.362+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:38.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:38.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:38.371 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:38.362+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:39.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:39.354+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:39.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:39.374+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:40.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:40.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:40.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:40.378+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:41.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:41.362+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:41.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:41.378+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:42.373 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:42.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:42.389 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:42.382+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5175d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:43.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:43.622+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:43.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:43.622+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:44.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:44.622+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:44.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:44.626+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:45.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:45.626+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:45.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:45.630+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:46.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:46.630+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5160d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:46.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:46.630+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:47.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:56:47.466+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:47.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:47.634+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852eed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:47.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:47.634+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:48.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:56:48.590+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:48.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:48.638+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:48.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:48.638+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ef40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:48.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:56:48.682+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:49.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:49.642+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:49.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:49.642+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852efb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:50.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:50.646+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:50.654 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:50.646+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5178e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:51.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:51.650+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:51.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:51.650+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:52.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:52.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:52.660 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:52.654+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:53.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:53.657+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:53.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:53.657+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:54.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:54.661+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:54.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:54.661+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:55.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:55.661+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:55.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:55.665+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:56.671 INFO:tasks.rbd_mirror_thrash:Failed to stop cluster1.client.mirror.1 2019-12-16T22:56:56.671 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 6 2019-12-16T22:56:56.671 ERROR:tasks.rbd_mirror_thrash:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/rbd_mirror_thrash.py", line 84, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/rbd_mirror_thrash.py", line 156, in do_thrash run.wait([daemon.proc], timeout=600) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 451, in wait check_time() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds 2019-12-16T22:56:56.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:56.665+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5161b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:56.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:56.665+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:57.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:57.669+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5140e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:57.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:57.673+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:58.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:58.673+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:58.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:58.677+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:59.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:56:59.096+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 2825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:56:59.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:56:59.677+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:56:59.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:56:59.681+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:00.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:00.124+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 3620 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:00.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:00.681+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:00.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:00.681+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:01.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:01.184+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 4051 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:01.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:01.685+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:01.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:01.693+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:02.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:02.192+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 4296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:02.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:02.689+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:02.703 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:02.697+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:03.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:03.255+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 5166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:03.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:03.693+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:03.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:03.797+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:04.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:04.287+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 5392 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:04.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:04.701+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:04.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:04.797+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:05.299 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:05.291+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 5551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:05.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:05.701+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:05.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:05.801+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:06.299 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:06.291+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 5695 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:06.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:06.709+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:06.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:06.809+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:07.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:07.323+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 5842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:07.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:07.713+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:07.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:07.809+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fe90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:08.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:08.387+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 5978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:08.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:08.773+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:08.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:08.913+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:09.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:09.407+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:09.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:09.777+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:09.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:09.917+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:10.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:10.447+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:10.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:10.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:10.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:10.921+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:11.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:11.423+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:11.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:11.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:11.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:11.921+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ff00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:12.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:12.415+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:12.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:12.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:12.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:12.929+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:13.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:13.455+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:13.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:13.845+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:14.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:14.037+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:14.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:14.503+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:14.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:14.853+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:15.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:15.041+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:15.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:15.495+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:15.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:15.857+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:16.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:16.045+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a732d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:16.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:16.499+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 6999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:16.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:16.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:17.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:17.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:17.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:57:17.469+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:17.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:17.499+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:17.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:17.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:18.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:18.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a758e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:18.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:18.567+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:18.600 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:57:18.597+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:18.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:57:18.689+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:19.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:19.017+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:19.190 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:19.185+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:19.547 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:19.539+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7305 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:20.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:20.025+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:20.193 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:20.189+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a747d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:20.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:20.531+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:21.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:21.029+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:21.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:21.197+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a753a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:21.527 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:21.519+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7549 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:22.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:22.033+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:22.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:22.205+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a723f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:22.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:22.575+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:23.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:23.033+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:23.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:23.209+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:23.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:23.639+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7847 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:24.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:24.037+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:24.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:24.213+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a739d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:24.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:24.643+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 7984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:25.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:25.041+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:25.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:25.213+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:25.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:25.655+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:26.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:26.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747460d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:26.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:26.221+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:26.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:26.683+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:27.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:27.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:27.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:27.225+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a74920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:27.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:27.751+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:28.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:28.053+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745e8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:28.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:28.225+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a72850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:28.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:28.739+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:29.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:29.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:29.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:29.228+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a75480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:29.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:29.799+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:30.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:30.064+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:30.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:30.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a75330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:30.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:30.803+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:31.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:31.064+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:31.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:31.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a75f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:31.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:31.787+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:32.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:32.068+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4320d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:32.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:32.240+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a73960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:32.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:32.791+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:33.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:33.068+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4321b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:33.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:33.240+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a72380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:33.793 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:33.787+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:34.200 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:34.196+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:34.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:34.244+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a72fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:34.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:34.827+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:35.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:35.196+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:35.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:35.248+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f5a733b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:35.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:35.867+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:36.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:36.200+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:36.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:36.248+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:36.906 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:36.899+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:37.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:37.204+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:37.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:37.252+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:37.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:37.927+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:38.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:38.208+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:38.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:38.256+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:38.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:38.903+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 8907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:39.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:39.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8809a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:39.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:39.260+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:39.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:39.943+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:40.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:40.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:40.269 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:40.260+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:40.943 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:40.931+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:41.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:41.220+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8808c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:41.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:41.264+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83415e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:41.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:41.911+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:42.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:42.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8807e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:42.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:42.268+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:42.942 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:42.935+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:43.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:43.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:43.277 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:43.272+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:43.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:43.979+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9233 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:44.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:44.284+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:44.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:44.284+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:44.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:44.958+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:45.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:45.288+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:45.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:45.288+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8805b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:46.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:46.030+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:46.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:46.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:46.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:46.296+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:47.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:47.010+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:47.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:47.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:47.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:47.300+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83425a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:47.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:57:47.472+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:48.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:48.010+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:48.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:48.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8803f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:48.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:48.300+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:48.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:57:48.596+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:48.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:57:48.688+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:49.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:49.038+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:49.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:49.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:49.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:49.416+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:50.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:50.082+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:50.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:50.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:50.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:50.424+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:51.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:51.142+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:51.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:51.420+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:51.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:51.424+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:52.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:52.174+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9875 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:52.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:52.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:52.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:52.436+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:53.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:53.170+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 9914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:53.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:53.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:53.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:53.440+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8802a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:54.161 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:54.158+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:54.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:54.600+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:54.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:54.604+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:55.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:55.166+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:55.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:55.604+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:55.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:55.608+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:56.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:56.194+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10128 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:56.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:56.608+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8828b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:56.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:56.616+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83424c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:57.184 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:57.178+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:57.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:57.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:57.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:57.616+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:58.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:58.162+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:58.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:58.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:58.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:58.620+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:59.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:57:59.178+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:57:59.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:57:59.616+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:57:59.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:57:59.624+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:00.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:00.162+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:00.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:00.620+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2743f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:00.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:00.628+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:01.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:01.214+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:01.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:01.624+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2748c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:01.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:01.636+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:02.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:02.222+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10503 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:02.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:02.628+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:02.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:02.640+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:03.372 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:03.366+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:03.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:03.632+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:03.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:03.652+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:04.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:04.418+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:04.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:04.640+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:04.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:04.660+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83403f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:05.418 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:05.414+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10760 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:05.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:05.647+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2772c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:05.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:05.659+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:06.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:06.390+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10831 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:06.654 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:06.647+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:06.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:06.667+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:07.430 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:07.426+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:07.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:07.651+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:07.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:07.671+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:08.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:08.486+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 10949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:08.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:08.655+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:08.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:08.675+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:09.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:09.466+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:09.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:09.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:09.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:09.679+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:10.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:10.518+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11092 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:10.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:10.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:10.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:10.679+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:11.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:11.514+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:11.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:11.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:11.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:11.683+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83411f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:12.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:12.566+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:12.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:12.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:12.695 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:12.687+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:13.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:13.610+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:13.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:13.671+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:13.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:13.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:14.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:14.594+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:14.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:14.759+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:14.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:14.763+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:15.676 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:15.670+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:15.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:15.771+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:15.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:15.771+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:16.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:16.734+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:16.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:16.775+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:16.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:16.775+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:17.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:58:17.483+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:17.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:17.779+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2747e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:17.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:17.779+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:17.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:17.798+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:18.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:58:18.599+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:18.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:58:18.691+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:18.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:18.779+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2773a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:18.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:18.779+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:18.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:18.862+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11496 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:19.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:19.787+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eba30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:19.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:19.787+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:19.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:19.882+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:20.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:20.791+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:20.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:20.791+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:20.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:20.922+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11609 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:21.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:21.803+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:21.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:21.803+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:21.930 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:21.926+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:22.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:22.807+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:22.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:22.807+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:22.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:22.930+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:23.814 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:23.807+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:23.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:23.815+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:23.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:23.938+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11775 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:24.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:24.967+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:24.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:24.967+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:24.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:24.966+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:25.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:25.946+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:25.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:25.971+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2767d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:25.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:25.971+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:26.936 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:26.929+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 11954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:26.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:26.975+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:26.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:26.975+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:27.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:27.969+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:27.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:27.979+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:27.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:27.979+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:28.986 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:28.979+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:28.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:28.983+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2764c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:29.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.013+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:29.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b2750 2019-12-16T22:58:29.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b35f0 2019-12-16T22:58:29.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b3fb0 2019-12-16T22:58:29.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b43c0 2019-12-16T22:58:29.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a361662000 2019-12-16T22:58:29.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a361674f70 2019-12-16T22:58:29.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a361675ad0 2019-12-16T22:58:29.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3620152b0 2019-12-16T22:58:29.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a362016ff0 2019-12-16T22:58:29.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a362017190 2019-12-16T22:58:29.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3620174d0 2019-12-16T22:58:29.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3623ba000 2019-12-16T22:58:29.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3623bd0c0 2019-12-16T22:58:29.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a362be0a40 2019-12-16T22:58:29.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a362d2fb50 2019-12-16T22:58:29.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3631232b0 2019-12-16T22:58:29.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3645047d0 2019-12-16T22:58:29.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a364504970 2019-12-16T22:58:29.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3686f4150 2019-12-16T22:58:29.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a368b8f450 2019-12-16T22:58:29.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a368b908a0 2019-12-16T22:58:29.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee8410 2019-12-16T22:58:29.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee9ba0 2019-12-16T22:58:29.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:58:29.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:58:29.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:58:29.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a36c08f380 2019-12-16T22:58:29.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:58:29.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a37026d380 2019-12-16T22:58:29.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a37026e150 2019-12-16T22:58:29.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:58:29.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a370b76820 2019-12-16T22:58:29.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a378396f70 2019-12-16T22:58:29.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3783988a0 2019-12-16T22:58:29.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a378399c20 2019-12-16T22:58:29.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.109+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:58:29.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:29.113+0000 7f66f9929700 -1 reset not still connected to 0x55a379b51040 2019-12-16T22:58:30.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:30.037+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:30.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:30.071+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebe90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:30.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:30.075+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:31.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:31.049+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:31.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:31.075+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:31.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:31.079+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:32.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:32.075+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ebf00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:32.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:32.077+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:32.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:32.083+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2757a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:33.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:33.079+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:33.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:33.087+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:33.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:33.089+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:34.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:34.087+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:34.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:34.091+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:34.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:34.149+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:35.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:35.091+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:35.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:35.091+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:35.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:35.141+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:36.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:36.095+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:36.133 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:36.127+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:36.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:36.213+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12487 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:37.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:37.103+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:37.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:37.131+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:37.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:37.253+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:38.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:38.107+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:38.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:38.135+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:38.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:38.265+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:39.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:39.107+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2758f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:39.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:39.139+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:39.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:39.285+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12691 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:40.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:40.295+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:40.305 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:40.299+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:40.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:40.301+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12769 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:41.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:41.293+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:41.305 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:41.298+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:41.308 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:41.302+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:42.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:42.302+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:42.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:42.306+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:42.325 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:42.317+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:43.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:43.306+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:43.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:43.306+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:43.397 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:43.389+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 12936 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:44.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:44.310+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:44.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:44.310+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:44.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:44.377+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:45.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:45.314+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:45.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:45.314+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:45.382 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:45.377+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:46.323 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:46.318+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e8fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:46.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:46.318+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:46.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:46.453+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:47.450 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:47.442+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:47.450 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:47.442+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:47.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:58:47.482+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:47.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:47.545+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:48.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:48.446+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:48.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:48.446+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e90a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:48.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:58:48.598+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:48.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:58:48.690+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:48.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:48.721+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:49.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:49.450+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:49.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:49.450+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:49.756 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:49.749+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13343 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:50.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:50.450+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:50.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:50.450+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:50.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:50.821+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:51.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:51.454+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:51.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:51.454+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e91f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:51.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:51.805+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:52.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:52.458+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:52.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:52.458+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:52.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:52.861+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:53.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:53.462+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e92d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:53.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:53.462+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:53.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:53.925+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:54.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:54.466+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:54.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:54.466+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:55.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:54.997+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13649 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:55.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:55.466+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:55.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:55.466+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e93b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:55.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:55.989+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:56.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:56.470+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:56.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:56.470+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:57.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:57.045+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:57.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:57.474+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:57.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:57.478+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:58.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:58.077+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:58.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:58.478+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:58.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:58.478+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:59.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:58:59.077+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:58:59.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:58:59.482+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:58:59.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:58:59.482+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:00.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:00.077+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 13976 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:00.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:00.482+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:00.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:00.486+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e95e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:01.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:01.149+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14028 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:01.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:01.486+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:01.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:01.490+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:02.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:02.209+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:02.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:02.490+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:02.500 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:02.494+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e96c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:03.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:03.217+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14116 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:03.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:03.490+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:03.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:03.494+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:04.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b2750 2019-12-16T22:59:04.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a3613b35f0 2019-12-16T22:59:04.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a3620152b0 2019-12-16T22:59:04.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a362016ff0 2019-12-16T22:59:04.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a362017190 2019-12-16T22:59:04.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a3620174d0 2019-12-16T22:59:04.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a362be0a40 2019-12-16T22:59:04.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.113+0000 7f66f9929700 -1 reset not still connected to 0x55a362d2fb50 2019-12-16T22:59:04.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a3645047d0 2019-12-16T22:59:04.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a364504970 2019-12-16T22:59:04.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a3686f4150 2019-12-16T22:59:04.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a368ee9ba0 2019-12-16T22:59:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a369f88340 2019-12-16T22:59:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a36b6774d0 2019-12-16T22:59:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a36bc75cf0 2019-12-16T22:59:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a36c721ba0 2019-12-16T22:59:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a37026d380 2019-12-16T22:59:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a37026e150 2019-12-16T22:59:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a370acca40 2019-12-16T22:59:04.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a370b76820 2019-12-16T22:59:04.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a378396f70 2019-12-16T22:59:04.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a3783988a0 2019-12-16T22:59:04.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.117+0000 7f66f9929700 -1 reset not still connected to 0x55a3797f39b0 2019-12-16T22:59:04.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:04.217+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:04.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:04.498+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:04.508 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:04.502+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e97a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:05.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:05.249+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:05.507 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:05.498+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747460d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:05.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:05.506+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:06.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:06.301+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:06.509 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:06.502+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745e8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:06.517 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:06.510+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:07.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:07.357+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:07.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:07.502+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:07.522 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:07.514+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e98f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:08.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:08.421+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:08.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:08.510+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:08.525 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:08.518+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:09.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:09.416+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:09.518 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:09.510+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:09.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:09.526+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e99d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:10.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:10.452+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:10.521 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:10.514+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:10.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:10.530+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:11.482 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:11.476+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:11.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:11.526+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:11.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:11.530+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:12.535 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:12.530+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:12.543 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:12.538+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:12.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:12.540+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14744 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:13.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:13.530+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:13.556 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:13.542+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:13.579 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:13.572+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:14.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:14.538+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:14.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:14.546+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:14.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:14.624+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14874 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:15.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:15.542+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4312d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:15.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:15.546+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86e9ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:15.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:15.648+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14916 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:16.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:16.546+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:16.558 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:16.550+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:16.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:16.708+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:17.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:59:17.481+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:17.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:17.557+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:17.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:17.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:17.748 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:17.740+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 14997 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:18.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:18.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:18.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:18.561+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:18.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:59:18.597+0000 7f1b551ee700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce500 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:18.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:2019-12-16T22:59:18.689+0000 7f1b63a0b700 -1 rbd::mirror::PoolReplayer: 0x55745e9ce000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:18.736 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:18.728+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:19.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:19.561+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:19.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:19.565+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:19.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:19.768+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:20.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:20.565+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:20.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:20.565+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:20.850 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:20.844+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:21.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:21.569+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:21.579 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:21.573+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:21.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:21.860+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:22.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:22.573+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4326f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:22.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:22.573+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:22.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:22.852+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:23.586 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:23.577+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:23.588 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:23.581+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:23.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:23.932+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15344 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:24.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:24.581+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:24.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:24.585+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4334f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:24.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:24.960+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15447 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:25.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:25.585+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:25.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:25.585+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4319d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:26.051 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:26.044+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:26.595 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:26.585+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:26.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:26.589+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:27.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:27.084+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:27.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:27.589+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:27.599 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:27.593+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4338e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:28.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:28.148+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:28.602 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:28.593+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:28.602 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:28.593+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:29.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:29.208+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:29.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:29.593+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:29.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:29.597+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:30.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:30.224+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15711 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:30.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:30.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:30.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:30.617+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4303f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:31.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:31.248+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:31.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:31.621+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:31.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:31.621+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:32.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:32.272+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15831 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:32.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:32.629+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:32.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:32.629+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:32.835 INFO:tasks.rbd_mirror_thrash:Failed to stop cluster2.client.mirror.0 2019-12-16T22:59:32.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 6 2019-12-16T22:59:32.836 ERROR:tasks.rbd_mirror_thrash:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/rbd_mirror_thrash.py", line 84, in _run self.do_thrash() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/rbd_mirror_thrash.py", line 156, in do_thrash run.wait([daemon.proc], timeout=600) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 451, in wait check_time() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds 2019-12-16T22:59:32.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr:*** Caught signal (Aborted) ** 2019-12-16T22:59:32.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.smithi177.stderr: in thread 7f1b86c79200 thread_name:rbd-mirror 2019-12-16T22:59:33.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:33.312+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 15885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:33.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:33.633+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:33.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:33.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:34.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:34.356+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:34.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:34.633+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:34.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:34.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:35.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:35.420+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:35.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:35.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:35.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:35.785+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:36.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:36.448+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:36.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:36.789+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eaa00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:36.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:36.789+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:37.531 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:37.524+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:37.575 INFO:tasks.daemonwatchdog.daemon_watchdog:thrasher.rbd_mirror.[cluster2] failed 2019-12-16T22:59:37.575 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-12-16T22:59:37.575 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/daemonwatchdog.py", line 37, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/daemonwatchdog.py", line 113, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage3-testing-2019-12-16-1157/qa/tasks/daemonwatchdog.py", line 53, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-12-16T22:59:37.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:37.793+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ea990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:37.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:37.793+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4300e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:37.841 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:59:37.837+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84a4e0 2019-12-16T22:59:37.842 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T22:59:37.837+0000 7fb660f13700 -1 reset not still connected to 0x55f63d84af70 2019-12-16T22:59:38.586 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:38.580+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:38.798 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:38.793+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eaae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:38.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:38.797+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4308c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:39.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:39.572+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:39.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:39.885+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eaa70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:39.889 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:39.885+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:40.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:40.652+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:40.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:40.889+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:40.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:40.889+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eabc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:41.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:41.740+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:41.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:41.893+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4333a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:41.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:41.893+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eab50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:42.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:42.792+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:42.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:42.893+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4307e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:42.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:42.897+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eaca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:43.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:43.844+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:43.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:43.897+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:43.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:43.897+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eac30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:44.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:44.897+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:44.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:44.901+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ead80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:44.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:44.932+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:45.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:45.901+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:45.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:45.905+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86ead10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:46.015 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:46.008+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:46.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:46.905+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eae60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:46.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:46.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4325a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:47.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:47.016+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:47.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T22:59:47.485+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:47.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:47.909+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eadf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:47.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:47.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:48.097 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:48.092+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:48.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:48.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:48.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:48.989+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eaf40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:49.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:49.136+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:49.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:49.925+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:49.996 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:49.993+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eaed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:50.158 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:50.152+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:51.044 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:51.037+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:51.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:51.041+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eb020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:51.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:51.219+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 16994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:52.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:52.041+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:52.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:52.045+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86eafb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:52.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:52.255+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17043 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:53.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:53.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4313b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:53.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:53.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:53.341 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:53.335+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:54.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:54.044+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:54.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:54.052+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:54.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:54.343+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17180 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:55.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:55.056+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:55.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:55.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:55.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:55.403+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:56.062 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:56.056+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:56.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:56.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:56.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:56.455+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:57.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:57.060+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:57.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:57.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4304d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:57.472 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:57.463+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17344 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:58.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:58.060+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ff00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:58.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:58.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:58.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:58.511+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T22:59:59.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T22:59:59.064+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:59.242 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T22:59:59.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T22:59:59.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T22:59:59.587+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:00.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:00.064+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:00.246 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:00.240+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:00.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:00.587+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:01.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:01.068+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852eb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:01.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:01.244+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:01.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:01.575+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 17575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:02.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:02.072+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:02.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:02.248+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4309a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:02.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:02.567+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:03.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:03.072+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:03.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:03.248+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:03.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:03.639+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:04.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:04.076+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:04.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:04.252+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:04.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:04.659+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:05.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:05.080+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:05.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:05.256+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:05.677 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:05.671+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:06.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:06.080+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:06.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:06.256+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:06.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:06.727+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:07.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:07.084+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cd20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:07.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:07.260+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:07.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:07.803+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:08.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:08.084+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852edf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:08.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:08.260+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:08.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:08.839+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:09.093 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:09.088+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:09.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:09.264+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:09.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:09.843+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18645 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:10.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:10.092+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:10.271 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:10.264+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:10.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:10.847+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 18687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:11.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:11.092+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a27d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:11.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:11.268+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:11.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:11.867+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:12.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:12.096+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:12.276 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:12.272+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:12.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:12.907+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:13.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:13.160+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:13.279 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:13.276+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:13.984 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:13.975+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:14.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:14.164+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:14.281 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:14.276+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:15.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:15.035+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19259 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:15.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:15.164+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a28b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:15.283 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:15.280+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:16.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:16.063+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:16.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:16.168+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:16.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:16.280+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:17.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:17.091+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:17.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:17.168+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a3170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:17.289 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:17.284+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:17.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:00:17.484+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:18.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:18.115+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19436 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:18.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:18.180+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:18.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:18.288+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:19.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:19.143+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:19.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:19.184+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:19.293 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:19.288+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:20.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:20.184+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a15e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:20.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:20.223+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:20.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:20.292+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:21.195 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:21.188+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:21.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:21.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:21.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:21.303+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19581 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:22.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:22.192+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:22.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:22.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:22.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:22.307+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:23.199 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:23.192+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a11f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:23.305 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:23.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:23.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:23.391+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:24.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:24.196+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a31e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:24.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:24.304+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:24.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:24.479+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:25.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:25.196+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a18f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:25.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:25.304+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:25.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:25.495+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:26.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:26.404+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:26.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:26.404+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:26.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:26.503+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:27.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:27.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:27.539 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:27.531+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:27.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:27.608+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:28.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:28.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:28.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:28.599+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 19975 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:28.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:28.608+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:29.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:29.411+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:29.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:29.611+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:29.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:29.651+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:30.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:30.411+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:30.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:30.615+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a31e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:30.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:30.707+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20112 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:31.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:31.415+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:31.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:31.615+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:31.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:31.791+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:32.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:32.419+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:32.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:32.619+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:32.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:32.834+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:33.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:33.423+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:33.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:33.623+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:33.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:33.918+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:34.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:34.423+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:34.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:34.623+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:34.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:34.966+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:35.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:35.427+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:35.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:35.627+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:36.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:36.050+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:36.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:36.427+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a3250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:36.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:36.627+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:37.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:37.098+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:37.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:37.603+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:37.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:37.631+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:38.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:38.154+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20495 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:38.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:38.607+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:38.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:38.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a09a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:39.268 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:39.258+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20552 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:39.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:39.607+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:39.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:39.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:40.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:40.338+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20610 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:40.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:40.611+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a21b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:40.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:40.639+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:41.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:41.390+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:41.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:41.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:41.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:41.639+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:42.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:42.430+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:42.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:42.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:42.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:42.643+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:43.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:43.454+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:43.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:43.619+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a07e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:43.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:43.647+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:44.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:44.514+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20875 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:44.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:44.623+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a05b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:44.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:44.651+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:45.545 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:45.538+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:45.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:45.623+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:45.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:45.655+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a02a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:46.545 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:46.542+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:46.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:46.627+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a24c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:46.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:46.655+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:47.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:00:47.483+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:47.599 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:47.594+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 20976 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:47.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:47.631+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:47.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:47.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:48.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:48.610+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:48.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:48.631+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:48.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:48.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:49.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:49.635+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:49.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:49.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:49.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:49.666+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:50.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:50.635+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a16c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:50.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:50.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:50.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:50.686+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:51.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:51.639+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:51.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:51.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:51.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:51.690+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:52.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:52.643+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a04d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:52.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:52.671+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8803f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:52.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:52.746+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:53.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:53.782+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:53.798 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:53.791+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:53.798 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:53.791+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:54.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:54.795+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:54.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:54.795+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:54.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:54.882+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:55.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:55.795+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c396b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:55.803 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:55.799+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:55.932 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:55.926+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:56.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:56.799+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:56.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:56.799+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:56.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:56.982+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:57.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:57.799+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:57.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:57.803+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:58.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:58.014+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:58.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:58.803+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:58.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:58.807+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:59.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:00:59.050+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:00:59.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:00:59.807+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:00:59.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:00:59.807+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:00.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:00.098+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:00.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:00.807+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:00.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:00.811+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:01.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:01.174+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:01.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:01.811+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:01.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:01.811+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:02.219 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:02.214+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:02.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:02.823+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:02.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:02.823+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:03.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:03.242+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:03.830 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:03.823+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:03.830 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:03.823+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:04.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:04.334+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:04.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:04.827+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:04.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:04.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8819d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:05.372 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:05.366+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 21948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:05.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:05.827+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:05.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:05.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:06.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:06.366+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:06.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:06.830+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:06.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:06.830+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8805b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:07.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:07.414+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:07.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:07.834+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:07.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:07.834+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:08.464 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:08.458+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:08.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:08.834+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c360e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:08.843 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:08.834+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8828b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:09.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:09.510+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:09.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:09.838+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c381b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:09.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:09.838+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:10.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:10.598+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:10.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:10.838+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c385a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:10.848 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:10.842+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:11.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:11.678+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:11.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:11.842+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:11.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:11.846+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:12.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:12.746+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:12.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:12.846+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:12.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:12.846+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:13.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:13.826+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:13.855 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:13.850+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:13.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:13.850+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:14.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:14.850+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8811f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:14.859 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:14.850+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:14.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:14.913+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:15.860 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:15.854+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8818f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:15.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:15.854+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c362a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:15.918 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:15.909+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22468 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:16.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:16.854+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:16.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:16.858+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:16.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:16.929+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:17.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:01:17.486+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:17.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:17.858+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:17.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:17.858+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:17.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:17.981+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:18.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:18.862+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8839c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:18.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:18.862+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c368c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:19.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:19.005+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:19.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:19.862+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8813b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:19.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:19.978+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:20.067 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:20.061+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:20.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:20.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:20.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:20.982+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:21.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:21.077+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:21.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:21.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2765a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:21.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:21.986+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:22.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:22.133+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:22.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:22.870+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2753b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:22.995 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:22.986+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:23.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:23.209+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:23.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:23.870+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:23.998 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:23.990+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:24.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:24.241+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22864 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:24.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:24.874+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:25.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:24.994+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:25.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:25.337+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:25.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:25.874+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:26.005 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:25.994+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:26.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:26.377+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 22995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:26.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:26.878+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2755e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:27.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:27.002+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:27.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:27.385+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:27.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:27.878+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:28.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:28.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:28.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:28.437+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:28.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:28.882+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2741c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:29.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:29.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83410a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:29.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:29.505+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:29.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:29.886+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:30.017 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:30.010+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:30.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:30.545+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:30.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:30.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:31.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:31.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83404d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:31.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:31.629+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:31.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:31.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:32.024 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:32.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83413b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:32.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:32.677+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:32.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:32.894+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:33.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:33.018+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:33.754 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:33.745+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:33.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:33.894+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:34.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:34.022+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83439c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:34.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:34.813+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:34.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:34.898+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:35.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:35.022+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:35.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:35.901+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:35.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:35.898+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:36.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:36.026+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:36.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:36.902+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:36.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:36.981+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:37.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:37.026+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:37.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:37.906+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:38.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:38.030+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83417a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:38.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:38.037+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:38.914 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:38.906+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:39.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:39.034+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83409a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:39.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:39.037+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:39.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:39.910+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:40.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:40.034+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c399c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:40.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:40.117+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23711 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:40.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:40.910+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:41.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:41.038+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:41.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:41.137+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:41.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:41.914+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:42.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:42.038+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c387d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:42.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:42.209+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:42.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:42.918+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:43.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:43.042+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c395d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:43.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:43.277+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23881 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:43.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:43.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:44.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:44.041+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:44.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:44.329+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:44.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:44.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:45.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:45.045+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c372d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:45.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:45.409+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 23996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:45.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:45.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:46.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:46.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:46.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:46.521+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24068 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:46.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:46.925+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:47.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:47.109+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:47.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:01:47.485+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:47.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:47.597+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:47.938 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:47.929+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:48.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:48.113+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:48.677 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:48.669+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:48.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:48.929+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:49.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:49.117+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c375e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:49.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:49.665+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:49.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:49.933+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:50.128 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:50.121+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:50.739 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:50.729+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:50.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:50.933+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:51.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:51.121+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:51.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:51.737+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:51.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:51.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:52.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:52.125+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c364d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:52.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:52.825+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:52.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:52.941+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:53.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:53.125+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c363f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:53.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:53.925+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:53.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:53.941+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:54.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:54.129+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:54.955 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:54.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:54.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:54.965+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:55.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:55.133+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:55.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:55.949+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:56.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:56.029+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:56.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:56.133+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:56.958 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:56.949+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:57.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:57.100+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:57.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:57.137+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:57.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:57.953+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5171e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:58.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:58.141+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:58.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:58.236+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:58.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:58.961+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:59.150 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:01:59.145+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:01:59.282 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:01:59.272+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:01:59.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:01:59.961+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:00.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:00.149+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:00.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:00.276+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:00.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:00.965+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5173a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:01.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:01.153+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:01.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:01.356+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:01.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:01.965+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:02.158 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:02.153+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:02.482 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:02.476+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:02.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:02.969+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:03.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:03.157+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:03.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:03.568+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24856 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:03.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:03.973+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:04.162 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:04.157+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:04.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:04.608+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24911 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:04.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:04.973+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:05.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:05.161+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:05.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:05.644+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 24963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:05.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:05.977+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4313b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:06.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:06.161+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:06.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:06.704+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:06.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:06.977+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:07.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:07.165+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:07.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:07.752+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:07.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:07.981+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4326f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:08.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:08.169+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:08.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:08.760+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:08.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:08.981+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:09.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:09.173+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c379d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:09.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:09.784+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:09.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:09.985+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:10.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:10.173+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:10.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:10.828+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25193 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:10.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:10.989+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:11.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:11.177+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:11.943 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:11.936+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:11.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:11.989+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:12.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:12.181+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:12.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:12.993+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:13.008 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:13.000+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:13.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:13.181+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:13.999 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:13.997+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:14.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:14.072+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:14.194 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:14.189+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c367e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:15.002 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:14.997+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:15.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:15.140+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:15.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:15.193+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:16.005 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:16.001+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4334f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:16.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:16.156+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:16.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:16.193+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:17.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:17.001+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4316c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:17.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:17.197+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:17.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:17.256+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:17.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:02:17.489+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:18.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:18.005+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:18.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:18.197+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:18.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:18.308+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:19.011 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:19.005+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4321b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:19.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:19.201+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c384c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:19.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:19.368+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:20.013 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:20.009+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:20.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:20.205+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:20.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:20.440+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:21.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:21.012+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:21.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:21.208+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:21.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:21.524+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25710 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:22.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:22.012+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:22.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:22.208+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:22.590 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:22.580+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:23.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:23.016+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:23.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:23.212+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c378f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:23.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:23.636+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:24.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:24.020+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:24.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:24.216+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:24.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:24.644+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:25.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:25.020+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4309a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:25.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:25.216+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:25.671 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:25.664+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:26.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:26.024+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:26.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:26.220+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:26.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:26.756+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 25979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:27.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:27.028+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:27.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:27.224+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:27.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:27.832+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:28.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:28.028+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:28.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:28.224+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:28.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:28.920+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:29.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:29.032+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:29.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:29.228+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:30.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:30.032+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:30.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:30.036+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:30.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:30.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:31.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:31.040+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:31.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:31.096+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:31.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:31.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c394f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:32.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:32.040+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:32.127 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:32.120+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:32.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:32.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:33.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:33.044+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:33.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:33.164+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:33.243 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:33.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:34.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:34.044+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:34.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:34.208+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:34.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:34.240+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:35.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:35.048+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4312d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:35.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:35.212+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26396 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:35.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:35.240+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:36.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:36.052+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:36.249 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:36.244+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c393a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:36.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:36.332+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26443 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:37.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:37.052+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:37.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:37.248+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:37.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:37.352+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26487 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:38.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:38.056+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:38.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:38.248+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:38.418 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:38.412+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:39.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:39.056+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:39.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:39.252+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:39.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:39.451+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:40.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:40.060+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:40.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:40.256+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c361c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:40.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:40.527+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:41.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:41.060+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:41.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:41.256+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:41.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:41.607+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:42.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:42.064+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:42.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:42.260+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:42.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:42.703+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:43.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:43.068+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:43.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:43.264+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:43.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:43.731+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:44.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:44.068+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:44.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:44.264+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:44.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:44.823+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:45.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:45.072+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4328b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:45.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:45.436+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:45.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:45.867+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:46.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:46.072+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:46.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:46.440+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:46.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:46.919+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:47.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:47.076+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:47.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:47.440+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c391e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:47.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:02:47.496+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:47.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:47.955+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:48.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:48.080+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:48.449 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:48.444+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c370a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:49.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:49.011+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 26991 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:49.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:49.080+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4303f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:49.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:49.448+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:50.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:50.084+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:50.146 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:50.139+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:50.454 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:50.448+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:51.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:51.088+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:51.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:51.195+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:51.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:51.452+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:52.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:52.092+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4319d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:52.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:52.456+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:52.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:52.527+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:53.099 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:53.092+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4338e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:53.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:53.464+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:53.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:53.587+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:54.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:54.096+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:54.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:54.468+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:54.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:54.675+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:55.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:55.100+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:55.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:55.468+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:55.748 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:55.739+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:56.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:56.104+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:56.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:56.472+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:56.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:56.775+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:57.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:57.108+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:57.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:57.476+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:57.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:57.843+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:58.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:58.111+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:58.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:58.475+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83424c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:58.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:58.851+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:02:59.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:02:59.655+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:59.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:02:59.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:02:59.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:02:59.919+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:00.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:00.659+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:00.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:00.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4317a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:00.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:00.979+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:01.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:01.663+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:01.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:01.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:02.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:02.035+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:02.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:02.667+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:02.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:02.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:03.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:03.107+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:03.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:03.667+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:03.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:03.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:04.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:04.131+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27711 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:04.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:04.671+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:04.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:04.671+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:05.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:05.191+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:05.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:05.671+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:05.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:05.675+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:06.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:06.247+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:06.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:06.675+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:06.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:06.823+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:07.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:07.295+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:07.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:07.675+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:07.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:07.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:08.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:08.403+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:08.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:08.679+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83427d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:08.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:08.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:09.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:09.415+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:09.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:09.683+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:09.843 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:09.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:10.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:10.487+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 27966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:10.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:10.683+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:11.017 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:11.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:11.561 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:11.551+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28015 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:11.694 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:11.687+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:12.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:12.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:12.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:12.639+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:12.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:12.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:13.021 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:13.015+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:13.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:13.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:13.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:13.719+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:14.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:14.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:14.702 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:14.695+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:14.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:14.787+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:15.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:15.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:15.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:15.699+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:15.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:15.851+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:16.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:16.023+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745e700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:16.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:16.699+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:16.856 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:16.847+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:17.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:17.023+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:17.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:03:17.543+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:17.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:17.703+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83438e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:17.906 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:17.899+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:18.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:18.027+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:18.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:18.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83405b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:18.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:18.983+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28363 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:19.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:19.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:19.718 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:19.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8342d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:20.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:20.031+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:20.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:20.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:20.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:20.715+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:21.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:21.039+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:21.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:21.118+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:21.723 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:21.715+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8340460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:22.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:22.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745e8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:22.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:22.206+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:22.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:22.719+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8343e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:23.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:23.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:23.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:23.270+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:23.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:23.723+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8341ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:24.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:24.047+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:24.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:24.326+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:24.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:24.727+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:25.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:25.047+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:25.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:25.354+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:25.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:25.727+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:26.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:26.051+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:26.374 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:26.366+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:26.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:26.731+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:27.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:27.055+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:27.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:27.418+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:27.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:27.735+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ec30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:28.062 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:28.055+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:28.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:28.498+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:28.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:28.735+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:29.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:29.059+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:29.590 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:29.582+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:29.744 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:29.739+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ccb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:30.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:30.059+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:30.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:30.590+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 28956 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:30.747 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:30.739+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:31.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:31.063+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:31.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:31.658+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:31.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:31.743+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:32.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:32.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a07e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:32.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:32.694+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:32.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:32.791+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:33.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:33.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:33.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:33.710+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:33.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:33.791+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:34.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:34.071+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:34.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:34.754+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:34.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:34.795+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:35.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:35.075+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:35.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:35.799+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:35.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:35.810+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:36.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:36.075+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:36.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:36.803+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:36.837 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:36.834+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:37.085 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:37.079+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:37.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:37.802+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cfc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:38.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:38.082+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:38.115 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:38.110+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:38.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:38.806+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ca80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:39.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:39.082+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:39.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:39.266+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29396 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:39.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:39.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:40.093 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:40.086+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:40.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:40.354+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:40.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:40.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:41.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:41.090+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:41.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:41.398+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:41.821 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:41.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ff00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:42.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:42.090+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a34f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:42.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:42.482+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:42.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:42.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:43.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:43.094+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:43.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:43.558+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:43.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:43.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:44.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:44.098+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:44.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:44.682+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29651 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:44.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:44.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:45.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:45.098+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:45.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:45.726+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29695 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:45.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:45.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:46.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:46.102+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a32c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:46.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:46.814+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:46.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:46.826+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:47.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:47.106+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:47.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:03:47.570+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:47.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:47.830+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:47.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:47.898+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:48.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:48.110+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:48.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:48.830+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852edf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:48.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:48.986+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:49.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:49.110+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:49.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:49.834+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:50.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:50.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a17a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:50.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:50.122+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:50.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:50.838+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:51.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:51.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:51.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:51.206+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 29958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:51.848 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:51.838+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:52.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:52.118+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:52.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:52.330+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:52.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:52.842+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:53.128 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:53.122+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:53.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:53.434+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:53.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:53.846+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:54.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:54.122+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:54.489 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:54.482+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30116 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:54.855 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:54.846+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852db20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:55.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:55.126+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:55.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:55.566+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:55.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:55.850+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:56.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:56.126+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a13b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:56.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:56.594+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:56.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:56.854+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:57.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:57.130+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a10a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:57.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:57.674+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:57.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:57.854+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:58.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:58.134+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:58.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:58.682+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:58.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:58.858+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:59.143 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:03:59.134+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:03:59.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:03:59.742+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:03:59.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:03:59.862+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:00.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:00.138+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:00.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:00.794+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:00.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:00.862+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852de30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:01.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:01.142+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a02a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:01.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:01.866+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:01.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:01.918+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:02.152 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:02.142+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:02.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:02.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852caf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:03.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:03.033+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:03.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:03.146+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:03.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:03.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:04.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:04.085+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:04.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:04.146+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:04.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:04.874+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:05.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:05.121+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:05.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:05.150+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:05.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:05.878+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:06.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:06.154+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:06.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:06.173+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:06.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:06.878+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:07.162 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:07.154+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5153b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:07.223 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:07.217+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:07.889 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:07.882+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:08.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:08.158+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:08.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:08.237+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30776 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:08.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:08.886+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:09.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:09.162+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:09.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:09.345+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30824 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:09.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:09.886+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:10.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:10.162+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:10.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:10.397+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30891 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:10.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:10.890+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:11.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:11.166+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5165a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:11.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:11.457+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:11.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:11.894+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ef40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:12.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:12.170+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:12.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:12.541+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 30997 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:12.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:12.894+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3542920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:13.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:13.174+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5160d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:13.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:13.625+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:13.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:13.898+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f35411f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:14.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:14.174+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5178e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:14.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:14.733+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:14.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:14.902+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3541490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:15.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:15.178+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:15.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:15.825+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:15.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:15.902+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3543100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:16.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:16.178+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:16.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:16.905+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3541730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:16.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:16.937+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:17.194 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:17.181+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5156c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:17.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:04:17.569+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:17.914 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:17.905+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3541570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:18.087 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:18.081+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:18.190 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:18.181+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:18.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:18.909+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3542e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:19.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:19.129+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:19.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:19.185+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:19.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:19.909+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:20.195 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:20.185+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:20.239 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:20.233+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:20.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:20.913+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:21.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:21.189+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:21.332 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:21.325+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:21.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:21.917+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c381b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:22.199 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:22.189+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:22.424 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:22.417+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:22.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:22.917+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:23.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:23.193+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:23.599 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:23.593+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:23.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:23.921+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:24.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:24.197+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5168b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:24.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:24.677+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:24.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:24.925+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:25.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:25.213+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5161b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:25.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:25.741+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:25.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:25.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c36a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:26.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:26.213+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5142a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:26.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:26.809+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:26.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:26.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:27.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:27.217+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5176b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:27.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:27.869+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:27.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:27.941+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:28.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:28.221+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5149a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:28.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:28.941+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:28.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:28.985+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:29.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:29.221+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:29.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:29.945+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:30.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:30.073+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:30.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:30.225+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:30.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:30.949+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c368c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:31.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:31.129+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:31.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:31.229+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:31.958 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:31.949+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c360e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:32.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:32.193+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 31968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:32.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:32.389+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5179c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:32.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:32.957+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c39870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:33.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:33.205+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:33.395 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:33.393+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:33.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:33.957+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c385a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:34.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:34.253+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:34.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:34.477+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:34.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:34.961+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c396b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:35.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:35.285+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:35.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:35.481+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5152d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:35.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:35.965+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:36.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:36.333+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:36.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:36.485+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:36.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:36.965+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c37c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:37.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:37.413+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:37.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:37.489+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5151f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:37.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:37.973+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7c38220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:38.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:38.489+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:38.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:38.513+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:38.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:38.973+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:39.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:39.493+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:39.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:39.637+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32245 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:39.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:39.977+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:40.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:40.561+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5164c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:40.725 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:40.717+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:40.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:40.981+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:41.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:41.569+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:41.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:41.825+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32344 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:41.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:41.981+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdf00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:42.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:42.569+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:42.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:42.929+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:42.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:42.985+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:43.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:43.573+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:43.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:43.985+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:44.023 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:44.017+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:44.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:44.577+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:45.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:45.148+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:45.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:45.225+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:45.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:45.577+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:46.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:46.229+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcfb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:46.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:46.248+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:46.587 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:46.581+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:47.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:47.229+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:47.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:47.384+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:47.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:04:47.573+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:47.587 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:47.585+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:48.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:48.233+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:48.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:48.472+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:48.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:48.585+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:49.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:49.237+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:49.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:49.544+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32665 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:49.592 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:49.589+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b514540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:50.242 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:50.237+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:50.595 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:50.589+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:50.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:50.652+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:51.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:51.241+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:51.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:51.593+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:51.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:51.752+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:52.249 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:52.245+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:52.599 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:52.593+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:52.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:52.860+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32816 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:53.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:53.249+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:53.601 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:53.597+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:53.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:53.880+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:54.254 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:54.249+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:54.604 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:54.601+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:55.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:55.028+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:55.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:55.252+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:55.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:55.600+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:56.146 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:56.140+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 32947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:56.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:56.252+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:56.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:56.604+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:57.205 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:57.200+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:57.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:57.256+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:57.611 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:57.604+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:58.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:58.260+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:58.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:58.268+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:58.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:58.664+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4318f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:59.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:04:59.260+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:04:59.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:04:59.392+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:04:59.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:04:59.668+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:00.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:00.264+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:00.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:00.500+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:00.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:00.668+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4302a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:01.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:01.264+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdf70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:01.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:01.584+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:01.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:01.672+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:02.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:02.268+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:02.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:02.676+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:02.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:02.752+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:03.277 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:03.272+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:03.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:03.676+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:03.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:03.868+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:04.278 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:04.272+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:04.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:04.680+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:04.923 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:04.916+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:05.281 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:05.276+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:05.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:05.684+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4339c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:05.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:05.984+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:06.283 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:06.276+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcf40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:06.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:06.684+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:07.127 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:07.120+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:07.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:07.324+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:07.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:07.688+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:08.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:08.180+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:08.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:08.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:08.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:08.692+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4307e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:09.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:09.272+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:09.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:09.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:09.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:09.692+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:10.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:10.296+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:10.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:10.792+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4333a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:10.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:10.792+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:11.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:11.400+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 33588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:11.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:11.796+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:11.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:11.796+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:12.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:12.464+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 34015 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:12.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:12.796+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:12.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:12.800+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:13.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:13.600+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 34333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:13.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:13.800+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:13.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:13.804+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:14.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:14.720+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 34802 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:14.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:14.800+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:14.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:14.804+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:15.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:15.796+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35078 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:15.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:15.808+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:15.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:15.944+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:16.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:16.888+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:16.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:16.896+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:16.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:16.944+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:17.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:05:17.572+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:17.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:17.896+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:17.950 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:17.944+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:17.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:17.948+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:18.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:18.900+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:18.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:18.952+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:19.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:19.148+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:19.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:19.904+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:19.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:19.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4315e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:20.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:20.232+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35243 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:20.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:20.904+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:20.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:20.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:21.304 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:21.296+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35285 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:21.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:21.908+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:21.965 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:21.960+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:22.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:22.340+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:22.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:22.908+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:22.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:22.964+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:23.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:23.444+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:23.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:23.912+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:23.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:23.964+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:24.486 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:24.480+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:24.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:24.912+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:24.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:24.968+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4308c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:25.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:25.508+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:25.920 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:25.916+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:25.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:25.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:26.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:26.628+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:26.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:26.916+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:26.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:26.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:27.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:27.703+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:27.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:27.920+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:27.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:27.976+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4312d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:28.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:28.739+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:28.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:28.976+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:28.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:28.984+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:29.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:29.875+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35669 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:29.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:29.980+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:29.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:29.988+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:30.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:30.895+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35724 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:30.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:30.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:30.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:30.988+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:31.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:31.943+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:31.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:31.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:31.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:31.992+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:32.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:32.988+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4321b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:32.999 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:32.992+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75be9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:33.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:32.995+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:33.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:33.987+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:34.002 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:33.995+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bea10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:34.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:34.095+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:34.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:34.991+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4316c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:35.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:35.003+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bea80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:35.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:35.211+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35864 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:36.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:36.007+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75beaf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:36.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:36.007+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:36.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:36.279+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:37.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:37.007+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75beb60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:37.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:37.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:37.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:37.395+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:38.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:38.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bebd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:38.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:38.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:38.511 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:38.503+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 35992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:39.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:39.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bec40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:39.021 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:39.015+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:39.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:39.631+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:40.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:40.015+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75becb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:40.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:40.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4336b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:40.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:40.687+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:41.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:41.019+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bed20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:41.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:41.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:41.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:41.799+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:42.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:42.023+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4331e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:42.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:42.023+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bed90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:42.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:42.975+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:43.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:43.027+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4323e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:43.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:43.027+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bee00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:44.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:44.027+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4309a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:44.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:44.027+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bee70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:44.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:44.091+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:45.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:45.031+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:45.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:45.031+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75beee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:45.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:45.127+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:46.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:46.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4305b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:46.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:46.163+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:46.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:46.227+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bef50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:47.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:47.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:47.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:47.231+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75befc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:47.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:47.243+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:47.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:05:47.571+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:48.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:48.039+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4310a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:48.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:48.235+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:48.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:48.335+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:49.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:49.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:49.243 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:49.239+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:49.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:49.495+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36409 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:50.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:50.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:50.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:50.239+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:50.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:50.551+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:51.189 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:51.183+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:51.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:51.243+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:51.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:51.607+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:52.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:52.327+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:52.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:52.327+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:52.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:52.743+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36555 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:53.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:53.331+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4326f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:53.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:53.331+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:53.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:53.819+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:54.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:54.331+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:54.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:54.331+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:54.983 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:54.975+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:55.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:55.335+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:55.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:55.335+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:56.063 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:56.055+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:56.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:56.339+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:56.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:56.339+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:57.151 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:57.143+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36760 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:57.346 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:57.339+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:57.346 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:57.339+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:58.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:58.203+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36805 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:58.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:58.343+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:58.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:58.459+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:59.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:05:59.251+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:05:59.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:05:59.343+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:05:59.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:05:59.463+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:00.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:00.347+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:00.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:00.371+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36929 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:00.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:00.463+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:01.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:01.347+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:01.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:01.467+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:01.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:01.471+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 36984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:02.357 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:02.351+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:02.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:02.471+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:02.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:02.583+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:03.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:03.351+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:03.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:03.471+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:03.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:03.715+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:04.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:04.355+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:04.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:04.475+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:04.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:04.783+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:05.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:05.423+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4332c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:05.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:05.479+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:05.892 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:05.883+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:06.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:06.423+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:06.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:06.479+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:06.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:06.919+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:07.433 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:07.427+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:07.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:07.483+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:08.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:08.035+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:08.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:08.431+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:08.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:08.487+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:09.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:09.147+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:09.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:09.431+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4317a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:09.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:09.487+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:10.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:10.254+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:10.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:10.531+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:10.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:10.531+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bf9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:11.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:11.350+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:11.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:11.531+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:11.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:11.531+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfa40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:12.473 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:12.462+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:12.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:12.534+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:12.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:12.534+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:13.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:13.538+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:13.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:13.538+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfb20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:13.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:13.766+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:14.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:14.538+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:14.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:14.542+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfb90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:14.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:14.990+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:15.549 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:15.542+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:15.550 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:15.542+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:16.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:16.010+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:16.551 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:16.546+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:16.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:16.546+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:17.087 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:17.078+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:17.554 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:17.546+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:17.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:17.546+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:17.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:06:17.574+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:18.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:18.122+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37655 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:18.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:18.550+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:18.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:18.550+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:19.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:19.262+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:19.559 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:19.554+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:19.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:19.554+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfdc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:20.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:20.326+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:20.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:20.554+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2749a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:20.563 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:20.558+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:21.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:21.558+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2767d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:21.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:21.558+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:21.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:21.698+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37801 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:22.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:22.558+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2743f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:22.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:22.562+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bff10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:22.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:22.758+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:23.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:23.858+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bff80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:23.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:23.858+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:23.893 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:23.886+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:24.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:24.862+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:24.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:24.866+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75bfff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:24.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:24.922+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:25.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:25.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd923e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:25.875 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:25.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:25.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:25.974+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 37974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:26.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:26.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd921b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:26.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:26.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c00d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:27.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:27.126+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:27.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:27.870+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:27.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:27.874+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:28.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:28.150+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:28.880 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:28.874+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:28.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:28.874+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c01b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:29.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:29.166+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38107 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:29.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:29.874+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:29.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:29.878+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:30.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:30.282+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:30.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:30.878+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd902a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:30.889 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:30.882+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:31.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:31.390+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:31.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:31.882+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:31.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:31.886+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:32.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:32.478+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:32.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:32.882+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:32.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:32.886+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:33.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:33.606+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:33.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:33.886+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:33.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:33.890+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c03e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:34.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:34.730+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:34.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:34.886+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:34.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:34.894+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:35.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:35.754+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:35.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:35.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:35.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:35.894+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c04c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:36.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:36.830+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:36.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:36.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:36.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:36.898+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:37.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:37.894+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:37.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:37.902+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c05a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:37.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:37.990+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:39.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:39.038+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:39.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:39.222+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:39.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:39.222+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:40.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:40.046+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:40.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:40.222+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:40.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:40.226+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:41.139 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:41.134+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:41.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:41.226+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:41.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:41.226+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c06f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:42.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:42.182+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:42.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:42.230+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:42.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:42.230+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:43.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:43.234+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c07d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:43.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:43.238+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3defb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:43.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:43.274+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:44.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:44.294+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:44.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:44.294+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:44.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:44.366+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38710 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:45.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:45.290+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c08b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:45.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:45.294+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:45.434 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:45.430+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:46.301 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:46.294+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:46.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:46.294+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:46.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:46.578+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:47.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:47.298+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:47.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:47.298+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a12d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:47.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:06:47.574+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:47.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:47.638+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:48.306 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:48.298+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:48.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:48.298+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:48.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:48.690+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38872 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:49.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:49.302+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a07e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:49.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:49.302+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:49.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:49.802+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:50.312 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:50.306+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:50.312 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:50.306+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:50.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:50.950+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 38954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:51.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:51.305+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:51.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:51.305+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:52.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:52.045+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:52.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:52.309+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:52.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:52.309+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:53.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:53.093+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:53.319 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:53.309+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:53.319 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:53.313+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:54.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:54.149+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:54.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:54.313+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:54.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:54.313+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:55.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:55.269+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:55.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:55.317+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:55.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:55.317+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:56.326 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:56.317+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:56.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:56.321+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:56.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:56.369+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:57.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:57.321+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a18f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:57.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:57.321+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f75c0df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:57.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:57.449+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:58.330 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:58.321+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a01c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:58.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:58.325+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:58.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:58.509+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:06:59.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:06:59.325+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:59.335 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:06:59.329+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:06:59.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:06:59.601+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:00.335 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:00.325+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a23e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:00.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:00.329+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:00.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:00.769+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:01.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:01.329+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a21b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:01.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:01.333+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:01.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:01.821+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:02.340 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:02.333+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:02.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:02.337+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:02.893 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:02.885+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:03.342 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:03.333+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:03.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:03.337+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:03.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:03.981+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:04.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:04.337+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:04.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:04.341+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:05.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:05.001+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:05.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:05.337+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a04d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:05.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:05.489+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:06.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:06.077+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:06.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:06.345+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:06.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:06.497+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:07.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:07.193+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:07.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:07.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:07.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:07.501+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:08.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:08.309+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:08.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:08.353+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:08.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:08.501+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:09.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:09.353+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:09.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:09.401+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39700 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:09.521 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:09.505+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcc30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:10.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:10.357+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a33a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:10.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:10.497+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39737 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:10.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:10.505+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:11.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:11.357+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:11.514 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:11.509+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:11.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:11.577+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:12.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:12.361+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:12.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:12.513+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:12.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:12.629+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:13.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:13.681+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39847 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:14.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:14.037+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:14.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:14.037+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdf00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:14.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:14.837+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:15.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:15.041+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:15.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:15.041+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:15.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:15.925+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:16.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:16.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:16.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:16.045+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:17.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:17.021+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 39973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:17.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:17.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:17.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:17.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcf40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:17.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:07:17.617+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:18.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:18.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:18.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:18.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcfb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:18.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:18.113+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40008 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:19.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:19.105+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:19.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:19.109+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a31e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:19.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:19.361+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40043 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:20.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:20.109+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a34f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:20.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:20.109+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:20.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:20.445+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:21.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:21.113+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:21.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:21.113+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:21.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:21.493+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:22.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:22.113+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:22.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:22.117+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:22.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:22.609+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40176 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:23.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:23.117+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:23.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:23.117+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:23.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:23.709+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40203 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:24.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:24.137+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:24.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:24.137+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:24.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:24.745+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:25.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:25.141+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:25.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:25.141+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:25.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:25.917+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40295 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:26.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:26.145+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:26.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:26.145+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:27.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:26.997+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:27.151 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:27.149+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:27.152 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:27.149+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:28.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:28.089+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40364 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:28.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:28.149+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:28.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:28.149+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:29.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:29.152+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2772c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:29.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:29.152+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:29.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:29.329+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:30.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:30.152+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:30.161 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:30.156+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:30.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:30.517+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:31.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:31.156+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:31.162 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:31.156+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:31.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:31.605+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:32.162 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:32.156+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:32.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:32.160+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:32.723 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:32.717+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:33.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:33.160+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2755e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:33.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:33.160+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdf70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:33.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:33.856+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:34.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:34.220+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:34.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:34.220+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:34.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:34.948+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:35.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:35.220+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2741c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:35.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:35.224+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:36.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:36.124+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40640 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:36.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:36.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:36.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:36.224+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:37.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:37.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:37.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:37.228+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:37.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:37.304+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:38.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:38.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:38.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:38.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:38.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:38.372+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40723 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:39.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:39.340+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a13b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:39.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:39.340+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2753b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:39.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:39.428+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:40.349 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:40.344+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:40.351 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:40.344+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:40.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:40.516+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:41.351 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:41.344+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a31e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:41.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:41.348+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:41.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:41.584+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40855 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:42.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:42.348+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a04d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:42.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:42.348+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:42.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:42.680+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40884 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:43.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:43.348+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:43.357 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:43.352+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:43.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:43.780+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:44.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:44.352+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:44.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:44.356+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:44.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:44.892+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:45.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:45.356+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:45.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:45.356+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:46.051 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:46.044+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 40977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:46.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:46.360+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:46.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:46.360+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:47.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:47.084+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41004 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:47.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:47.360+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:47.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:47.364+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a11f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:47.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:07:47.628+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:48.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:48.100+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:48.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:48.364+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:48.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:48.364+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:49.161 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:49.156+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41083 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:49.373 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:49.368+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:49.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:49.368+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:50.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:50.212+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41128 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:50.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:50.368+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:50.376 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:50.372+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2766f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:51.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:51.372+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:51.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:51.372+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2750a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:51.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:51.376+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:52.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:52.376+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a23e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:52.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:52.376+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2768b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:52.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:52.456+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:53.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:53.376+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:53.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:53.376+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:53.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:53.544+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41263 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:54.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:54.460+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a32c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:54.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:54.460+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2748c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:54.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:54.692+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:55.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:55.464+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:55.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:55.464+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:55.880 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:55.872+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:56.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:56.464+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:56.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:56.468+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a3330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:56.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:56.980+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:57.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:57.468+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4317a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:57.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:57.472+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:58.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:58.012+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41456 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:58.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:58.472+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:58.478 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:58.472+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:59.075 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:07:59.068+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:07:59.521 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:07:59.516+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:07:59.521 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:07:59.516+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a24c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:00.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:00.096+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41523 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:00.525 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:00.520+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a3170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:00.525 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:00.520+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:01.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:01.176+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41560 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:01.528 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:01.524+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:01.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:01.524+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:02.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:02.280+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41601 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:02.530 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:02.524+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:02.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:02.528+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a05b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:03.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:03.384+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:03.534 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:03.528+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:03.534 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:03.528+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:04.490 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:04.484+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:04.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:04.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499acca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:04.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:04.532+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:05.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:05.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499acd80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:05.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:05.532+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a21b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:05.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:05.552+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:06.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:06.535+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:06.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:06.535+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:06.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:06.600+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:07.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:07.539+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a28b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:07.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:07.543+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:07.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:07.672+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41784 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:08.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:08.539+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:08.550 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:08.543+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:08.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:08.756+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:09.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:09.699+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:09.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:09.699+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:09.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:09.896+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:10.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:10.703+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:10.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:10.703+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a15e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:11.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:11.004+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:11.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:11.707+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:11.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:11.707+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:12.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:12.112+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:12.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:12.707+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aae70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:12.715 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:12.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a27d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:13.241 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:13.236+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 41974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:13.717 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:13.711+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:13.717 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:13.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a16c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:14.444 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:14.436+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:14.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:14.791+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:14.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:14.795+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:15.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:15.504+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:15.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:15.795+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:15.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:15.799+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a01c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:16.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:16.659+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:16.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:16.795+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aab60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:16.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:16.803+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a3250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:17.660 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:08:17.655+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:17.730 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:17.723+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:17.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:17.799+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:17.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:17.803+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a07e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:18.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:18.803+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:18.812 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:18.807+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:18.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:18.859+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:19.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:19.803+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:19.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:19.807+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:19.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:19.967+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:20.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:20.807+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:20.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:20.811+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:21.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:21.083+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:21.816 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:21.811+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aae00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:21.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:21.815+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:22.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:22.179+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:22.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:22.815+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aaaf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:22.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:22.815+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:23.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:23.327+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42356 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:23.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:23.819+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:23.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:23.819+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:24.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:24.391+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:24.827 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:24.823+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:24.827 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:24.823+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:25.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:25.491+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42440 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:25.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:25.823+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:25.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:25.823+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a33a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:26.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:26.611+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:26.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:26.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:26.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:26.827+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:27.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:27.707+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:27.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:27.827+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:27.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:27.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:28.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:28.735+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:28.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:28.831+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a26f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:28.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:28.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:29.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:29.855+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:29.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:29.855+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a19d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:29.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:29.919+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42620 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:30.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:30.859+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:30.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:30.859+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a12d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:31.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:31.019+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:31.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:31.859+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:31.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:31.863+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:32.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:32.199+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42691 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:32.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:32.863+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:32.875 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:32.867+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:33.318 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:33.311+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:33.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:33.867+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:33.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:33.871+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:34.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:34.467+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:34.959 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:34.951+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ada30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:34.959 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:34.951+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:35.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:35.583+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42815 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:35.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:35.955+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499acd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:35.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:35.955+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:36.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:36.691+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:36.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:36.959+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:36.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:36.959+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:37.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:37.743+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:37.967 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:37.963+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:37.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:37.963+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:38.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:38.955+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:38.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:38.963+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:38.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:38.967+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:39.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:39.967+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:39.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:39.967+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:40.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:40.095+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 42985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:40.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:40.967+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:40.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:40.971+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:41.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:41.195+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:41.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:41.971+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:41.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:41.975+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a2530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:42.355 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:42.343+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43088 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:42.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:42.971+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aafc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:42.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:42.975+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:43.403 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:43.395+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:43.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:43.975+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:43.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:43.979+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a1c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:44.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:44.503+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:44.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:44.978+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:44.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:44.982+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a0a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:45.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:45.619+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:45.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:45.978+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:45.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:45.982+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f73a18f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:46.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:46.719+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:46.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:46.982+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499adf70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:46.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:46.986+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:47.774 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:08:47.766+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:47.850 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:47.843+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:47.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:47.986+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:47.995 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:47.990+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:48.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:48.883+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:48.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:48.986+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aac40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:48.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:48.990+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:50.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:50.003+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43400 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:50.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:50.066+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:50.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:50.066+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:51.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:51.070+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:51.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:51.070+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:51.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:51.163+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:52.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:52.070+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:52.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:52.074+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:52.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:52.199+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:53.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:53.074+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:53.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:53.074+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:53.361 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:53.351+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43520 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:54.085 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:54.078+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:54.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:54.078+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499acfb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:54.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:54.523+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:55.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:55.090+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:55.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:55.086+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:55.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:55.599+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:56.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:56.090+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499acb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:56.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:56.090+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:56.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:56.619+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:57.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:57.094+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:57.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:57.094+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:57.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:57.766+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43671 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:58.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:58.098+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:58.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:58.254+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:58.894 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:08:58.886+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43705 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:08:59.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:08:59.098+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:08:59.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:08:59.254+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:00.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:00.014+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:00.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:00.182+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:00.265 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:00.258+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aad20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:01.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:01.106+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:01.194 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:01.186+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:01.266 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:01.258+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:02.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:02.190+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:02.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:02.254+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:02.269 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:02.262+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ace60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:03.199 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:03.190+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:03.271 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:03.266+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:03.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:03.342+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:04.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:04.194+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:04.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:04.266+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499adf00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:04.490 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:04.482+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:05.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:05.318+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:05.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:05.322+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:05.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:05.618+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 43953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:06.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:06.322+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:06.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:06.322+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:06.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:06.746+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:07.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:07.326+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:07.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:07.326+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:07.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:07.846+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:08.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:08.330+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:08.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:08.330+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:08.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:08.990+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44068 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:09.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:09.330+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806c9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:09.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:09.334+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:10.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:10.150+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:10.342 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:10.334+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:10.342 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:10.334+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ca10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:11.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:11.222+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:11.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:11.338+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:11.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:11.338+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ca80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:12.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:12.294+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:12.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:12.338+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aaf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:12.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:12.342+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806caf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:13.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:13.342+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cb60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:13.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:13.342+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ad640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:13.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:13.438+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:14.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:14.346+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:14.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:14.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cbd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:14.555 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:14.550+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:15.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:15.350+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abb90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:15.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:15.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cc40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:15.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:15.730+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44309 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:16.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:16.350+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aad90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:16.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:16.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ccb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:16.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:16.798+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:17.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:17.354+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cd20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:17.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:17.354+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499acbc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:17.780 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:09:17.774+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:17.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:17.838+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:18.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:18.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cd90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:18.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:18.358+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:19.008 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:19.002+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:19.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:19.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ce00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:19.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:19.358+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:20.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:20.094+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:20.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:20.362+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:20.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:20.362+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ce70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:21.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:21.174+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:21.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:21.366+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aa4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:21.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:21.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:22.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:22.326+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:22.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:22.365+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:22.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:22.369+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:23.376 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:23.369+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:23.382 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:23.373+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806cfc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:23.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:23.502+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:24.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:24.377+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:24.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:24.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:24.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:24.602+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:25.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:25.457+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ab650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:25.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:25.457+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:25.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:25.642+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44635 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:26.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:26.461+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499aaa10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:26.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:26.465+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:26.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:26.734+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44682 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:27.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:27.461+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499acdf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:27.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:27.465+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:27.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:27.826+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:28.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:28.465+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499abce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:28.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:28.469+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:28.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:28.918+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:29.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:29.465+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607499ac300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:29.478 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:29.469+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:30.031 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:30.026+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:30.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:30.665+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:30.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:30.669+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:31.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:31.174+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44832 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:31.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:31.673+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:31.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:31.841+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:32.431 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:32.426+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:32.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:32.677+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:32.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:32.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:33.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:33.518+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44915 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:33.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:33.677+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:33.854 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:33.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:34.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:34.681+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a03f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:34.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:34.690+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:34.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:34.849+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:35.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:35.681+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:35.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:35.734+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 44985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:35.859 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:35.853+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:36.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:36.685+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:36.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:36.857+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:36.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:36.870+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:37.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:37.693+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:37.864 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:37.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:38.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:38.018+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:38.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:38.693+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:38.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:38.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:39.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:39.138+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:39.702 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:39.697+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:39.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:39.865+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:40.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:40.201+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45160 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:40.704 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:40.701+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:40.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:40.865+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:41.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:41.273+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:41.758 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:41.753+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:41.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:41.869+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:42.386 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:42.381+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:42.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:42.757+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a31e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:42.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:42.873+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:43.482 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:43.477+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:43.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:43.757+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:43.889 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:43.877+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:44.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:44.693+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:44.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:44.761+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a34f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:44.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:44.881+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:45.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:45.765+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:45.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:45.877+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:45.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:45.881+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:46.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:46.765+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:46.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:46.885+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806d9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:47.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:47.037+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:47.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:47.769+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a25a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:47.808 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:09:47.805+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:47.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:47.885+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806da40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:48.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:48.161+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:48.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:48.769+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:48.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:48.889+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806dab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:49.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:49.285+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:49.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:49.773+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:49.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:49.897+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806db20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:50.441 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:50.433+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:51.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:51.333+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:51.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:51.333+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806db90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:51.478 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:51.473+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:52.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:52.333+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:52.340 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:52.337+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806dc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:52.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:52.517+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:53.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:53.337+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:53.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:53.341+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:53.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:53.629+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:54.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:54.341+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:54.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:54.341+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806dce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:54.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:54.853+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45655 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:55.349 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:55.341+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:55.349 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:55.345+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:56.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:56.009+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:56.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:56.345+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:56.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:56.345+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ddc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:57.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:57.137+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45736 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:57.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:57.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:57.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:57.349+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806de30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:58.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:58.309+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:09:58.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:58.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:58.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:58.353+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806dea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:59.357 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:09:59.352+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:59.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:09:59.352+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:09:59.521 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:09:59.513+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45795 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:00.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:00.356+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:00.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:00.356+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:00.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:00.681+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45840 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:01.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:01.356+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:01.363 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:01.360+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806dff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:01.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:01.769+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45884 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:02.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:02.360+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:02.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:02.360+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:02.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:02.841+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:03.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:03.360+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:03.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:03.364+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:03.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:03.937+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 45965 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:04.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:04.364+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:04.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:04.364+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:04.984 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:04.977+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:05.373 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:05.368+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a21b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:05.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:05.368+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:06.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:05.997+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:06.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:06.368+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:06.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:06.372+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:07.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:07.053+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:07.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:07.372+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:07.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:07.376+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:08.175 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:08.169+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46136 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:08.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:08.372+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:08.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:08.376+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:09.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:09.285+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46165 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:09.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:09.376+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:09.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:09.380+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:10.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:10.380+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:10.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:10.380+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:10.543 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:10.537+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:11.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:11.380+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:11.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:11.384+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:11.691 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:11.685+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:12.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:12.384+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:12.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:12.384+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:12.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:12.753+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:13.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:13.384+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a28b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:13.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:13.388+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:13.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:13.869+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:14.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:14.388+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:14.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:14.392+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:15.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:15.141+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:15.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:15.392+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:15.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:15.392+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:16.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:16.201+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:16.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:16.392+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:16.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:16.396+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:17.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:17.396+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:17.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:17.401+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:17.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:17.404+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:17.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:10:17.804+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:18.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:18.396+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a10a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:18.411 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:18.404+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:18.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:18.489+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46496 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:19.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:19.400+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:19.413 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:19.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:19.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:19.665+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:20.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:20.404+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:20.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:20.412+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:20.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:20.797+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:21.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:21.408+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:21.419 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:21.412+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:21.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:21.872+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:22.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:22.408+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:22.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:22.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:23.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:23.040+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46621 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:23.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:23.416+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:23.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:23.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806e990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:24.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:24.192+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:24.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:24.416+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:24.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:24.420+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ea00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:25.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:25.340+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46700 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:25.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:25.420+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:25.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:25.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:26.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:26.420+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:26.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:26.428+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806eae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:26.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:26.488+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:27.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:27.428+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806eb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:27.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:27.508+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46781 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:27.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:27.608+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:28.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:28.432+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ebc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:28.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:28.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:28.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:28.632+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:29.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:29.436+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ec30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:29.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:29.616+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:29.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:29.776+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46875 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:30.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:30.440+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806eca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:30.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:30.616+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:30.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:30.892+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:31.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:31.440+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ed10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:31.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:31.620+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:31.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:31.916+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 46972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:32.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:32.444+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ed80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:32.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:32.620+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:32.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:32.972+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:33.450 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:33.444+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806edf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:33.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:33.656+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:34.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:34.028+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:34.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:34.456+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806ee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:34.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:34.660+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a04d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:35.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:35.372+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:35.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:35.456+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f806eed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:35.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:35.660+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:36.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:36.456+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:36.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:36.459+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:36.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:36.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a16c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:37.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:37.467+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:37.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:37.548+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:37.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:37.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:38.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:38.471+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:38.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:38.656+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:38.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:38.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a12d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:39.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:39.471+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b718f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:39.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:39.671+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:39.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:39.720+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:40.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:40.475+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:40.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:40.675+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:40.846 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:40.840+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:41.484 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:41.479+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b719d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:41.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:41.675+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:41.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:41.920+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:42.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:42.479+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:42.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:42.679+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:42.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:42.980+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:43.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:43.483+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:43.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:43.683+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a07e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:44.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:44.120+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47416 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:44.491 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:44.487+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:44.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:44.683+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:45.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:45.440+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47451 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:45.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:45.487+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:45.694 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:45.687+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:46.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:46.504+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:46.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:46.679+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:46.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:46.691+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:47.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:47.624+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:47.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:47.683+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:47.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:47.695+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a11f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:47.809 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:10:47.803+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:48.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:48.687+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:48.702 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:48.695+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:48.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:48.724+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:49.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:49.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:49.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:49.699+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:49.823 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:49.816+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:50.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:50.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:50.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:50.703+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:50.922 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:50.912+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:51.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:51.759+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:51.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:51.759+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:52.032 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:52.028+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:52.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:52.763+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:52.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:52.763+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:53.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:53.100+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:53.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:53.763+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:53.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:53.763+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:54.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:54.156+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:54.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:54.767+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:54.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:54.767+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a09a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:55.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:55.280+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:55.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:55.767+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:55.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:55.771+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:56.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:56.396+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:56.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:56.843+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:56.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:56.843+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:57.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:57.576+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:57.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:57.847+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:57.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:57.847+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:58.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:58.676+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47921 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:58.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:58.951+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:59.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:10:59.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:10:59.762 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:10:59.756+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:10:59.959 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:10:59.955+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b710a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:00.044 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:00.039+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4332c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:00.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:00.844+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 47986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:00.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:00.955+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:01.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:01.039+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:01.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:01.952+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48033 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:01.964 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:01.959+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:02.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:02.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:02.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:02.959+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:03.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:03.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4324c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:03.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:03.048+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48067 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:03.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:03.963+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:04.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:04.047+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:04.127 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:04.119+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:04.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:04.967+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b733a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:05.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:05.047+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:05.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:05.319+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:05.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:05.967+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:06.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:06.055+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:06.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:06.415+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:07.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:07.059+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:07.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:06.971+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:07.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:07.507+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:07.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:07.975+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:08.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:08.059+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:08.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:08.583+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:08.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:08.979+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:09.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:09.063+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:09.708 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:09.699+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:09.986 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:09.979+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:10.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:10.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd926f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:10.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:10.831+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:10.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:10.983+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:11.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:11.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:11.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:11.947+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:12.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:12.027+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b711f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:12.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:12.071+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:13.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:13.031+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:13.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:13.070+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:13.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:13.103+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:14.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:14.030+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:14.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:14.074+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:14.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:14.179+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48411 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:15.039 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:15.034+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:15.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:15.078+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:15.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:15.311+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48463 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:16.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:16.034+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:16.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:16.078+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:16.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:16.483+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:17.044 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:17.038+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:17.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:17.082+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:17.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:17.559+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:18.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:18.038+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:18.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:18.086+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:18.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:18.651+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:19.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:19.042+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:19.094 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:19.086+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd909a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:19.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:19.767+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:19.916 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:11:19.910+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:20.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:20.042+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b712d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:20.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:20.090+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:20.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:20.855+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:21.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:21.046+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:21.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:21.090+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:21.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:21.971+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48809 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:22.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:22.698+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:22.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:22.702+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b734f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:23.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:23.059+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:23.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:23.702+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd907e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:23.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:23.706+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b715e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:24.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:24.163+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:24.711 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:24.706+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:24.715 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:24.706+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b713b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:25.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:25.279+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:25.715 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:25.706+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd913b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:25.717 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:25.710+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:26.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:26.431+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 48967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:26.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:26.710+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:26.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:26.714+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b735d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:27.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:27.623+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:27.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:27.714+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:27.723 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:27.718+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b716c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:28.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:28.714+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:28.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:28.718+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:28.755 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:28.747+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:29.724 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:29.718+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:29.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:29.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:29.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:29.907+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:30.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:30.718+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:30.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:30.826+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b723e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:31.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:31.059+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49132 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:31.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:31.722+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:31.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:31.862+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:32.175 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:32.167+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:32.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:32.862+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:32.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:32.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b724c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:33.214 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:33.207+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:33.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:33.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd934f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:33.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:33.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:34.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:34.307+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:34.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:34.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:34.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:34.874+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b725a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:35.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:35.427+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:35.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:35.870+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:35.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:35.878+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:36.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:36.527+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:36.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:36.870+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd919d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:36.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:36.886+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:37.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:37.635+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49343 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:37.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:37.874+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:37.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:37.886+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b727d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:38.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:38.771+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:38.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:38.878+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd912d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:38.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:38.890+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:39.845 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:39.835+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:39.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:39.882+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:39.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:39.890+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b726f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:40.880 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:40.871+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:40.889 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:40.882+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:40.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:40.894+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:41.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:41.886+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:41.904 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:41.898+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b736b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:41.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:41.967+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:42.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:42.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd902a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:42.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:42.898+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:43.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:43.075+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:43.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:43.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:44.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:44.002+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:44.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:44.147+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:44.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:44.898+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:45.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:45.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:45.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:45.239+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:45.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:45.902+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:46.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:46.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:46.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:46.310+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:46.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:46.902+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:47.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:47.010+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:47.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:47.398+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 49808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:47.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:47.906+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:48.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:48.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:48.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:48.454+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 50118 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:48.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:48.906+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:49.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:49.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:49.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:49.534+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 50337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:49.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:49.910+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:50.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:50.017+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:50.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:50.610+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 50728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:50.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:50.909+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:51.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:51.021+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:51.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:51.734+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 50900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:51.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:51.913+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:52.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:52.021+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:52.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:52.878+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51112 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:52.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:52.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:53.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:53.025+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b700e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:53.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:53.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd931e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:53.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:53.938+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:54.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:54.025+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:54.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:54.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:55.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:55.029+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b701c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:55.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:55.098+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:55.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:55.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:56.039 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:56.033+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:56.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:56.206+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:56.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:56.925+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:57.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:57.033+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b702a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:57.146 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:11:57.133+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:57.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:57.270+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:58.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:58.362+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:11:58.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:58.373+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:58.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:58.373+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:59.382 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:11:59.373+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:59.382 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:11:59.373+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:11:59.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:11:59.458+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:00.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:00.377+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:00.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:00.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:00.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:00.638+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:01.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:01.377+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:01.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:01.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:01.754 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:01.750+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:02.389 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:02.381+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:02.389 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:02.381+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:02.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:02.830+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:03.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:03.453+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:03.528 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:03.453+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:03.880 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:03.874+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:04.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:04.457+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b703f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:04.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:04.457+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:04.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:04.930+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:05.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:05.461+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:05.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:05.461+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:06.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:06.014+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:06.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:06.465+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b704d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:06.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:06.465+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:07.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:07.138+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:07.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:07.469+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:07.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:07.469+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:08.276 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:08.270+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:08.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:08.637+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b705b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:08.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:08.637+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd924c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:09.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:09.390+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:09.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:09.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:09.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:09.641+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:10.509 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:10.502+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:10.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:10.645+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd901c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:10.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:10.645+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b70700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:11.611 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:11.606+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:11.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:11.649+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b707e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:11.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:11.649+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:12.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:12.649+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:12.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:12.653+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:12.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:12.766+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51782 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:13.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:13.653+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:13.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:13.653+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:13.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:13.890+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:14.660 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:14.657+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:14.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:14.657+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:15.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:15.038+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:15.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:15.657+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd908c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:15.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:15.661+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b717a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:16.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:16.230+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:16.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:16.661+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:16.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:16.661+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:17.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:17.290+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 51940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:17.668 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:17.665+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd938e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:17.668 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:17.665+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:18.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:18.362+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:18.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:18.725+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:18.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:18.725+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:19.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:19.450+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:19.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:19.729+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b72990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:19.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:19.729+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:20.539 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:20.534+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:20.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:20.733+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b73bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:20.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:20.733+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:21.683 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:21.678+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:21.739 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:21.733+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b728b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:21.739 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:21.737+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:22.741 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:22.737+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:22.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:22.737+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:22.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:22.786+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52560 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:23.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:23.805+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4313b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:23.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:23.805+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:24.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:24.166+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:24.812 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:24.809+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:24.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:24.809+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4311f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:25.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:25.238+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:25.816 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:25.813+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:25.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:25.813+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8b71e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:26.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:26.498+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 52905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:26.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:26.813+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4328b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:26.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:26.817+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3543100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:27.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:12:27.180+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:27.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:27.586+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:27.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:27.816+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:27.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:27.816+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:28.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:28.625+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:28.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:28.820+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:28.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:28.820+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:29.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:29.705+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:29.828 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:29.824+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e20e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:29.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:29.824+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:30.814 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:30.809+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:30.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:30.824+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:30.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:30.824+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:31.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:31.828+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e21c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:31.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:31.828+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:31.932 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:31.925+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53420 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:32.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:32.828+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:32.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:32.828+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:33.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:33.009+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:33.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:33.832+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e22a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:33.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:33.832+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:34.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:34.061+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:34.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:34.836+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:34.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:34.836+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:35.254 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:35.249+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:35.843 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:35.840+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:35.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:35.840+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4316c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:36.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:36.361+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:36.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:36.840+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e23f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:36.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:36.840+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4310a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:37.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:37.521+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:37.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:37.844+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:37.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:37.844+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:38.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:38.621+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 53991 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:38.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:38.888+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:38.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:38.892+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e24d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:39.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:39.892+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:39.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:39.892+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:39.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:39.941+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:40.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:40.896+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e25b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:40.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:40.896+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4309a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:41.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:41.105+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:41.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:41.896+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:41.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:41.896+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4327d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:42.307 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:42.301+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:42.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:42.900+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:42.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:42.900+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:43.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:43.425+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:44.024 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:44.020+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:44.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:44.020+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:44.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:44.545+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:45.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:45.020+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4331e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:45.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:45.028+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:45.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:45.633+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:46.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:46.024+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:46.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:46.028+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e27e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:46.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:46.761+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:47.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:47.028+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:47.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:47.032+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:47.984 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:47.977+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:48.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:48.032+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4303f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:48.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:48.032+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e28c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:49.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:49.032+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4323e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:49.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:49.036+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:49.101 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:49.093+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:50.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:50.036+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:50.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:50.040+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e29a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:50.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:50.293+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:51.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:51.040+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4302a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:51.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:51.040+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:51.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:51.325+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:52.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:52.040+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:52.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:52.044+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:52.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:52.449+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:53.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:53.044+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:53.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:53.048+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:53.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:53.553+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:54.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:54.140+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:54.340 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:54.140+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:54.691 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:54.685+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:55.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:55.144+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:55.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:55.144+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:55.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:55.853+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:56.150 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:56.144+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:56.150 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:56.144+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4334f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:57.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:57.101+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:57.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:57.148+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:57.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:57.148+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:57.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:12:57.180+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:58.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:58.148+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:58.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:58.152+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4324c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:58.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:58.189+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:12:59.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:12:59.152+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:59.158 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:12:59.152+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:12:59.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:12:59.353+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54756 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:00.159 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:00.152+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:00.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:00.156+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:00.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:00.505+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:01.162 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:01.156+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:01.163 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:01.156+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4332c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:01.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:01.693+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:02.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:02.160+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:02.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:02.160+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:02.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:02.849+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54872 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:03.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:03.160+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:03.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:03.164+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:03.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:03.989+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:04.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:04.163+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:04.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:04.163+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:05.063 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:05.057+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:05.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:05.167+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:05.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:05.167+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:06.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:06.167+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e30a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:06.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:06.171+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:06.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:06.285+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 54970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:07.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:07.171+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:07.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:07.171+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:07.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:07.333+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:08.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:08.175+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:08.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:08.363+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:08.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:08.417+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:09.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:09.179+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4338e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:09.371 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:09.367+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e31f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:09.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:09.489+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:10.187 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:10.179+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4307e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:10.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:10.367+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:10.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:10.556+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:11.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:11.183+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:11.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:11.371+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e32d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:11.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:11.700+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:12.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:12.187+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:12.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:12.375+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:12.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:12.772+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:13.195 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:13.187+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4326f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:13.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:13.375+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e33b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:13.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:13.868+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55203 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:14.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:14.191+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:14.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:14.379+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:15.007 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:15.000+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:15.199 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:15.191+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:15.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:15.379+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:16.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:16.136+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:16.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:16.195+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:16.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:16.383+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:17.204 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:17.199+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4315e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:17.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:17.284+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:17.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:17.387+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:18.206 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:18.199+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:18.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:18.352+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55379 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:18.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:18.387+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e35e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:19.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:19.399+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:19.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:19.399+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:19.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:19.508+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:20.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:20.399+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e36c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:20.410 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:20.399+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:20.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:20.564+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:21.413 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:21.403+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:21.413 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:21.403+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:21.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:21.712+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:22.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:22.407+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e37a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:22.413 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:22.407+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd927d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:22.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:22.844+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:23.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:23.407+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:23.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:23.411+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd916c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:24.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:24.224+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55556 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:24.519 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:24.515+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd936b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:24.524 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:24.519+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:25.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:25.472+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:25.522 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:25.515+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:25.526 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:25.519+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e38f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:26.524 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:26.519+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd921b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:26.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:26.523+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:26.651 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:26.644+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55620 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:27.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:13:27.183+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:27.526 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:27.519+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:27.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:27.527+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e39d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:27.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:27.800+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:28.535 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:28.527+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:28.536 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:28.531+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:28.969 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:28.964+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:29.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:29.531+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:29.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:29.535+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd910a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:30.139 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:30.132+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55751 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:30.542 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:30.535+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:30.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:30.535+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:31.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:31.539+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd928b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:31.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:31.539+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:31.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:31.608+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:32.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:32.539+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:32.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:32.539+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:33.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:33.112+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55852 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:33.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:33.543+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd903f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:33.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:33.543+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:34.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:34.348+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:34.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:34.563+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:34.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:34.563+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:35.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:35.444+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:35.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:35.563+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:35.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:35.575+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:36.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:36.548+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 55978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:36.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:36.567+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:36.584 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:36.575+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:37.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:37.567+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:37.587 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:37.579+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:37.611 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:37.604+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:38.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:38.571+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:38.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:38.583+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:38.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:38.812+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:39.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:39.587+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:39.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:39.587+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd932c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:39.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:39.964+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56244 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:40.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:40.590+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:40.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:40.590+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:41.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:41.160+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:41.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:41.590+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:41.607 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:41.594+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:42.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:42.436+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:42.600 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:42.594+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:42.602 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:42.594+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd900e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:43.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:43.588+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:43.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:43.594+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e40d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:43.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:43.598+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd923e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:44.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:44.598+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:44.607 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:44.598+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:44.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:44.664+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:45.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:45.602+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:45.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:45.602+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e41b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:45.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:45.804+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:46.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:46.606+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:46.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:46.606+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:46.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:46.920+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:47.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:47.606+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:47.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:47.610+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:48.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:48.160+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:48.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:48.610+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:48.618 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:48.610+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:49.386 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:49.380+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 56968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:49.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:49.614+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:49.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:49.614+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:50.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:50.500+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57033 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:50.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:50.614+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd926f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:50.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:50.614+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e43e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:51.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:51.618+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:51.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:51.618+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:51.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:51.656+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:52.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:52.618+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:52.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:52.618+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e44c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:52.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:52.764+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:53.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:53.622+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:53.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:53.622+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:53.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:53.927+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:54.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:54.622+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:54.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:54.626+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e45a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:55.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:55.027+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:55.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:55.626+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:55.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:55.626+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:56.191 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:56.183+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:56.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:56.630+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:56.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:56.630+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:57.192 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:13:57.186+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:57.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:57.287+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:57.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:57.630+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:57.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:57.634+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e46f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:58.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:58.471+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:58.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:58.634+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:58.656 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:58.638+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:59.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:13:59.583+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:13:59.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:13:59.726+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a04d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:13:59.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:13:59.726+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e47d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:00.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:00.671+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:00.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:00.726+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:00.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:00.730+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:01.739 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:01.730+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a16c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:01.739 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:01.730+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e48b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:01.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:01.851+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:02.741 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:02.734+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:02.741 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:02.734+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:03.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:03.003+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57856 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:03.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:03.734+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:03.744 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:03.738+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:04.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:04.119+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 57933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:04.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:04.738+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:04.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:04.738+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:05.223 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:05.215+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58015 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:05.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:05.742+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:05.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:05.742+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:06.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:06.459+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:06.751 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:06.746+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a11f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:06.752 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:06.746+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:07.590 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:07.583+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:07.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:07.754+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:07.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:07.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:08.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:08.754+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a09a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:08.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:08.759+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:08.941 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:08.930+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:09.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:09.758+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:09.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:09.930+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:09.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:09.963+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:10.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:10.758+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:10.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:10.934+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:11.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:11.147+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:11.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:11.762+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:11.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:11.938+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:12.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:12.367+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:12.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:12.766+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a12d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:12.946 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:12.938+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:13.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:13.511+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:13.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:13.766+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:13.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:13.942+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:14.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:14.551+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:14.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:14.770+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:14.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:14.946+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:15.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:15.755+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:15.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:15.770+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a28b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:15.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:15.946+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:16.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:16.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:16.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:16.907+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:16.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:16.950+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:17.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:17.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:17.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:17.950+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:18.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:18.087+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:18.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:18.777+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:18.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:18.953+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:19.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:19.283+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 58989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:19.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:19.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a10a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:20.145 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:20.137+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a52d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:20.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:20.399+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:20.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:20.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:21.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:21.141+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a51f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:21.559 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:21.551+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:21.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:21.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:22.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:22.141+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:22.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:22.627+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:22.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:22.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:23.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:23.145+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:23.798 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:23.789+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a21b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:23.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:23.791+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:24.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:24.149+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:24.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:24.919+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:25.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:25.337+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:25.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:25.337+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:26.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:26.027+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59283 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:26.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:26.337+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:26.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:26.341+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a50a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:27.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:14:27.197+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:27.223 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:27.215+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:27.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:27.341+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:27.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:27.341+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:28.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:28.279+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:28.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:28.345+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:28.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:28.345+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:29.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:29.335+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:29.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:29.349+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:29.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:29.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:30.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:30.349+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:30.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:30.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:30.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:30.427+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:31.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:31.353+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:31.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:31.353+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a17a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:31.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:31.647+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:32.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:32.353+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:32.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:32.357+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a02a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:32.794 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:32.787+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:33.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:33.357+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:33.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:33.357+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a23e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:33.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:33.919+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:34.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:34.357+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:34.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:34.365+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a01c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:35.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:35.023+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59596 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:35.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:35.365+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:35.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:35.369+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:36.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:36.071+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:36.373 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:36.369+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:36.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:36.369+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:37.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:37.186+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:37.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:37.373+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:37.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:37.373+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:38.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:38.373+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:38.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:38.362+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:38.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:38.377+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:39.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:39.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:39.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:39.377+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a20d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:39.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:39.502+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:40.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:40.381+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:40.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:40.381+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:40.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:40.662+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:41.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:41.381+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:41.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:41.385+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:41.822 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:41.810+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:42.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:42.385+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:42.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:42.385+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:43.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:43.026+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:43.397 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:43.393+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:43.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:43.393+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:44.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:44.222+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:44.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:44.457+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a24c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:44.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:44.461+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:45.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:45.398+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 59965 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:45.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:45.461+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:45.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:45.461+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:46.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:46.465+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:46.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:46.465+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:46.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:46.678+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:47.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:47.469+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:47.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:47.469+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:47.790 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:47.782+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:48.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:48.469+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a40e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:48.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:48.469+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:48.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:48.906+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60078 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:49.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:49.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:49.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:49.633+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:50.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:50.066+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:50.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:50.637+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:50.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:50.637+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:51.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:51.206+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:51.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:51.637+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:51.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:51.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:52.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:52.370+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:52.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:52.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:52.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:52.641+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:53.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:53.562+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:53.649 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:53.645+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dec30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:53.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:53.645+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a79c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:54.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:54.646+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60253 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:54.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:54.757+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:54.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:54.761+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:55.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:55.761+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:55.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:55.761+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a78e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:55.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:55.762+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:56.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:56.761+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:56.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:56.765+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:56.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:56.974+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:57.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:14:57.221+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:57.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:57.764+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:57.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:57.764+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a41c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:58.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:58.106+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:58.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:58.768+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:58.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:58.768+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:59.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:14:59.290+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:14:59.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:14:59.772+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a42a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:14:59.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:14:59.772+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:00.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:00.530+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:00.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:00.772+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:00.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:00.772+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:01.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:01.642+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60452 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:01.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:01.776+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:01.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:01.776+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:02.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:02.780+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:02.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:02.782+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:02.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:02.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:03.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:03.784+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:03.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:03.942+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60523 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:03.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:03.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:04.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:04.784+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:04.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:04.976+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:05.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:05.114+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:05.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:05.788+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:05.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:05.980+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:06.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:06.266+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:06.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:06.792+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:06.986 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:06.980+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:07.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:07.426+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:07.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:07.792+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:07.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:07.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:08.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:08.594+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60649 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:08.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:08.796+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a76b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:08.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:08.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:09.677 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:09.670+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60685 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:09.807 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:09.800+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:09.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:09.988+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:10.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:10.786+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60723 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:10.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:10.800+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a43f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:10.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:10.988+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:11.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:11.804+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:11.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:11.986+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:11.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:11.992+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:12.812 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:12.808+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a75d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:12.999 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:12.992+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:13.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:13.206+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:13.814 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:13.808+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a73a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:14.002 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:13.996+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:14.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:14.694+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:14.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:14.840+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a74f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:15.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:15.000+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:15.848 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:15.844+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a72c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:15.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:15.850+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60883 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:16.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:16.000+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:16.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:16.844+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:16.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:16.990+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60920 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:17.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:17.004+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:17.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:17.848+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a71e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:18.011 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:18.004+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:18.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:18.074+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:18.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:18.852+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:19.013 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:19.008+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:19.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:19.134+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 60983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:19.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:19.964+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:20.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:20.012+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:20.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:20.313+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:20.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:20.968+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:21.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:21.012+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:21.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:21.613+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:21.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:21.972+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:22.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:22.016+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:22.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:22.849+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:22.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:22.972+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:23.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:23.020+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:23.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:23.976+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:24.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:24.024+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:24.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:24.025+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:24.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:24.980+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a44d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:25.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:25.024+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:25.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:25.097+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:25.986 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:25.980+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:26.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:26.028+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3defb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:26.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:26.281+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:26.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:26.984+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:27.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:27.032+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:27.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:15:27.220+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:27.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:27.437+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61392 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:27.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:27.984+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:28.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:28.032+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:28.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:28.557+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:28.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:28.988+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:29.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:29.036+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:29.691 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:29.685+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61467 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:30.067 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:30.064+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:30.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:30.064+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:30.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:30.781+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61507 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:31.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:31.064+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:31.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:31.068+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:31.894 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:31.889+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61544 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:32.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:32.068+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:32.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:32.068+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:33.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:32.997+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:33.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:33.072+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce840e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:33.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:33.072+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a45b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:34.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:34.076+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce841c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:34.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:34.076+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:34.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:34.125+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:35.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:35.080+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:35.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:35.084+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:35.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:35.173+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:36.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:36.083+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce842a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:36.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:36.083+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:36.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:36.349+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:37.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:37.087+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:37.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:37.219+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:37.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:37.513+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:38.100 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:38.087+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:38.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:38.219+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:38.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:38.637+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:39.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:39.091+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:39.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:39.223+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:39.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:39.709+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:40.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:40.411+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:40.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:40.411+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce844d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:40.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:40.873+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61802 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:41.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:41.415+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:41.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:41.415+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:41.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:41.921+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 61841 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:42.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:42.415+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce845b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:42.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:42.415+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:43.051 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:43.045+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 62102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:43.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:43.419+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:43.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:43.419+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:44.219 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:44.213+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 62641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:44.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:44.423+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:44.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:44.423+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:45.403 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:45.397+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 62981 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:45.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:45.423+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:45.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:45.423+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:46.433 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:46.427+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce847e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:46.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:46.427+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:46.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:46.765+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 63224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:47.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:47.435+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:47.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:47.435+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a68b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:47.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:47.845+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 63531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:48.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:48.435+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:48.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:48.435+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce848c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:48.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:48.977+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 63765 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:49.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:49.439+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a67d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:49.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:49.439+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce849a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:50.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:50.181+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64035 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:50.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:50.479+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:50.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:50.479+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e55d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:51.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:51.361+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:51.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:51.483+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:51.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:51.483+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:52.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:52.483+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:52.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:52.483+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:52.496 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:52.489+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:53.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:53.487+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:53.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:53.487+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e54f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:53.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:53.709+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:54.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:54.491+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:54.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:54.655+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:54.936 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:54.933+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:55.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:55.491+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:55.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:55.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:56.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:56.177+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:56.500 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:56.495+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:56.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:56.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:57.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:57.401+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:57.434 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:15:57.423+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:57.503 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:57.495+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:57.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:57.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:58.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:58.499+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:58.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:58.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:58.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:58.669+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:15:59.507 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:15:59.503+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:59.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:15:59.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:15:59.918 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:15:59.913+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:00.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:00.735+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:00.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:00.739+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:01.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:01.101+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64340 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:01.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:01.739+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:01.750 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:01.743+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e53a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:02.473 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:02.464+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:02.747 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:02.743+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:02.752 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:02.747+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e51e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:03.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:03.624+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:03.751 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:03.743+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:03.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:03.747+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e52c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:04.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:04.747+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:04.756 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:04.751+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e59c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:04.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:04.804+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:05.757 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:05.751+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce851f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:05.759 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:05.751+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:05.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:05.952+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:06.757 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:06.751+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:06.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:06.755+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:07.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:07.192+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:07.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:07.755+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce852d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:07.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:07.755+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:08.355 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:08.348+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:08.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:08.759+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce853b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:08.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:08.759+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:09.511 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:09.504+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64615 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:09.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:09.759+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:09.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:09.763+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:10.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:10.700+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:10.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:10.763+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:10.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:10.763+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:11.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:11.763+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:11.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:11.767+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:11.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:11.988+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:12.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:12.767+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:12.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:12.771+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:13.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:13.096+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64711 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:13.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:13.770+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:13.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:13.770+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:14.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:14.272+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64751 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:14.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:14.770+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce856c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:14.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:14.774+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6c070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:15.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:15.420+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:15.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:15.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:15.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:15.778+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:16.522 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:16.516+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:16.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:16.778+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce857a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:16.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:16.778+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6cc40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:17.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:17.672+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:17.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:17.778+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:17.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:17.782+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:18.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:18.782+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce858f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:18.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:18.786+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:18.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:18.884+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:19.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:19.786+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:19.798 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:19.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6caf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:20.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:20.064+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:20.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:20.794+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:20.965 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:20.946+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce859d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:21.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:21.300+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:21.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:21.794+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:21.965 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:21.946+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:22.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:22.496+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:22.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:22.798+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:22.958 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:22.950+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:23.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:23.632+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 64994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:23.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:23.798+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6c000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:23.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:23.954+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:24.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:24.802+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:24.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:24.808+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:24.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:24.958+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:25.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:25.896+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:25.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:25.906+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:25.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:25.982+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:26.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:26.906+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:26.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:26.986+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:27.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:27.056+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:27.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:27.910+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:27.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:27.986+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:28.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:28.824+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:28.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:28.914+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:28.996 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:28.990+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:29.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:29.918+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:29.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:29.940+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65216 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:29.999 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:29.990+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:30.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:30.922+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:31.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:30.994+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:31.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:31.060+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:31.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:31.922+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6f090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:32.005 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:31.998+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:32.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:32.188+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:32.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:32.926+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6cd20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:33.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:32.998+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:33.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:33.376+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65323 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:33.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:33.930+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6efb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:34.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:34.002+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce860d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:34.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:34.564+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65356 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:34.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:34.930+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ed10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:35.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:35.002+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:35.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:35.680+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:36.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:36.106+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce861b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:36.116 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:36.110+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6cbd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:36.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:36.860+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:37.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:37.114+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ec30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:37.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:37.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:38.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:38.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:38.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:38.114+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6eed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:39.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:39.012+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65496 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:39.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:39.118+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6eb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:39.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:39.118+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:40.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:40.122+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ef40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:40.128 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:40.122+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce863e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:40.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:40.220+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:41.133 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:41.122+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ce00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:41.133 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:41.122+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:41.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:41.324+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:42.133 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:42.126+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:42.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:42.126+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce864c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:42.527 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:42.520+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:43.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:43.130+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:43.136 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:43.130+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:43.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:43.760+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:44.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:44.130+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ccb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:44.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:44.130+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:44.930 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:44.923+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:45.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:45.134+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:45.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:45.134+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6cee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:46.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:46.027+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65741 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:46.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:46.138+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce866f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:46.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:46.266+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ed80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:47.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:47.138+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:47.278 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:47.270+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6cfc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:47.307 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:47.299+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:48.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:48.142+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce867d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:48.278 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:48.270+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6cd90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:48.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:48.743+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65821 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:49.152 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:49.146+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce868b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:49.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:49.274+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:49.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:49.939+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:50.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:50.230+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:50.283 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:50.274+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ce70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:51.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:51.083+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:51.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:51.230+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:51.286 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:51.278+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:52.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:52.233+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:52.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:52.243+0000 7f6702f62700 -1 osd.2 104 get_health_metrics reporting 65928 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:52.289 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:52.281+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:53.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:53.233+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:53.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:53.285+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:53.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:53.371+0000 7f6702f62700 -1 osd.2 105 get_health_metrics reporting 65985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:54.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:54.237+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:54.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:54.285+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:54.930 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:54.923+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:55.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:55.241+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:55.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:55.289+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:56.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:56.241+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:56.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:56.289+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:57.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:57.047+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:57.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:57.245+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:57.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:57.293+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:58.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:58.245+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:58.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:58.255+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:16:58.306 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:58.297+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:59.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:16:59.249+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:59.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:16:59.297+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:16:59.419 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:16:59.411+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:00.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:00.249+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:00.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:00.385+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6eca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:00.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:00.607+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:01.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:01.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:01.395 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:01.389+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:01.734 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:01.723+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:01.826 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:17:01.817+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:02.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:02.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:02.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:02.389+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:02.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:02.851+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:03.360 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:03.353+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:03.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:03.393+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:03.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:03.979+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:04.363 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:04.357+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce87090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:04.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:04.397+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ebc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:05.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:05.303+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:05.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:05.357+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce87100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:05.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:05.397+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:06.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:06.491+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:06.520 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:06.513+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce87170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:06.523 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:06.513+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:07.524 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:07.521+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce871e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:07.526 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:07.521+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:07.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:07.599+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:08.526 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:08.521+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4307e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:08.528 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:08.525+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6eae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:08.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:08.727+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:09.530 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:09.525+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:09.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:09.529+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:09.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:09.831+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:10.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:10.529+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:10.534 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:10.529+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ea00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:10.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:10.979+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66840 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:11.534 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:11.529+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:11.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:11.533+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:12.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:12.091+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:12.536 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:12.533+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4304d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:12.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:12.537+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:13.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:13.239+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:13.540 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:13.537+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:13.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:13.537+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:14.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:14.387+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 66987 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:14.542 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:14.537+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:14.543 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:14.541+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:15.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:15.541+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:15.546 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:15.541+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:15.583 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:15.575+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:16.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:16.625+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:16.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:16.629+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:16.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:16.711+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67092 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:17.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:17.629+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:17.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:17.629+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:17.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:17.903+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:18.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:18.633+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:18.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:18.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:19.087 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:19.079+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:19.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:19.633+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4301c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:19.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:19.637+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:20.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:20.159+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:20.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:20.637+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:20.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:20.637+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:21.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:21.271+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:21.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:21.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:21.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:21.641+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:22.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:22.403+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:22.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:22.641+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:22.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:22.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:23.539 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:23.531+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:23.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:23.645+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8838e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:23.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:23.645+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:24.649 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:24.645+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:24.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:24.645+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:24.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:24.691+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:25.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:25.649+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:25.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:25.749+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:25.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:25.807+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:26.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:26.769+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:26.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:26.769+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:26.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:26.959+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:27.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:27.773+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:27.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:27.773+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:28.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:28.142+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:28.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:28.773+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:28.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:28.773+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:29.316 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:29.306+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:29.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:29.776+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:29.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:29.780+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:30.522 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:30.510+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67707 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:30.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:30.556+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_post_acquire_leader_lock: error acquiring leader lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:30.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:30.556+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_acquire_leader_lock: error acquiring lock: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:30.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:30.616+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:30.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:30.780+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:30.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:30.780+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:31.626 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:31.618+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:31.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:31.784+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ddc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:31.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:31.784+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:32.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:32.784+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:32.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:32.788+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:32.873 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:32.866+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:33.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:33.788+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:33.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:33.792+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:34.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:34.026+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:34.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:34.796+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:34.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:34.832+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:35.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:35.194+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:35.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:35.628+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:35.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:35.796+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8811f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:35.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:35.832+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:36.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:36.326+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 67989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:37.156 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:17:37.152+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:37.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:37.204+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6de30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:37.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:37.208+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:37.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:37.546+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:38.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:38.208+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6db20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:38.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:38.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:38.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:38.746+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:39.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:39.208+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:39.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:39.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8828b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:40.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:40.102+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:40.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:40.212+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6da40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:40.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:40.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:40.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:40.736+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:41.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:41.216+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:41.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:41.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:41.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:41.334+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:42.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:42.216+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:42.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:42.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:42.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:42.558+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:43.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:43.220+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6db90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:43.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:43.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8802a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:43.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:43.814+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:44.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:44.308+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:44.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:44.312+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8824c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:45.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:45.006+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:45.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:45.312+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:45.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:45.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:45.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:45.892+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:46.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:46.226+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:46.320 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:46.316+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a60d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:46.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:46.320+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8832c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:47.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:47.316+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:47.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:47.324+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:47.464 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:47.458+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:48.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:48.320+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a61b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:48.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:48.324+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:48.573 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:48.566+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:49.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:49.324+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:49.521 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:49.516+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:49.873 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:49.866+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:50.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:50.324+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:50.523 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:50.520+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:50.974 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:50.968+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:51.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:51.038+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68556 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:51.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:51.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:51.525 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:51.520+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:52.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:52.150+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:52.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:52.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a47e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:52.528 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:52.524+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8810a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:53.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:53.406+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68636 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:53.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:53.524+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8815e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:53.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:53.532+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:54.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:54.528+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8819d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:54.549 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:54.540+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:54.954 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:54.946+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:55.535 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:55.528+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:55.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:55.544+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:56.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:56.058+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:56.073 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:17:56.068+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:56.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:56.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8818f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:56.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:56.544+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a63e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:57.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:57.158+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:57.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:57.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:57.554 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:57.548+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a64c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:58.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:58.386+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68809 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:17:58.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:58.552+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:58.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:58.608+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:59.559 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:17:59.556+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:59.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:17:59.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8825a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:17:59.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:17:59.690+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 68855 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:00.561 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:00.556+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:00.618 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:00.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:00.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:00.974+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 69016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:01.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:01.096+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:01.563 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:01.560+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:01.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:01.616+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8821b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:02.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:02.110+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 69571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:02.566 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:02.560+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:02.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:02.616+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58da30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:03.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:03.346+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 69850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:03.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:03.564+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f35411f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:03.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:03.620+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58bf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:04.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:04.600+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f3543100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:04.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:04.624+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58bf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:04.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:04.662+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:05.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:05.604+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:05.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:05.628+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:05.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:05.806+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:06.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:06.164+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:06.610 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:06.604+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:06.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:06.628+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:06.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:06.990+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:07.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:18:07.179+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:07.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:07.607+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a59d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:07.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:07.631+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58abd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:08.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:08.110+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:08.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:08.611+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:08.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:08.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58cc30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:09.366+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:09.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:09.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:09.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:09.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:10.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:10.485+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:10.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:10.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:10.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:10.639+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:11.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:11.351+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:11.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:11.619+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:11.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:11.637+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:11.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:11.643+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58bff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:12.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:12.619+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a48c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:12.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:12.647+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58c680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:12.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:12.845+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:13.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:13.623+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:13.654 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:13.647+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58db10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:13.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:13.957+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:14.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:14.623+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a56c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:14.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:14.651+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:15.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:15.125+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:15.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:15.627+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:15.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:15.655+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58bab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:16.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:16.313+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70685 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:16.448 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:16.443+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:16.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:16.631+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a67d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:16.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:16.655+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58b880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:17.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:17.425+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:17.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:17.631+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:17.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:17.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58c450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:18.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:18.633+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70781 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:18.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:18.635+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:18.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:18.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58b030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:19.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:19.639+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:19.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:19.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58b810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:19.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:19.797+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:20.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:20.639+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:20.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:20.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58ad90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:21.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:21.037+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:21.449 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:21.443+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:21.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:21.643+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:21.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:21.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58aee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:22.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:22.221+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:22.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:22.643+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:22.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:22.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58b180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:23.325 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:23.317+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 70981 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:23.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:23.647+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:23.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:23.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58df00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:24.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:24.549+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:24.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:24.647+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:24.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:24.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58db80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:25.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:25.651+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:25.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:25.713+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:25.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:25.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58ab60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:26.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:26.443+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:26.660 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:26.655+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:26.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:26.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58ba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:26.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:26.993+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:27.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:27.655+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a50a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:27.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:27.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58b570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:28.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:28.129+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:28.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:28.659+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:28.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:28.843+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:29.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:29.297+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:29.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:29.663+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:29.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:29.847+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58dd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:30.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:30.429+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:30.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:30.667+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:30.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:30.847+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58ad20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:31.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:31.455+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:31.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:31.613+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:31.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:31.671+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:31.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:31.851+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58cd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:32.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:32.671+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:32.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:32.757+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71305 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:32.859 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:32.855+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58a9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:33.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:33.675+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:33.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:33.855+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58cdf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:33.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:33.933+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:34.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:34.675+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:34.864 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:34.859+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58afc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:35.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:35.245+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:35.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:35.679+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:35.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:35.859+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:36.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:36.445+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:36.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:36.563+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:36.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:36.683+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:36.870 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:36.863+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58af50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:37.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:18:37.495+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:37.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:37.653+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71464 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:37.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:37.687+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:37.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:37.867+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58c610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:38.694 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:38.687+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:38.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:38.801+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:38.875 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:38.871+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:39.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:39.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:39.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:39.871+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58c840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:39.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:39.949+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:40.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:40.695+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:40.880 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:40.875+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:41.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:41.093+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:41.703 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:41.695+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:41.765 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:41.759+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:41.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:41.875+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58b0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:42.323 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:42.317+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:42.706 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:42.699+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:42.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:42.879+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:43.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:43.485+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:43.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:43.703+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a71e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:43.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:43.879+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58dcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:44.712 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:44.707+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:44.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:44.805+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:44.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:44.883+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58c140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:45.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:45.706+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:45.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:45.886+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8807e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:46.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:46.113+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:46.717 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:46.710+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a74f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:46.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:46.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:47.024 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:47.018+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:47.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:47.317+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:47.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:47.710+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:47.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:47.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:48.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:48.509+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71856 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:48.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:48.714+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:48.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:48.894+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8817a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:49.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:49.718+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:49.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:49.781+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71903 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:49.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:49.894+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:50.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:50.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:50.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:50.898+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:50.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:50.933+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:51.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:51.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a72c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:51.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:51.902+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c881d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:52.062 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:52.057+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 71981 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:52.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:52.114+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:52.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:52.726+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a57a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:52.911 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:52.906+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8804d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:53.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:53.228+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:53.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:53.730+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:53.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:53.906+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c8839c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:54.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:54.416+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72056 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:54.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:54.730+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:54.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:54.910+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:55.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:55.492+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:55.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:55.734+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a51f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:55.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:55.910+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:56.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:56.676+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:56.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:56.738+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:56.921 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:56.914+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:57.122 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:18:57.114+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:57.747 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:57.742+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:57.848 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:57.840+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:57.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:57.918+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:58.750 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:58.742+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:58.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:58.918+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:59.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:18:59.024+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:18:59.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:18:59.746+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a49a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:18:59.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:18:59.922+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c882220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:00.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:00.236+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:00.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:00.750+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:00.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:00.922+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:01.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:01.428+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:01.758 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:01.750+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:01.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:01.926+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c880000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:02.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:02.198+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:02.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:02.544+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:02.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:02.774+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a66f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:02.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:02.930+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c883870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:03.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:03.708+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:03.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:03.778+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a58f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:03.938 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:03.930+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58de20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:04.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:04.778+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:04.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:04.888+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72415 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:04.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:04.934+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:05.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:05.782+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a53b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:05.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:05.934+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:06.348 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:06.340+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:06.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:06.786+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:06.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:06.938+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:07.204 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:07.198+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:07.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:07.480+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:07.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:19:07.598+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:07.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:07.786+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:07.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:07.942+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:08.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:08.672+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72550 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:08.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:08.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a5810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:08.950 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:08.942+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:09.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:09.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a44d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:09.932 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:09.924+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:09.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:09.950+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:10.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:10.794+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:10.958 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:10.950+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:11.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:11.116+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:11.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:11.798+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:11.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:11.954+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:12.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:12.210+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:12.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:12.368+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72675 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:12.807 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:12.798+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:12.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:12.954+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:13.587 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:13.580+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:13.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:13.802+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:13.965 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:13.958+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:14.754 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:14.748+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:14.812 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:14.806+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:14.967 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:14.962+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:15.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:15.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:15.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:15.962+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dec30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:15.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:15.980+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:16.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:16.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:16.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:16.966+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:17.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:17.156+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:17.218 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:17.210+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:17.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:17.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:17.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:17.966+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:18.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:18.284+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:18.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:18.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:18.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:18.970+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:19.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:19.572+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:19.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:19.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:19.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:19.974+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3defb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:20.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:20.740+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 72992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:20.828 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:20.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:20.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:20.974+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:21.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:21.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a45b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:21.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:21.978+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3ded10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:22.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:22.024+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:22.219 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:22.210+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:22.833 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:22.826+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a4000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:22.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:22.982+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:23.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:23.188+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:23.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:23.830+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:23.989 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:23.982+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3de760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:24.444 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:24.436+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:24.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:24.829+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a52d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:24.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:24.985+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:25.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:25.624+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:25.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:25.833+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a40e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:25.995 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:25.985+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3deb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:26.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:26.756+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:26.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:26.833+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a79c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:26.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:26.989+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:27.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:27.293+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:27.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:27.837+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:27.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:27.980+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:28.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:27.993+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:28.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:28.837+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:29.002 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:28.993+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dfb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:29.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:29.168+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:29.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:29.841+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a7cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:30.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:30.001+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:30.573 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:30.564+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:30.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:30.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a78e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:31.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:31.001+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:31.743 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:31.736+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:31.854 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:31.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f85a6760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:32.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:32.005+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:32.299 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:32.293+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:32.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:32.849+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:32.960 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:32.952+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:33.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:33.005+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:33.859 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:33.853+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:34.017 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:34.009+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3df800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:34.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:34.172+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:34.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:34.853+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:35.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:35.013+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:35.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:35.343+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:35.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:35.857+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:36.021 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:36.013+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b3dff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:36.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:36.587+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:36.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:36.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:37.024 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:37.017+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:37.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:37.301+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:37.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:19:37.617+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:37.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:37.823+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:37.870 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:37.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:38.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:38.017+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:38.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:38.865+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:39.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:39.021+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:39.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:39.039+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:39.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:39.869+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:40.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:40.025+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:40.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:40.307+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:40.873+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:41.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:41.029+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:41.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:41.483+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:41.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:41.877+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:42.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:42.033+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:42.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:42.505+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:42.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:42.691+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73789 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:42.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:42.881+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:43.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:43.037+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:43.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:43.881+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:44.044 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:44.041+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997faa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:44.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:44.067+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:44.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:44.885+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6e0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:45.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:45.041+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:45.258 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:45.251+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:45.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:45.889+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6ddc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:46.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:46.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ec30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:46.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:46.495+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73919 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:46.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:46.889+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:47.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:47.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:47.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:47.509+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:47.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:47.679+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 73965 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:47.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:47.893+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:48.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:48.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:48.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:48.843+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:48.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:48.897+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:49.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:49.053+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:49.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:49.897+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:50.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:50.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fe90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:50.183 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:50.175+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:50.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:50.905+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6de30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:51.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:51.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997eed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:51.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:51.419+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:51.911 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:51.905+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6db20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:52.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:52.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:52.513 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:52.509+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:52.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:52.575+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:52.913 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:52.909+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:53.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:53.065+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:53.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:53.819+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74188 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:53.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:53.913+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6da40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:54.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:54.065+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:54.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:54.913+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:54.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:54.927+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:55.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:55.069+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997efb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:56.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:56.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:56.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:56.073+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:56.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:56.111+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:57.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:57.053+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6db90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:57.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:57.073+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:57.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:57.235+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74316 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:57.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:19:57.509+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:58.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:58.053+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f7a6d9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:58.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:58.077+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:58.472 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:58.463+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:19:59.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:19:59.057+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:59.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:19:59.077+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ed10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:19:59.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:19:59.607+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74400 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:00.062 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:00.057+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:00.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:00.081+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:00.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:00.779+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:01.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:01.065+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92920e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:01.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:01.197+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:02.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:02.069+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:02.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:02.075+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74480 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:02.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:02.201+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:02.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:02.509+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:03.076 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:03.072+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92921c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:03.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:03.195+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:03.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:03.200+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997eca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:04.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:04.076+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:04.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:04.204+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ea00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:04.374 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:04.367+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:05.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:05.076+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92922a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:05.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:05.208+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:05.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:05.623+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:06.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:06.080+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:06.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:06.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:06.823 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:06.815+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:07.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:07.080+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:07.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:07.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:07.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:07.580+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:07.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:20:07.644+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:07.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:07.983+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74685 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:08.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:08.084+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92923f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:08.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:08.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:09.093 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:09.088+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:09.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:09.099+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74724 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:09.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:09.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:10.094 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:10.088+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92924d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:10.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:10.220+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:10.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:10.319+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:11.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:11.200+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:11.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:11.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:11.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:11.503+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:12.206 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:12.200+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92925b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:12.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:12.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:12.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:12.600+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:12.639 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:12.631+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:13.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:13.204+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:13.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:13.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ce00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:13.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:13.879+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74903 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:14.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:14.208+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:14.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:14.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:15.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:15.039+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:15.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:15.212+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:15.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:15.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997dab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:16.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:16.308+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:16.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:16.312+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:16.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:16.455+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 74982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:17.319 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:17.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:17.320 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:17.316+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92927e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:17.622 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:17.616+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:17.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:17.638+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:18.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:18.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:18.323 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:18.320+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:18.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:18.718+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:19.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:19.320+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:19.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:19.320+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92928c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:19.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:19.798+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:20.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:20.324+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:20.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:20.324+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:21.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:21.042+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:21.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:21.324+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:21.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:21.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92929a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:22.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:22.278+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:22.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:22.328+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:22.335 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:22.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:22.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:22.684+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:23.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:23.332+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:23.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:23.332+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:23.539 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:23.530+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:24.340 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:24.336+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:24.340 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:24.336+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:24.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:24.770+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:25.342 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:25.336+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:25.342 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:25.336+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:25.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:25.930+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:26.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:26.384+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:26.389 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:26.384+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd903f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:27.062 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:27.058+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:27.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:27.388+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd927d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:27.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:27.388+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:27.783 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:27.780+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:28.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:28.222+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:28.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:28.388+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd928b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:28.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:28.388+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:29.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:29.392+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997caf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:29.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:29.392+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:29.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:29.430+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:30.399 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:30.396+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2768b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:30.400 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:30.396+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:30.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:30.606+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:31.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:31.488+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:31.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:31.488+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:31.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:31.862+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:32.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:32.492+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:32.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:32.492+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:32.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:32.792+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:33.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:33.122+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:33.500 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:33.496+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:33.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:33.652+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:34.204 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:34.198+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75581 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:34.502 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:34.496+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:34.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:34.656+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:35.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:35.314+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:35.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:35.500+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:35.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:35.660+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:36.608 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:36.602+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:36.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:36.620+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:36.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:36.660+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:37.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:37.620+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:37.668 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:37.664+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92930a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:37.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:20:37.704+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:37.803 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:37.800+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:37.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:37.798+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:38.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:38.624+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2752d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:38.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:38.664+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:38.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:38.994+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:39.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:39.628+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:39.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:39.668+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:40.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:40.138+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:40.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:40.628+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:40.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:40.672+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92931f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:41.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:41.318+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:41.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:41.631+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2742a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:41.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:41.671+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:42.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:42.446+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75845 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:42.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:42.631+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2755e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:42.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:42.675+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92932d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:42.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:42.799+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:43.655 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:43.650+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75880 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:43.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:43.675+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:43.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:43.775+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:44.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:44.679+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92933b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:44.722 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:44.718+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:44.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:44.779+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:45.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:45.679+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:45.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:45.779+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2774f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:45.901 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:45.894+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:46.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:46.683+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:46.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:46.783+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:47.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:47.042+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 75982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:47.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:47.687+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:47.791 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:47.787+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:47.923 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:47.919+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:48.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:48.206+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:48.695 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:48.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:48.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:48.787+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:49.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:49.386+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:49.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:49.691+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92935e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:49.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:49.791+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2772c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:50.531 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:50.522+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:50.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:50.695+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:50.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:50.803+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2749a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:51.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:51.714+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:51.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:51.759+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92936c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:51.811 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:51.803+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:52.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:52.763+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:52.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:52.807+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2741c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:52.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:52.882+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76176 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:52.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:52.919+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:53.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:53.767+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92937a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:53.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:53.811+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2743f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:54.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:54.102+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:54.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:54.771+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:54.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:54.811+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:55.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:55.402+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:55.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:55.775+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:55.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:55.815+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:56.677 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:56.670+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:56.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:56.935+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:56.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:56.935+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92938f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:57.930 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:20:57.923+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:57.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:57.935+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:57.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:57.935+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:57.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:57.942+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:58.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:58.939+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:59.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:20:59.023+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92939d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:20:59.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:20:59.198+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76379 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:20:59.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:20:59.943+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2771e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:00.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:00.023+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:00.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:00.349+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:00.950 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:00.943+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:01.032 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:01.027+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:01.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:01.517+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:01.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:01.947+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:02.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:02.031+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:02.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:02.685+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:02.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:02.947+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:02.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:02.991+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:03.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:03.031+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:03.834 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:03.829+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:03.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:03.951+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:04.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:04.035+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:04.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:04.955+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:05.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:05.035+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:05.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:05.085+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:05.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:05.955+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2766f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:06.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:06.039+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:06.332 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:06.325+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:07.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:07.027+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:07.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:07.043+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:07.547 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:07.541+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:07.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:21:07.703+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:08.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:08.031+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:08.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:08.047+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:08.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:08.087+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:08.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:08.709+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:09.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:09.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:09.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:09.051+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:09.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:09.833+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76715 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:10.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:10.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2775d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:10.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:10.051+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:11.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:11.039+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:11.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:11.045+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76751 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:11.065 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:11.055+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:12.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:12.079+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:12.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:12.083+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:12.236 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:12.229+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:13.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:13.079+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:13.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:13.083+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2750a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:13.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:13.103+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:13.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:13.389+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76832 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:14.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:14.091+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2764c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:14.193 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:14.187+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:14.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:14.665+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:15.099 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:15.091+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:15.195 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:15.191+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92940d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:15.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:15.829+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:16.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:16.095+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:16.204 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:16.199+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:17.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:17.099+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:17.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:17.113+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76921 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:17.206 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:17.199+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92941b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:18.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:18.099+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:18.123 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:18.119+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:18.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:18.203+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:18.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:18.413+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76955 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:19.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:19.099+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2763e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:19.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:19.203+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:19.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:19.685+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 76996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:20.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:20.102+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2760d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:20.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:20.206+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:20.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:20.877+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:21.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:21.106+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:21.214 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:21.206+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:22.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:22.045+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77072 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:22.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:22.210+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92943e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:22.288 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:22.106+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:23.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:23.110+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:23.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:23.158+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:23.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:23.210+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:23.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:23.325+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:24.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:24.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:24.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:24.214+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92944c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:24.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:24.605+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:25.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:25.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:25.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:25.218+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:25.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:25.909+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:26.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:26.118+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:26.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:26.218+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92945a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:27.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:27.129+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:27.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:27.222+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:27.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:27.210+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce87100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:28.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:28.194+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:28.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:28.226+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:28.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:28.330+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:28.350 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:28.345+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:29.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:29.230+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92946f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:29.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:29.334+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:29.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:29.561+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:30.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:30.234+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:30.342 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:30.334+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce843f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:30.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:30.757+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:31.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:31.234+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92947d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:31.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:31.338+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce850a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:31.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:31.965+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:32.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:32.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:32.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:32.350+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:33.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:33.149+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:33.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:33.194+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:33.362 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:33.354+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92948b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:33.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:33.358+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:34.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:34.309+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:34.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:34.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:34.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:34.362+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:35.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:35.362+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:35.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:35.362+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:35.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:35.537+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:36.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:36.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:36.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:36.366+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:36.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:36.933+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:37.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:37.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:37.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:37.370+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:37.744 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:21:37.738+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:38.203 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:38.194+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:38.227 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:38.221+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:38.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:38.370+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:38.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:38.370+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:39.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:39.369+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:39.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:39.374+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:39.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:39.374+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:40.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:40.374+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:40.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:40.374+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:40.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:40.493+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77655 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:41.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:41.378+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce87020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:41.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:41.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:41.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:41.916+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:42.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:42.382+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce86840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:42.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:42.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:43.226 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:43.218+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:43.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:43.220+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:43.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:43.382+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce878e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:43.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:43.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:44.391 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:44.386+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce85030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:44.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:44.386+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:44.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:44.528+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:45.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:45.386+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:45.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:45.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:45.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:45.780+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77817 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:46.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:46.390+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce84070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:46.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:46.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:47.028 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:47.020+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:47.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:47.450+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074ce87800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:47.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:47.450+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:48.237 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:48.230+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:48.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:48.240+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:48.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:48.454+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:48.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:48.454+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:49.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:49.388+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:49.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:49.458+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:49.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:49.458+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:50.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:50.458+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:50.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:50.458+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:50.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:50.668+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 77983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:51.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:51.462+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:51.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:51.462+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:51.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:51.928+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:52.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:52.466+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:52.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:52.466+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:53.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:53.200+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:53.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:53.290+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:53.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:53.466+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:53.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:53.466+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:54.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:54.416+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:54.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:54.470+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:54.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:54.554+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:55.478 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:55.470+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:55.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:55.558+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:55.651 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:55.644+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:56.480 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:56.474+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:56.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:56.562+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:56.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:56.952+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:57.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:57.473+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:57.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:57.561+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:58.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:58.156+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:58.407 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:21:58.401+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:58.484 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:58.477+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:58.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:58.565+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:59.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:21:59.392+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:21:59.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:21:59.477+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4317a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:21:59.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:21:59.565+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:00.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:00.481+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4303f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:00.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:00.569+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:00.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:00.672+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:01.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:01.489+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4308c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:01.579 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:01.573+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:01.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:01.944+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:02.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:02.489+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:02.581 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:02.573+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:03.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:03.100+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:03.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:03.493+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:03.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:03.565+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:03.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:03.577+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:04.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:04.372+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78443 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:04.503 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:04.497+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:04.586 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:04.577+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:05.506 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:05.497+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cfc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:05.599 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:05.581+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:05.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:05.640+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:06.508 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:06.501+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:06.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:06.585+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:06.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:06.932+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:07.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:07.549+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:07.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:07.585+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:07.746 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:22:07.737+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:08.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:08.100+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:08.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:08.553+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ca10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:08.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:08.565+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:08.595 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:08.589+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:09.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:09.396+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:09.563 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:09.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:09.599 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:09.589+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:10.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:10.512+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:10.566 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:10.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:10.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:10.593+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:11.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:11.561+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:11.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:11.597+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:11.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:11.768+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:12.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:12.565+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:12.608 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:12.605+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:12.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:12.992+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78722 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:13.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:13.569+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:13.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:13.609+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:13.683 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:13.681+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:14.168+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78760 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:14.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:14.573+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:14.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:14.609+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e33b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:15.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:15.328+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:15.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:15.573+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:15.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:15.613+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:16.538 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:16.532+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:16.581 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:16.577+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:16.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:16.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e36c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:17.682 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:17.676+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:17.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:17.833+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:17.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:17.833+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:18.819 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:18.817+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:18.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:18.837+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:18.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:18.837+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:18.920 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:18.912+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:19.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:19.837+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:19.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:19.841+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ff00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:20.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:20.112+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 78962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:20.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:20.841+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:20.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:20.845+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33eb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:21.303 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:21.296+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:21.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:21.841+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:21.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:21.845+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:22.530 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:22.524+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:22.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:22.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:22.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:22.849+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ce70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:23.828 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:23.820+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79100 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:23.834 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:23.829+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:23.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:23.849+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:23.855 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:23.853+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:24.854 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:24.849+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:24.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:24.853+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:25.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:25.007+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:25.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:25.853+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e22a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:25.859 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:25.857+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:26.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:26.155+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79172 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:26.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:26.857+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e58e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:26.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:26.857+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:27.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:27.631+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:27.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:27.949+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:27.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:27.949+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:28.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:28.927+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:28.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:28.949+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:28.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:28.953+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:29.000 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:28.997+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:29.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:29.953+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e30a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:29.959 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:29.957+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:30.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:30.055+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:30.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:30.957+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:30.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:30.957+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:31.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:31.359+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:31.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:31.961+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:31.964 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:31.961+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:32.556 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:32.547+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:32.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:32.961+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:32.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:32.965+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:33.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:33.703+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79436 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:33.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:33.965+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:33.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:33.965+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33da40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:34.205 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:34.201+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:34.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:34.943+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:34.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:34.968+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:34.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:34.968+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:35.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:35.968+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:35.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:35.972+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:36.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:36.187+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:36.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:36.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:36.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:36.976+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:37.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:37.339+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:37.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:22:37.800+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:38.194 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:38.188+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:38.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:38.192+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:38.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:38.523+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:39.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:39.192+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e37a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:39.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:39.196+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:39.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:39.488+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:39.658 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:39.651+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:40.200 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:40.196+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:40.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:40.200+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:40.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:40.915+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:41.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:41.196+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:41.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:41.204+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:42.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:42.163+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79711 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:42.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:42.200+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:42.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:42.204+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:43.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:43.204+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:43.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:43.208+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:43.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:43.271+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79740 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:44.210 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:44.204+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:44.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:44.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:44.403 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:44.395+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:44.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:44.596+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:45.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:45.208+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:45.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:45.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ccb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:45.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:45.635+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:46.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:46.212+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e55d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:46.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:46.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:46.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:46.879+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:47.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:47.220+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ce00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:47.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:47.412+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:48.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:48.071+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:48.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:48.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:48.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:48.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:49.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:49.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33caf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:49.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:49.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:49.424 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:49.411+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:49.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:49.664+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:50.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:50.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:50.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:50.420+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:50.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:50.703+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 79970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:51.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:51.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:51.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:51.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:51.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:51.851+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:52.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:52.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:52.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:52.428+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:53.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:53.115+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:53.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:53.500+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:53.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:53.500+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:54.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:54.375+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:54.507 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:54.504+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:54.508 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:54.504+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:54.669 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:54.664+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:55.510 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:55.504+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e21c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:55.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:55.508+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:55.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:55.523+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:56.513 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:56.508+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e32d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:56.514 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:56.508+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:56.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:56.691+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:57.515 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:57.512+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:57.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:57.512+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997eca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:57.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:57.895+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:58.536 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:58.532+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e29a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:58.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:58.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:59.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:22:59.211+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:22:59.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:22:59.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:59.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:22:59.536+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e28c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:22:59.670 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:22:59.664+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:00.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:00.423+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:00.542 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:00.536+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e48b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:00.542 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:00.536+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:01.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:01.540+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:01.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:01.540+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:01.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:01.627+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:02.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:02.544+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997faa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:02.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:02.544+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:02.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:02.835+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:03.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:03.708+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:03.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:03.708+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:04.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:04.199+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:04.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:04.708+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:04.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:04.712+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:04.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:04.720+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:05.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:05.483+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:05.717 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:05.712+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:05.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:05.716+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:06.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:06.666+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80496 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:06.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:06.716+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997eed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:06.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:06.716+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:07.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:07.716+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fe90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:07.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:07.720+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:07.804 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:23:07.800+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:07.873 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:07.866+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:08.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:08.720+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:08.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:08.724+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:09.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:09.130+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:09.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:09.724+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997efb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:09.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:09.728+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:09.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:09.960+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:10.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:10.362+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:10.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:10.724+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:10.744 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:10.740+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:11.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:11.728+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:11.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:11.734+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80645 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:11.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:11.740+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:12.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:12.731+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:12.750 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:12.743+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:12.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:12.934+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:13.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:13.735+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:13.752 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:13.747+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:14.303 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:14.294+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:14.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:14.739+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:14.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:14.747+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:14.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:14.975+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:15.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:15.486+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:15.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:15.739+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ed10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:15.757 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:15.751+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:16.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:16.718+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:16.748 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:16.743+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:16.759 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:16.755+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:17.750 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:17.743+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:17.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:17.755+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e27e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:17.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:17.910+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80837 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:19.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:18.995+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:19.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:18.995+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:19.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:19.198+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80864 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:19.997 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:19.991+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:20.003 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:19.999+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e46f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:20.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:20.003+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:20.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:20.462+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:21.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:20.999+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:21.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:21.003+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:21.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:21.698+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:22.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:22.003+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:22.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:22.007+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:22.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:22.866+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 80992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:23.013 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:23.007+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:23.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:23.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:23.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:23.994+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:24.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:24.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e59c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:24.017 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:24.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:25.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:25.011+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:25.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:25.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:25.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:25.015+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997ce00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:25.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:25.434+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:26.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:26.015+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:26.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:26.015+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:26.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:26.718+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:27.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:27.019+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:27.024 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:27.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997dab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:28.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:28.019+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:28.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:28.023+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:28.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:28.034+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:29.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:29.023+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:29.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:29.023+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:29.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:29.394+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:30.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:30.011+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:30.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:30.027+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:30.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:30.027+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:30.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:30.646+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:31.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:31.027+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:31.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:31.031+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:31.850 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:31.846+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:32.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:32.031+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:32.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:32.031+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:33.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:33.035+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997f9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:33.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:33.035+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:33.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:33.038+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:34.044 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:34.039+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:34.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:34.039+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:34.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:34.190+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:35.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:35.039+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997caf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:35.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:35.039+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:35.077 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:35.071+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:35.505 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:35.498+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:36.048 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:36.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:36.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:36.043+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:36.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:36.706+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81416 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:37.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:37.043+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:37.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:37.047+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:37.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:23:37.807+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:37.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:37.938+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:38.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:38.047+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997e8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:38.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:38.047+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92940d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:39.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:39.071+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:39.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:39.071+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:39.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:39.370+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:40.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:40.071+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92941b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:40.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:40.075+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:40.177 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:40.171+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:40.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:40.646+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:41.080 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:41.075+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:41.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:41.075+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:41.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:41.838+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81602 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:42.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:42.075+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:42.085 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:42.079+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:43.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:43.018+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81644 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:43.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:43.167+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:43.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:43.171+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:44.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:44.171+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:44.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:44.175+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:44.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:44.238+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:45.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:45.171+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:45.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:45.171+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:45.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:45.175+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd860e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:45.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:45.418+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:46.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:46.175+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:46.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:46.179+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:46.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:46.666+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:47.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:47.183+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd861c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:47.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:47.339+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92943e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:47.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:47.786+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:48.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:48.187+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:48.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:48.343+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:48.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:48.889+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81824 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:49.194 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:49.187+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:49.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:49.343+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92944c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:50.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:50.045+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:50.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:50.190+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:50.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:50.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:51.200 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:51.194+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd863f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:51.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:51.205+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:51.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:51.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:52.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:52.194+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:52.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:52.337+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:52.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:52.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:53.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:53.198+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd864d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:53.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:53.354+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83143f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:53.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:53.497+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 81968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:54.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:54.202+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd865b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:54.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:54.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:54.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:54.597+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:55.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:55.202+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:55.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:55.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:55.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:23:55.574+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:55.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:55.741+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82031 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:56.212 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:56.206+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:56.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:56.362+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:56.907 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:56.901+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:57.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:57.210+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:57.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:57.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:58.075 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:58.069+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:58.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:58.210+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:58.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:58.370+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83152d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:59.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:23:59.189+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82140 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:23:59.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:23:59.214+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:23:59.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:23:59.370+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:00.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:00.218+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd868c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:00.388 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:00.381+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:00.389 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:00.374+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:00.635 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:00.626+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:01.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:01.218+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:01.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:01.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:01.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:01.589+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:02.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:02.222+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd869a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:02.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:02.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:02.907 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:02.901+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:03.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:03.222+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:03.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:03.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:04.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:04.093+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:04.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:04.226+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:04.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:04.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:05.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:05.230+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:05.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:05.289+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:05.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:05.386+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:05.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:05.682+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:06.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:06.230+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:06.399 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:06.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:06.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:06.485+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:07.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:07.234+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:07.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:07.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:07.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:07.793+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:07.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:24:07.810+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:08.243 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:08.238+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:08.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:08.394+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:09.047 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:09.041+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:09.246 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:09.238+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:09.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:09.398+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:10.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:10.189+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:10.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:10.242+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:10.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:10.398+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:10.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:10.682+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:11.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:11.242+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:11.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:11.333+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:11.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:11.402+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:12.253 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:12.246+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:12.416 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:12.406+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:12.444 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:12.437+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:13.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:13.250+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:13.414 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:13.406+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:13.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:13.697+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:14.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:14.250+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:14.416 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:14.410+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:14.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:14.909+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:15.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:15.254+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd870a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:15.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:15.410+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:15.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:15.686+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:16.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:16.073+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82644 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:16.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:16.254+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:16.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:16.414+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:17.265 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:17.258+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:17.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:17.265+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:17.423 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:17.418+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:18.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:18.262+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd871f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:18.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:18.418+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:18.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:18.433+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:19.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:19.262+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd872d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:19.429 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:19.422+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:19.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:19.701+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 82980 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:20.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:20.266+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:20.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:20.426+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:20.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:20.690+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:20.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:20.909+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:21.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:21.266+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd873b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:21.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:21.426+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:22.067 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:22.061+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:22.276 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:22.270+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:22.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:22.430+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:23.279 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:23.274+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:23.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:23.357+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:23.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:23.434+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:24.282 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:24.274+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:24.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:24.438+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:24.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:24.501+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:25.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:25.278+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd875e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:25.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:25.438+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:25.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:25.690+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:25.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:25.765+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:26.287 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:26.282+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:26.449 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:26.442+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:26.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:26.949+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83816 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:27.289 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:27.282+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd876c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:27.451 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:27.441+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:28.174 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:28.169+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:28.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:28.285+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:28.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:28.445+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:29.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:29.285+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:29.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:29.409+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:29.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:29.449+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:30.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:30.289+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:30.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:30.453+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83161b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:30.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:30.605+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83919 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:30.698 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:30.689+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:31.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:31.289+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd878f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:31.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:31.453+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:31.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:31.936+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 83961 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:32.301 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:32.293+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:32.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:32.457+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:33.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:33.224+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:33.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:33.293+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd879d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:33.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:33.605+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:34.305 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:34.297+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:34.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:34.508+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:34.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:34.609+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:35.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:35.301+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:35.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:35.609+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83156c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:35.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:35.760+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:35.796 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:35.789+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:36.312 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:36.305+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:36.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:36.613+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:37.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:37.052+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84117 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:37.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:37.309+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:37.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:37.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:37.818 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:24:37.809+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:38.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:38.284+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:38.318 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:38.309+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:38.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:38.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:39.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:39.357+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:39.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:39.384+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:39.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:39.621+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:40.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:40.361+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:40.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:40.621+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:40.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:40.636+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:40.827 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:40.821+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:41.375 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:41.369+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:41.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:41.625+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:41.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:41.896+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:42.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:42.369+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:42.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:42.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:43.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:43.176+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:43.382 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:43.377+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:43.649 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:43.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:44.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:44.392+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:44.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:44.469+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:44.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:44.637+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:45.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:45.473+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:45.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:45.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:45.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:45.656+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:45.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:45.825+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:46.478 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:46.473+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd880d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:46.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:46.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92954f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:46.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:46.848+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:47.480 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:47.477+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:47.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:47.645+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:48.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:48.088+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:48.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:48.481+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd881b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:48.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:48.645+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:49.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:49.376+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:49.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:49.481+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:49.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:49.649+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:50.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:50.485+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:50.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:50.612+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:50.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:50.653+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92953a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:50.828 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:50.825+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:51.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:51.485+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:51.660 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:51.657+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:51.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:51.760+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:52.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:52.489+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd883e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:52.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:52.657+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:52.970 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:52.960+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:53.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:53.493+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:53.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:53.669+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92951e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:54.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:54.184+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:54.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:54.493+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:54.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:54.677+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:55.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:55.404+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:55.500 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:55.497+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd885a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:55.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:55.681+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92952c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:55.829 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:24:55.825+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:56.502 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:56.497+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:56.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:56.681+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:56.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:56.704+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:57.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:57.501+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:57.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:57.685+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:57.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:57.980+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:58.512 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:58.505+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd886f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:58.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:58.685+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:59.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:24:59.144+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:24:59.510 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:24:59.505+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd887d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:24:59.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:24:59.689+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92959c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:00.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:00.284+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:00.513 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:00.509+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:00.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:00.693+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:00.879 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:00.873+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:01.515 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:01.513+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd888b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:01.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:01.508+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:01.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:01.693+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:02.518 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:02.513+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:02.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:02.684+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:02.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:02.697+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:03.520 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:03.517+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:03.703 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:03.701+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:03.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:03.976+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:04.523 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:04.521+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:04.706 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:04.700+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:05.236 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:05.220+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 84975 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:05.527 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:05.520+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:05.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:05.704+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:05.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:05.876+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:06.528 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:06.524+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:06.531 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:06.524+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:06.711 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:06.708+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:07.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:07.524+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:07.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:07.716+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:07.756 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:07.744+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:07.835 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:25:07.832+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:08.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:08.528+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:08.723 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:08.716+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:08.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:08.924+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:09.535 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:09.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:09.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:09.720+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:10.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:10.204+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:10.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:10.532+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:10.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:10.724+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:11.114 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:11.108+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:11.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:11.484+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:11.540 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:11.536+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:11.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:11.724+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:12.542 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:12.536+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:12.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:12.728+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:12.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:12.792+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:13.544 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:13.540+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:13.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:13.732+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:14.008 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:13.995+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85244 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:14.547 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:14.540+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:14.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:14.732+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:15.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:15.491+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85283 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:15.549 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:15.544+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:15.741 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:15.736+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:16.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:16.152+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:16.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:16.548+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:16.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:16.695+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85325 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:16.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:16.740+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:17.554 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:17.548+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:17.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:17.740+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:18.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:17.995+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:18.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:18.552+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:18.752 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:18.744+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:19.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:19.215+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:19.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:19.556+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:19.752 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:19.748+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:20.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:20.543+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:20.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:20.556+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd892c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:20.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:20.752+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92956b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:21.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:21.152+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:21.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:21.564+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:21.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:21.695+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85487 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:21.757 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:21.752+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:22.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:22.708+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd893a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:22.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:22.756+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92958e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:23.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:23.007+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:23.715 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:23.712+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:23.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:23.756+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92948b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:24.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:24.147+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:24.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:24.712+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:24.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:24.760+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:25.327 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:25.319+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:25.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:25.716+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:25.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:25.760+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:26.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:26.228+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:26.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:26.503+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:26.723 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:26.720+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:26.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:26.764+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:27.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:27.679+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:27.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:27.720+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:27.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:27.768+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:28.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:28.724+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:28.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:28.844+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:29.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:28.991+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:29.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:29.724+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:29.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:29.848+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:30.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:30.171+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:30.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:30.728+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:30.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:30.848+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92945a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:31.316 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:31.312+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:31.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:31.535+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85787 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:31.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:31.732+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4313b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:31.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:31.852+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92929a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:32.744 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:32.732+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:32.859 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:32.852+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:32.892 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:32.883+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:33.741 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:33.736+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4316c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:33.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:33.856+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9293b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:34.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:34.007+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85875 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:34.744 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:34.740+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:34.864 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:34.860+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:35.239 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:35.231+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:35.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:35.740+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:35.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:35.864+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:36.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:36.476+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:36.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:36.547+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:36.748 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:36.744+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:36.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:36.864+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9294f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:37.750 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:37.744+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4310a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:37.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:37.815+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 85995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:37.836 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:25:37.832+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:37.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:37.868+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9295090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:38.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:38.748+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:38.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:38.868+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:39.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:39.039+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86031 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:39.755 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:39.752+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:39.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:39.872+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92947d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:40.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:40.303+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:40.758 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:40.752+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4339c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:40.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:40.876+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:41.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:41.471+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:41.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:41.696+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:41.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:41.756+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:41.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:41.876+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92946f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:42.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:42.647+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86152 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:42.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:42.755+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:42.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:42.879+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9292c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:43.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:43.763+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4319d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:43.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:43.827+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:43.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:43.883+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:44.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:44.763+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:44.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:44.883+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:45.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:45.147+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:45.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:45.767+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:45.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:45.887+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:46.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:46.387+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:46.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:46.771+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:46.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:46.883+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:46.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:46.891+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:47.722 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:47.715+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:47.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:47.771+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:47.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:47.895+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:48.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:48.775+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:48.904 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:48.899+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:48.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:48.951+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:49.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:49.779+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:49.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:49.903+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdf00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:50.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:50.123+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86396 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:50.786 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:50.779+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:50.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:50.903+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:51.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:51.467+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:51.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:51.783+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:51.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:51.907+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:51.931 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:51.919+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:52.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:52.787+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:52.848 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:52.839+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:52.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:52.931+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:53.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:53.787+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:53.941 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:53.935+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:54.015 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:54.007+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:54.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:54.791+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:54.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:54.939+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:55.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:55.262+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:55.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:55.795+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4325a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:55.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:55.939+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:56.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:56.590+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86599 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:56.802 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:56.795+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:56.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:56.943+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:57.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:25:57.091+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:57.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:57.799+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:57.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:57.834+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:57.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:57.947+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fde90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:58.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:58.799+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:58.955 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:58.951+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fde20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:59.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:25:59.086+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:25:59.809 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:25:59.803+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4308c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:25:59.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:25:59.951+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:00.303 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:00.294+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:00.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:00.807+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:00.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:00.955+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:01.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:01.598+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:01.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:01.811+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:01.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:01.955+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fce60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:02.212 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:02.207+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:02.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:02.778+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:02.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:02.811+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4305b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:02.964 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:02.959+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:03.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:03.815+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4323e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:03.967 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:03.963+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:04.027 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:04.018+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:04.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:04.815+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:04.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:04.963+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:05.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:05.210+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:05.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:05.819+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4327d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:05.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:05.967+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:06.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:06.362+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:06.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:06.819+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:06.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:06.971+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:07.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:07.227+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:07.587 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:07.578+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:07.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:07.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd869a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:07.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:26:07.947+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:07.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:07.971+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:08.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:08.770+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 86988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:08.834 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:08.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:08.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:08.975+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fca00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:09.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:09.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:09.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:09.975+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcbc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:10.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:10.118+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:10.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:10.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:10.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:10.979+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:11.431 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:11.366+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:11.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:11.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:11.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:11.983+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:12.275 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:12.271+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:12.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:12.610+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:12.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:12.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:12.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:12.983+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:13.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:13.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:13.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:13.854+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:14.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:14.131+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:14.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:14.843+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:15.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:15.135+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:15.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:15.162+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:15.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:15.847+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:16.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:16.135+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:16.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:16.418+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:16.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:16.851+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:17.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:17.139+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:17.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:17.299+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:17.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:17.630+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:17.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:17.851+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:18.148 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:18.143+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:18.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:18.842+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:18.860 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:18.855+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd870a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:19.151 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:19.142+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:19.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:19.854+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:20.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:20.102+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:20.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:20.146+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:20.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:20.858+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd872d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:21.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:21.150+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:21.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:21.474+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:21.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:21.858+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:22.158 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:22.150+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:22.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:22.394+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:22.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:22.682+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:22.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:22.862+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:23.161 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:23.154+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e21c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:23.871 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:23.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:23.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:23.878+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:24.163 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:24.158+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:24.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:24.866+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:25.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:25.074+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:25.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:25.158+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:25.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:25.870+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:26.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:26.162+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e32d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:26.382 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:26.378+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:26.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:26.870+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:27.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:27.162+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e28c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:27.418 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:27.410+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:27.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:27.594+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:27.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:27.874+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd865b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:28.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:28.166+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e29a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:28.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:28.782+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87601 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:28.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:28.878+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:29.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:29.170+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:29.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:29.878+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd861c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:29.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:29.958+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:30.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:30.170+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e48b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:30.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:30.882+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:31.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:31.174+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:31.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:31.250+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:31.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:31.882+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:32.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:32.178+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:32.450 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:32.442+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:32.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:32.622+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:32.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:32.886+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd868c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:33.187 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:33.182+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:33.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:33.818+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:33.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:33.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd871f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:34.190 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:34.182+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:34.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:34.890+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd864d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:34.907 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:34.902+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:35.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:35.186+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:35.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:35.894+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:35.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:35.990+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87817 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:36.195 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:36.186+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80620d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:36.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:36.898+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:37.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:37.162+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:37.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:37.190+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:37.456 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:37.450+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:38.034 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:26:38.022+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:38.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:38.022+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:38.199 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:38.194+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80621b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:38.335 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:38.329+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87895 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:39.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:39.026+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:39.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:39.194+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:39.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:39.589+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:40.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:40.030+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:40.204 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:40.198+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:40.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:40.793+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 87967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:41.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:41.034+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:41.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:41.198+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:42.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:41.985+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:42.042 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:42.034+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd875e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:42.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:42.202+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:42.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:42.502+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:43.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:43.109+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:43.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:43.170+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:43.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:43.206+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80623e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:44.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:44.178+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd898e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:44.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:44.273+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:44.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:44.374+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:45.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:45.178+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:45.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:45.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80624c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:45.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:45.449+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88100 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:46.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:46.182+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd899c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:46.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:46.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:46.788 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:46.781+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:47.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:47.186+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:47.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:47.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80625a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:47.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:47.518+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:48.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:48.109+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:48.318 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:48.310+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:48.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:48.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:49.321 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:49.314+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:49.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:49.386+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:49.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:49.385+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:50.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:50.318+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:50.397 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:50.390+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80626f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:50.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:50.525+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:51.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:51.318+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:51.400 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:51.394+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:51.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:51.901+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88305 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:52.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:52.322+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:52.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:52.394+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80627d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:52.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:52.846+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:53.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:53.285+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:53.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:53.326+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:53.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:53.498+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:54.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:54.326+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:54.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:54.453+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88396 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:54.507 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:54.498+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80628b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:55.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:55.330+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:55.508 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:55.502+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:55.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:55.617+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:56.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:56.329+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:56.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:56.501+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:57.015 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:57.009+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:57.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:57.333+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd894f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:57.514 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:57.505+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:57.921 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:26:57.913+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:58.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:58.149+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88495 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:58.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:58.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:58.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:58.781+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:59.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:26:59.385+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:26:59.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:26:59.785+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:26:59.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:26:59.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b515180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:00.626 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:00.621+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:00.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:00.785+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:00.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:00.789+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5145b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:01.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:01.789+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:01.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:01.789+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:01.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:01.901+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88604 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:02.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:02.789+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:02.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:02.793+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b517410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:02.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:02.933+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:03.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:03.009+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:03.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:03.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b516060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:03.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:03.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:04.254 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:04.249+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:04.870 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:04.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:04.870 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:04.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b5176b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:05.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:05.481+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:05.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:05.865+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:05.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:05.865+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:06.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:06.869+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:06.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:06.869+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:07.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:07.089+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:07.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:07.873+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:07.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:07.873+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:08.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:27:08.081+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:08.089 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:08.081+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:08.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:08.213+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:09.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:09.029+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:09.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:09.033+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:09.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:09.453+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:10.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:10.033+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:10.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:10.037+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:10.683 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:10.677+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:11.045 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:11.037+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:11.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:11.041+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8062fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:12.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:12.005+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:12.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:12.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4303f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:12.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:12.049+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:13.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:13.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:13.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:13.053+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:13.095 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:13.093+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:13.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:13.229+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:14.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:14.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:14.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:14.053+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:14.468 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:14.461+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:15.054 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:15.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:15.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:15.057+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:15.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:15.665+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 88997 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:16.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:16.053+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:16.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:16.061+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80631e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:17.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:17.017+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:17.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:17.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:17.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:17.061+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:18.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:18.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:18.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:18.065+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80632c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:18.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:18.221+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:18.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:18.229+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:19.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:19.385+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:19.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:19.769+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:19.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:19.773+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4325a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:20.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:20.568+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:20.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:20.773+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:20.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:20.777+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:21.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:21.716+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:21.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:21.777+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:21.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:21.777+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:22.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:22.777+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80634f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:22.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:22.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:22.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:22.948+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:23.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:23.357+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:23.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:23.781+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:23.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:23.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4308c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:24.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:24.204+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:24.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:24.897+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:24.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:24.897+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f80635d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:25.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:25.420+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:25.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:25.901+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8063640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:25.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:25.901+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:26.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:26.680+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:26.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:26.905+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83160d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:26.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:26.905+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4323e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:27.838 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:27.832+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:27.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:27.909+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:27.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:27.909+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4305b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:28.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:28.461+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:28.914 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:28.909+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83158f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:28.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:28.913+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4327d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:29.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:29.048+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:29.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:29.913+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:29.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:29.913+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:30.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:30.328+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:30.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:30.917+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:30.920 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:30.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:31.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:31.464+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:31.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:31.917+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83166f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:31.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:31.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:32.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:32.708+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:32.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:32.921+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:32.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:32.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:33.555 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:33.552+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:33.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:33.924+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83149a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:33.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:33.924+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:34.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:34.032+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:34.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:34.924+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83159d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:34.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:34.928+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:35.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:35.272+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:35.928+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:35.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:35.928+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:36.540 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:36.532+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:36.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:36.932+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a26f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:36.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:36.940+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:37.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:37.840+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:37.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:37.936+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:37.946 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:37.940+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:38.157 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:27:38.152+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:38.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:38.556+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:38.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:38.936+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:38.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:38.944+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:39.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:39.076+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:40.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:40.088+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:40.102 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:40.096+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:40.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:40.408+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:41.098 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:41.092+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2771e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:41.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:41.100+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:41.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:41.568+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:42.101 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:42.096+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:42.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:42.104+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:42.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:42.864+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:43.111 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:43.104+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83157a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:43.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:43.292+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:43.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:43.660+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:44.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:44.108+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83155e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:44.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:44.200+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:44.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:44.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:45.242 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:45.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:45.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:45.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:45.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:45.412+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89775 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:46.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:46.240+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83144d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:46.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:46.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:46.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:46.620+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:47.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:47.244+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:47.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:47.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2775d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:47.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:47.796+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:48.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:48.244+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:48.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:48.304+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:48.731 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:48.728+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:49.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:49.036+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89883 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:49.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:49.248+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83145b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:49.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:49.304+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:50.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:50.192+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:50.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:50.288+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:50.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:50.308+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2764c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:51.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:51.292+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:51.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:51.312+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:51.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:51.476+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:52.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:52.296+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8314e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:52.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:52.312+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:52.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:52.620+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 89980 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:53.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:53.296+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8317170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:53.319 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:53.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2750a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:53.732 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:53.728+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:53.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:53.724+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:54.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:54.300+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8315110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:54.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:54.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:54.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:54.960+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:55.308 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:55.304+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f83153b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:55.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:55.320+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:56.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:56.140+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:56.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:56.304+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8316a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:56.345 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:56.340+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:57.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:57.308+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:57.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:57.324+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:57.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:57.344+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:58.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:58.324+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:58.351 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:58.348+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:58.568 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:58.560+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:27:58.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:27:58.836+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:59.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:27:59.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:59.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:27:59.348+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2760d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:27:59.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:27:59.656+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:00.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:00.368+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:00.413 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:00.372+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:00.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:00.964+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:01.376 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:01.372+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:01.382 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:01.376+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:02.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:02.203+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90258 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:02.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:02.376+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:02.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:02.380+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:03.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:03.380+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:03.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:03.384+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2768b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:03.561 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:03.551+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:03.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:03.976+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:04.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:04.380+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:04.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:04.384+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:04.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:04.763+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:05.506 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:05.500+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:05.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:05.500+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:05.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:05.927+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:06.509 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:06.504+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2755e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:06.510 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:06.504+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cc40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:07.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:07.151+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:07.513 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:07.508+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:07.513 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:07.508+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:08.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:28:08.200+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:08.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:08.363+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:08.513 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:08.508+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:08.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:08.552+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ddc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:08.980 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:08.976+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:09.561 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:09.556+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:09.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:09.612+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:09.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:09.639+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:10.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:10.563+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:10.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:10.615+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:10.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:10.851+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:11.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:11.563+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852f020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:11.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:11.619+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:12.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:12.119+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:12.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:12.567+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:12.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:12.619+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2753b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:13.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:13.319+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:13.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:13.571+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:13.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:13.627+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2756c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:14.061 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:14.055+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:14.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:14.571+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:14.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:14.571+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:14.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:14.631+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b277480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:15.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:15.575+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:15.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:15.631+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:15.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:15.767+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:16.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:16.575+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:16.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:16.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:17.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:17.087+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:17.587 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:17.583+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:17.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:17.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:18.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:18.435+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:18.590 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:18.583+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:18.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:18.639+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2758f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:19.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:19.063+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:19.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:19.587+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:19.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:19.643+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2765a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:19.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:19.659+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:20.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:20.587+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:20.650 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:20.643+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:20.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:20.867+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:21.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:21.591+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:21.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:21.647+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:22.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:22.063+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90820 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:22.599 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:22.595+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:22.656 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:22.651+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2745b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:23.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:23.251+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:23.601 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:23.595+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:23.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:23.651+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2773a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:24.107 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:24.099+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:24.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:24.367+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:24.611 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:24.607+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ef40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:24.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:24.655+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:25.530 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:25.523+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:25.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:25.607+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852df10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:25.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:25.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2747e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:26.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:26.611+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:26.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:26.659+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:26.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:26.707+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:27.619 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:27.611+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ca10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:27.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:27.663+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2774f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:27.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:27.923+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90961 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:28.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:28.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852ebc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:28.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:28.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:29.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:29.135+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:29.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:29.183+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 90991 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:29.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:29.619+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852fa30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:29.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:29.667+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:30.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:30.287+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:30.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:30.647+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852dce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:30.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:30.671+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:31.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:31.407+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:31.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:31.651+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:31.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:31.675+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:32.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:32.523+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:32.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:32.655+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852e140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:32.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:32.675+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:33.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:33.655+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852cfc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:33.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:33.679+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:33.799 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:33.791+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:34.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:34.235+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:34.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:34.659+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:34.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:34.679+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:34.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:34.975+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:35.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:35.663+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f852c770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:35.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:35.683+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:36.167 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:36.159+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:36.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:36.687+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2749a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:36.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:36.819+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e47d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:37.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:37.319+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:37.694 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:37.687+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b276760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:37.827 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:37.823+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e44c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:38.208 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:28:38.203+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:38.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:38.555+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:38.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:38.691+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2743f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:38.830 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:38.823+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:39.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:39.383+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:39.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:39.695+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:39.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:39.711+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:39.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:39.827+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:40.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:40.943+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:41.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:41.111+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:41.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:41.115+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e53a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:42.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:42.115+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2772c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:42.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:42.119+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:42.167 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:42.159+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91335 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:43.128 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:43.119+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2748c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:43.128 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:43.119+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:43.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:43.359+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:44.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:44.123+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2741c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:44.128 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:44.123+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:44.415 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:44.407+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:44.496 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:44.486+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91400 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:45.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:45.123+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:45.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:45.123+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:45.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:45.730+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:46.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:46.215+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b2752d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:46.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:46.219+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:46.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:46.938+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:47.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:47.219+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:47.289 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:47.283+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b275d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:48.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:48.102+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:48.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:48.222+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:48.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:48.282+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:49.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:49.222+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:49.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:49.286+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:49.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:49.394+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:49.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:49.414+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:50.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:50.226+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e54f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:50.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:50.290+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:50.660 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:50.650+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:51.320 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:51.314+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:51.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:51.314+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e43e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:51.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:51.822+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91596 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:52.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:52.322+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:52.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:52.370+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:53.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:53.074+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:53.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:53.322+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:53.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:53.370+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a05b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:54.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:54.306+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:54.335 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:54.330+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:54.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:54.374+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a00e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:54.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:54.470+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:55.338 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:55.330+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:55.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:55.386+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:55.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:55.594+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:56.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:56.334+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e48b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:56.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:56.390+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:56.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:56.814+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:57.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:57.338+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e28c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:57.399 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:57.390+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a3e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:58.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:58.162+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91755 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:58.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:58.342+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e29a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:58.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:58.394+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:59.351 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:28:59.342+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:59.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:28:59.398+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:28:59.418 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:28:59.414+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91789 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:28:59.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:28:59.470+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:00.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:00.478+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:00.484 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:00.478+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:00.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:00.686+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91817 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:01.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:01.714+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:01.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:01.714+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a03f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:02.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:02.006+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:02.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:02.718+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e32d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:02.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:02.718+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a2220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:03.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:03.258+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91881 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:03.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:03.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e20e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:03.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:03.722+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a10a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:04.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:04.470+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:04.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:04.666+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:04.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:04.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:04.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:04.726+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a1490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:05.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:05.726+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c6a0a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:05.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:05.726+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:05.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:05.954+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91952 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:06.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:06.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:07.002 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:06.994+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:07.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:07.218+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 91984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:07.798 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:07.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e41b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:08.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:07.998+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:08.233 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:29:08.222+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:08.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:08.382+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:08.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:08.794+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e46f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:09.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:08.998+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x5607474608b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:09.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:09.474+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:09.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:09.594+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:09.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:09.798+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:10.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:10.006+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747460840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:10.812 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:10.806+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:10.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:10.810+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:11.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:11.006+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:11.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:11.806+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e21c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:12.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:12.006+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:12.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:12.010+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x560747461bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:12.817 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:12.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:13.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:13.014+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:13.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:13.198+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:13.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:13.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:14.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:14.014+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:14.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:14.470+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:14.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:14.474+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:14.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:14.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:15.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:15.018+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745f2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:15.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:15.714+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:15.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:15.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:16.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:16.022+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074745fce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:16.827 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:16.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:16.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:16.954+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:17.031 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:17.026+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:17.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:17.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:18.034 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:18.026+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ec30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:18.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:18.274+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:18.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:18.826+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:19.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:19.030+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:19.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:19.458+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:19.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:19.482+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:19.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:19.830+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:20.039 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:20.034+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:20.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:20.602+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:20.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:20.830+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:21.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:21.038+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:21.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:21.750+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:22.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:22.414+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:22.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:22.414+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:23.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:23.038+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:23.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:23.418+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fa30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:23.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:23.418+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:24.355 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:24.350+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:24.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:24.421+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:24.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:24.421+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e27e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:24.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:24.561+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:25.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:25.421+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:25.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:25.421+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:25.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:25.498+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:26.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:26.429+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:26.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:26.429+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:26.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:26.641+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:27.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:27.477+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:27.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:27.477+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:27.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:27.865+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92503 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:28.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:28.481+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:28.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:28.481+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:29.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:29.045+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:29.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:29.485+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:29.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:29.485+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33faa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:29.646 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:29.637+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:30.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:30.149+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:30.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:30.485+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:30.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:30.489+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33dff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:31.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:31.285+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:31.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:31.489+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:31.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:31.489+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e22a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:32.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:32.589+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33dce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:32.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:32.613+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92636 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:32.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:32.589+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e59c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:33.600 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:33.593+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33dc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:33.600 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:33.593+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e2b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:33.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:33.985+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:34.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:34.593+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:34.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:34.597+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ddc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:34.733 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:34.725+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:35.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:35.329+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:35.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:35.597+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e5b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:35.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:35.597+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:36.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:36.513+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:36.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:36.601+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:36.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:36.601+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e3dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:37.611 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:37.605+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:37.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:37.605+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f92e4ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:37.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:37.709+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92787 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:38.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:29:38.285+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:38.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:38.605+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:38.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:38.605+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33eed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:38.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:38.981+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92824 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:39.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:39.613+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33eca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:39.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:39.613+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:39.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:39.961+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:40.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:40.177+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92855 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:40.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:40.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fca00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:40.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:40.617+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ca80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:41.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:41.429+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:41.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:41.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:41.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:41.617+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:42.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:42.613+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:42.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:42.889+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:42.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:42.889+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:43.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:43.889+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:43.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:43.893+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcbc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:43.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:43.941+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 92972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:44.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:44.893+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:44.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:44.893+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:44.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:44.961+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:45.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:45.185+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:45.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:45.897+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:45.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:45.897+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:46.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:46.421+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:46.904 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:46.901+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:46.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:46.901+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:47.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:47.633+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:47.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:47.909+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ea00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:47.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:47.909+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:48.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:48.833+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:48.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:48.913+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:48.917 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:48.913+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:49.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:49.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:49.920 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:49.917+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:50.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:50.041+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:50.135 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:50.129+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:50.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:50.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:50.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:50.921+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fde20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:51.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:51.365+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:51.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:51.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fe90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:51.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:51.921+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fce60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:52.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:52.565+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:52.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:52.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:52.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:52.925+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:53.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:53.773+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93216 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:53.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:53.925+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:53.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:53.929+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:54.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:54.929+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33dab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:54.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:54.929+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:54.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:54.973+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:55.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:29:55.041+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:55.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:55.933+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:55.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:55.933+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:56.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:56.105+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:56.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:56.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:56.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:56.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:57.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:57.301+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:57.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:57.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fde90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:57.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:57.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:58.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:58.441+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:58.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:58.941+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:58.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:58.941+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33edf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:59.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:29:59.741+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:29:59.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:29:59.941+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:29:59.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:29:59.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ed10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:00.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:00.041+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:00.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:00.945+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:00.950 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:00.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:00.969 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:00.961+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93384 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:01.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:01.948+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:01.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:01.948+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:02.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:02.133+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:02.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:02.948+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:02.955 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:02.952+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:03.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:03.333+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93447 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:03.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:03.952+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:03.958 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:03.952+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdf00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:04.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:04.617+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93480 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:04.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:04.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:04.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:04.956+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:05.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:05.040+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:05.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:05.797+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:05.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:05.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:05.963 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:05.960+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:06.965 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:06.960+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:06.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:06.960+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cb60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:07.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:07.041+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93560 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:07.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:07.964+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:07.969 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:07.964+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:08.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:08.216+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:08.295 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:30:08.292+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:08.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:08.968+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cc40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:08.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:08.968+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:09.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:09.448+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:09.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:09.968+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:09.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:09.968+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:10.186 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:10.180+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:10.658 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:10.648+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:10.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:10.972+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:10.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:10.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:11.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:11.812+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93700 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:11.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:11.976+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:11.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:11.976+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:12.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:12.976+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:12.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:12.980+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cd20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:13.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:12.992+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:13.983 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:13.980+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:13.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:13.980+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33cd90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:14.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:14.200+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93891 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:14.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:14.980+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:14.987 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:14.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33efb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:15.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:15.360+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:15.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:15.444+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93928 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:15.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:15.984+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcfb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:15.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:15.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:16.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:16.684+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93964 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:16.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:16.988+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:16.993 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:16.988+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ebc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:17.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:17.832+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 93994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:17.995 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:17.988+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:17.996 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:17.992+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:18.998 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:18.992+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:19.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:19.060+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94035 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:19.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:19.112+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcf40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:20.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:19.996+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33fdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:20.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:20.116+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fdbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:20.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:20.152+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:20.527 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:20.524+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:21.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:21.116+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:21.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:21.116+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:21.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:21.452+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:22.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:22.120+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:22.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:22.120+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:22.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:22.644+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:23.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:23.120+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:23.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:23.124+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:23.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:23.912+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:24.129 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:24.124+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:24.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:24.124+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fca70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:25.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:25.128+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:25.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:25.128+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:25.167 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:25.160+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94200 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:25.726 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:25.720+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:26.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:26.128+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:26.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:26.132+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:26.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:26.296+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:27.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:27.132+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:27.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:27.136+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:27.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:27.412+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94263 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:28.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:28.136+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:28.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:28.136+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ce70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:28.683 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:28.676+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:29.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:29.136+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:29.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:29.140+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33eb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:29.901 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:29.892+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:30.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:30.140+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:30.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:30.140+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:30.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:30.772+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:31.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:31.116+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:31.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:31.140+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:31.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:31.144+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:32.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:32.144+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:32.151 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:32.148+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33de30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:32.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:32.272+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:33.151 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:33.148+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:33.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:33.148+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:33.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:33.416+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:34.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:34.148+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fbf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:34.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:34.152+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:34.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:34.580+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:35.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:35.152+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fcae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:35.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:35.156+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:35.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:35.736+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:35.776 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:35.772+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:36.162 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:36.156+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c430af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:36.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:36.168+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f74fd9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:36.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:36.980+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:37.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:37.160+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4327d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:37.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:37.172+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8286fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:38.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:38.160+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:38.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:38.164+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:38.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:38.176+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:38.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:30:38.367+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:39.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:39.163+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:39.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:39.175+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:39.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:39.272+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:40.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:40.167+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:40.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:40.179+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:40.509 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:40.500+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:40.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:40.771+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:41.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:41.167+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:41.187 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:41.179+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:41.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:41.708+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94616 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:42.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:42.171+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:42.189 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:42.183+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:42.822 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:42.816+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:43.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:43.171+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4338e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:43.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:43.187+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:44.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:44.112+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:44.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:44.175+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:44.193 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:44.187+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:45.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:45.179+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:45.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:45.191+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:45.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:45.508+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94715 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:45.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:45.771+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:46.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:46.179+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:46.198 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:46.191+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:46.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:46.816+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:47.193 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:47.183+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:47.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:47.195+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:47.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:47.992+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:48.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:48.195+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:48.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:48.199+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:49.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:49.160+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:49.204 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:49.199+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:49.206 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:49.199+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:50.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:50.203+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:50.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:50.203+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:50.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:50.512+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94840 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:50.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:50.943+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:51.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:51.203+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:51.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:51.207+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:51.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:51.751+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:52.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:52.207+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:52.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:52.207+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:52.969 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:52.959+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:53.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:53.211+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:53.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:53.211+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:54.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:54.103+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:54.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:54.215+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd903f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:54.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:54.215+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:55.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:55.215+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:55.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:55.219+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:55.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:55.359+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:56.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:56.219+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:56.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:56.219+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:56.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:30:56.479+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:56.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:56.583+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 94989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:57.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:57.223+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:57.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:57.223+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd927d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:57.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:57.867+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:58.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:58.227+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:58.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:58.227+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:59.079 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:30:59.071+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:30:59.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:30:59.231+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:30:59.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:30:59.231+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:00.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:00.231+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94da9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:00.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:00.231+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:00.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:00.239+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95088 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:01.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:01.235+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94daa10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:01.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:01.235+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:01.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:01.487+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:01.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:01.503+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:02.243 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:02.239+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94daa80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:02.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:02.243+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:02.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:02.695+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:03.246 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:03.239+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94daaf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:03.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:03.247+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:03.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:03.871+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:04.248 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:04.243+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dab60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:04.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:04.247+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:05.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:05.043+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:05.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:05.243+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dabd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:05.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:05.251+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:06.253 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:06.247+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dac40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:06.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:06.255+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:06.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:06.259+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:06.557 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:06.551+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:07.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:07.247+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dacb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:07.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:07.263+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd931e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:07.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:07.595+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:08.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:08.251+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dad20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:08.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:08.263+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:08.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:31:08.367+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:08.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:08.891+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95302 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:09.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:09.255+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dad90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:09.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:09.267+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:10.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:10.107+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95330 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:10.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:10.255+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dae00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:10.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:10.271+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:11.265 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:11.259+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dae70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:11.282 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:11.271+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:11.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:11.423+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:11.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:11.687+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:12.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:12.263+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94daee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:12.283 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:12.275+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd934f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:12.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:12.743+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:13.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:13.267+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94daf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:13.289 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:13.279+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd915e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:13.906 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:13.899+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95416 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:14.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:14.267+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dafc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:14.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:14.279+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd908c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:15.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:15.199+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95447 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:15.287 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:15.282+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd901c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:15.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:15.430+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:16.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:16.282+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:16.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:16.434+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:16.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:16.487+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:17.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:17.234+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:17.293 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:17.286+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:17.442 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:17.434+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:17.660 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:17.647+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:18.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:18.290+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:18.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:18.438+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:18.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:18.819+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:19.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:19.290+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:19.447 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:19.442+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:19.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:19.987+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:20.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:20.294+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:20.451 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:20.446+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:21.167 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:21.155+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:21.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:21.294+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:21.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:21.446+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:22.249 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:22.242+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:22.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:22.298+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:22.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:22.427+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:22.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:22.450+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:23.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:23.298+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:23.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:23.450+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:23.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:23.771+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:24.310 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:24.302+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd919d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:24.462 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:24.454+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:25.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:25.015+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:25.312 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:25.306+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:25.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:25.458+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:26.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:26.303+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95755 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:26.306+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:26.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:26.462+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:27.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:27.274+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:27.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:27.310+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:27.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:27.466+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:27.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:27.611+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:28.320 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:28.314+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:28.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:28.466+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:28.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:28.811+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95836 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:29.323 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:29.314+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:29.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:29.470+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:29.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:29.979+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95865 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:30.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:30.318+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:30.479 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:30.474+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:31.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:31.219+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:31.326 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:31.318+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:31.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:31.474+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:32.281 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:32.274+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:32.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:32.322+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd923e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:32.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:32.474+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:32.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:32.643+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95936 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:33.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:33.326+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:33.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:33.478+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:33.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:33.814+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:34.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:34.326+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:34.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:34.482+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:35.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:35.050+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 95996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:35.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:35.330+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd902a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:35.491 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:35.482+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:36.338 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:36.330+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:36.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:36.334+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:36.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:36.486+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:37.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:37.326+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:37.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:37.334+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd935d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:37.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:37.486+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:37.677 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:37.666+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96068 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:38.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:38.338+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd910a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:38.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:31:38.366+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:38.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:38.490+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:38.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:38.794+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:39.346 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:39.338+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:39.499 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:39.494+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:39.950 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:39.942+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96132 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:40.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:40.342+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:40.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:40.494+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbb20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:41.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:41.298+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:41.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:41.342+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:41.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:41.498+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbb90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:42.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:42.498+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:42.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:42.586+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:42.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:42.722+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96204 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:42.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:42.830+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:43.508 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:43.502+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:43.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:43.830+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:43.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:43.934+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:44.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:44.502+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:44.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:44.834+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:45.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:45.162+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:45.515 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:45.506+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:45.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:45.838+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd925a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:46.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:46.374+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:46.608 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:46.602+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbdc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:46.846 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:46.838+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:47.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:47.602+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:47.611 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:47.606+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:47.691 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:47.686+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:47.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:47.842+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:48.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:48.606+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:48.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:48.846+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:48.970 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:48.962+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96363 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:49.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:49.610+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:49.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:49.850+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:50.222 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:50.218+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:50.624 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:50.610+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:50.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:50.850+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:51.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:51.610+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:51.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:51.642+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:51.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:51.854+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:52.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:52.645+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:52.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:52.681+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:52.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:52.853+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:52.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:52.862+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96467 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:53.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:53.649+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:53.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:53.857+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd932c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:54.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:54.182+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:54.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:54.649+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:54.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:54.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:55.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:55.346+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:55.660 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:55.653+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:55.870 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:55.861+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:56.611 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:56.606+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:56.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:56.653+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:56.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:56.865+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd907e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:57.665 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:57.657+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:57.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:31:57.693+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:57.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:57.838+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:57.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:57.869+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:58.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:58.661+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:58.880 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:58.873+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:59.115 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:31:59.102+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:31:59.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:31:59.661+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:31:59.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:31:59.873+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd920d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:00.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:00.522+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96640 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:00.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:00.665+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:00.885 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:00.877+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:01.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:01.669+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:01.697 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:01.690+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:01.887 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:01.881+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:02.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:02.669+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:02.703 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:02.697+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:02.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:02.881+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:03.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:03.138+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:03.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:03.673+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:03.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:03.885+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:04.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:04.458+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:04.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:04.677+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:04.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:04.885+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd909a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:05.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:05.666+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96782 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:05.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:05.677+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:05.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:05.889+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:06.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:06.681+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:06.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:06.893+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:06.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:06.898+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:07.691 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:07.685+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:07.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:07.877+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:07.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:07.897+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd938e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:08.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:08.270+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:08.373 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:32:08.369+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:08.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:08.689+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:08.903 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:08.901+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd900e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:09.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:09.522+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:09.696 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:09.693+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:09.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:09.901+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:10.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:10.693+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:10.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:10.822+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96908 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:10.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:10.905+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:11.703 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:11.697+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:11.911 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:11.909+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:12.158 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:12.154+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:12.703 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:12.697+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:12.914 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:12.909+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:13.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:13.069+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:13.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:13.422+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 96972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:13.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:13.701+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:13.916 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:13.913+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd933a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:14.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:14.705+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dca00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:14.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:14.738+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97004 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:14.918 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:14.913+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:15.711 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:15.705+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dca70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:15.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:15.917+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:16.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:16.014+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:16.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:16.709+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:16.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:16.921+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:17.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:17.281+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:17.717 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:17.713+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:17.927 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:17.925+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:18.171 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:18.165+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:18.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:18.477+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:18.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:18.717+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcbc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:18.930 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:18.925+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:19.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:19.673+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:19.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:19.717+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcc30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:19.933 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:19.929+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:20.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:20.721+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:20.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:20.933+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:20.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:20.965+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:21.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:21.725+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:21.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:21.933+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:22.149 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:22.141+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:22.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:22.725+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcd80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:22.941 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:22.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd903f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:23.305 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:23.301+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:23.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:23.421+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:23.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:23.729+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcdf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:23.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:23.941+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:24.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:24.733+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dce60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:24.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:24.745+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:24.946 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:24.941+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd927d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:25.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:25.733+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:25.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:25.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:26.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:26.053+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:26.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:26.737+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcf40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:26.950 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:26.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:27.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:27.505+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:27.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:27.737+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcfb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:27.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:27.949+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:28.306 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:28.301+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:28.744 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:28.741+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:28.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:28.829+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97420 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:28.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:28.949+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:29.747 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:29.744+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:29.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:29.952+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:30.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:30.117+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:30.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:30.744+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:30.959 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:30.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:31.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:31.557+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:31.752 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:31.748+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:31.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:31.956+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:32.756 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:32.748+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:32.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:32.837+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97535 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:32.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:32.968+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:33.307 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:33.300+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:33.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:33.804+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:33.975 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:33.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd931e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:34.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:34.105+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97573 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:34.816 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:34.808+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:34.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:34.972+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:35.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:35.557+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:35.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:35.812+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:35.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:35.976+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:36.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:36.812+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:36.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:36.905+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97655 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:36.982 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:36.976+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:37.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:37.816+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:37.986 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:37.980+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd934f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:38.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:38.225+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:38.373 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:32:38.368+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:38.442 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:38.436+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:38.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:38.816+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:38.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:38.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd915e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:39.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:39.577+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:39.826 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:39.820+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:39.990 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:39.984+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd901c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:40.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:40.832+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:40.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:40.885+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:40.992 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:40.988+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:41.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:41.836+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:41.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:41.988+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:42.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:42.249+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97816 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:42.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:42.836+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:42.998 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:42.992+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:43.607 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:43.604+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:43.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:43.649+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97855 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:43.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:43.940+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:44.001 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:43.996+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:44.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:44.905+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97891 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:44.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:44.944+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:45.003 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:44.996+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:45.950 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:45.944+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:46.005 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:46.000+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:46.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:46.209+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:46.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:46.948+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:47.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:47.004+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:47.573 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:47.565+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 97960 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:47.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:47.952+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:48.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:48.004+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd919d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:48.687 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:48.680+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:48.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:48.969+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:49.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:49.016+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:49.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:49.020+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:50.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:50.024+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:50.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:50.024+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:50.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:50.245+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:51.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:51.028+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:51.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:51.196+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:51.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:51.573+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98072 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:52.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:52.032+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:52.204 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:52.200+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:52.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:52.757+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:53.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:53.036+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:53.206 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:53.200+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:53.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:53.880+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:54.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:54.036+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:54.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:54.097+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:54.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:54.204+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd923e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:55.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:55.040+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:55.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:55.208+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:55.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:55.429+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98180 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:56.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:56.044+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:56.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:56.208+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:56.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:56.617+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:57.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:57.044+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:57.217 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:57.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd902a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:57.893 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:57.885+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:58.052 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:58.048+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:58.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:58.212+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:58.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:32:58.980+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:59.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:32:59.048+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:32:59.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:32:59.181+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:32:59.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:32:59.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd910a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:00.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:00.052+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:00.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:00.216+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:00.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:00.504+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:01.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:01.052+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dba9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:01.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:01.220+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:01.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:01.764+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:02.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:02.056+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbaa10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:02.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:02.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:02.983 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:02.972+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:03.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:03.060+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbaa80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:03.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:03.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:04.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:04.068+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:04.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:04.064+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbaaf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:04.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:04.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:04.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:04.288+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98423 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:05.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:05.080+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbab60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:05.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:05.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd925a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:05.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:05.536+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:06.092 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:06.079+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbabd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:06.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:06.231+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:07.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:07.068+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:07.091 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:07.083+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbac40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:07.249 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:07.243+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:08.095 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:08.087+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbacb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:08.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:08.232+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:08.259 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:08.247+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:08.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:33:08.367+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:09.094 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:09.087+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbad20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:09.155 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:09.151+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:09.253 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:09.247+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:09.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:09.516+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:10.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:10.091+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbad90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:10.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:10.251+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:10.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:10.676+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:11.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:11.163+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbae00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:11.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:11.251+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:11.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:11.856+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:12.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:12.167+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbae70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:12.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:12.255+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd932c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:13.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:13.156+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98682 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:13.176 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:13.171+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbaee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:13.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:13.259+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:14.179 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:14.171+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbaf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:14.265 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:14.259+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd907e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:14.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:14.279+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:14.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:14.528+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:15.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:15.175+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbafc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:15.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:15.263+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:15.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:15.716+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:16.183 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:16.179+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:16.271 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:16.263+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:16.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:16.856+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:17.185 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:17.179+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:17.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:17.267+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd920d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:18.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:18.004+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98809 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:18.189 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:18.183+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:18.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:18.307+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:19.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:19.196+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:19.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:19.279+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:19.288 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:19.283+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:19.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:19.311+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:20.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:20.283+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:20.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:20.315+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:20.441 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:20.432+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:21.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:21.287+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:21.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:21.315+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd909a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:21.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:21.672+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:22.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:22.291+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:22.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:22.319+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:22.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:22.912+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:23.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:23.295+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:23.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:23.319+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:24.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:24.299+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:24.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:24.323+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd900e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:24.481 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:24.475+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:24.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:24.584+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 98979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:25.306 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:25.299+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:25.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:25.327+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:25.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:25.920+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:26.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:26.303+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:26.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:26.327+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:27.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:27.224+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:27.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:27.307+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:27.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:27.331+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:28.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:28.307+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:28.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:28.335+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:28.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:28.612+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:29.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:29.327+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:29.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:29.547+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:29.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:29.579+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:29.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:29.824+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99140 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:30.335 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:30.327+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:30.586 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:30.579+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:31.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:31.060+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:31.337 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:31.331+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:31.588 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:31.583+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:32.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:32.308+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99203 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:32.340 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:32.335+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:32.592 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:32.587+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:33.343 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:33.335+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:33.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:33.544+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:33.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:33.587+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:34.413 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:34.407+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:34.558 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:34.551+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:34.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:34.591+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4327d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:34.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:34.696+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:35.416 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:35.411+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:35.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:35.591+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:35.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:35.936+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:36.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:36.527+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:36.601 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:36.595+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c431dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:37.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:37.300+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:37.536 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:37.531+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:37.604 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:37.599+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:38.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:33:38.515+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:38.541 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:38.535+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:38.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:38.599+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:38.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:38.720+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99352 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:39.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:39.567+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:39.636 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:39.631+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:39.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:39.635+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c4338e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:40.026 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:40.020+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:40.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:40.567+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:40.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:40.639+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c433b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:41.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:41.344+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:41.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:41.571+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbb20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:41.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:41.639+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:42.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:42.548+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99443 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:42.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:42.575+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbb90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:42.651 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:42.643+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:43.584 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:43.578+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:43.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:43.646+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c432840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:43.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:43.879+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:44.586 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:44.578+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:44.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:44.646+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:44.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:44.666+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:45.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:45.175+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:45.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:45.582+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:45.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:45.650+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:46.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:46.367+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99537 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:46.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:46.582+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:46.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:46.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:47.594 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:47.586+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbdc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:47.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:47.603+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:47.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:47.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:48.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:48.590+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:48.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:48.658+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:48.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:48.955+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:49.654 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:49.646+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:49.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:49.662+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33c930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:49.933 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:49.926+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:50.247 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:50.239+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:50.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:50.650+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:50.670 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:50.662+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33ce70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:51.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:51.451+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:51.659 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:51.650+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:51.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:51.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33eb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:52.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:52.607+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:52.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:52.654+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbbff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:52.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:52.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33e3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:53.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:53.658+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:53.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:53.670+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33d730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:53.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:53.863+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:54.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:54.674+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b33dc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:54.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:54.658+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:55.097 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:33:55.090+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:55.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:55.115+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99775 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:55.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:55.662+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:55.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:55.674+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:56.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:56.307+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:56.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:56.666+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:56.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:56.678+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:57.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:57.591+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:57.677 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:57.670+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:57.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:57.678+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de600e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:58.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:58.674+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:58.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:58.682+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:58.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:33:58.823+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:33:59.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:33:59.750+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:33:59.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:33:59.750+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:00.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:00.107+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99915 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:00.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:00.466+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:00.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:00.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:00.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:00.754+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de602a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:01.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:01.315+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:01.763 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:01.754+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:01.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:01.758+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:02.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:02.567+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 99985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:02.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:02.758+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:02.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:02.762+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:03.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:03.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:03.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:03.762+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de603f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:03.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:03.783+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:04.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:04.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:04.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:04.766+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de604d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:05.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:05.079+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:05.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:05.514+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:05.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:05.766+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:05.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:05.766+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:06.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:06.387+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:06.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:06.766+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:06.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:06.770+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de605b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:07.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:07.647+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:07.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:07.770+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:07.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:07.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:08.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:34:08.538+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:08.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:08.770+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:08.788 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:08.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:08.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:08.903+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100143 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:09.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:09.774+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:09.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:09.778+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:10.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:10.167+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:10.705 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:10.698+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:10.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:10.778+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:10.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:10.782+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de607e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:11.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:11.379+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:11.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:11.778+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:11.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:11.782+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:12.622 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:12.611+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:12.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:12.782+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:12.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:12.786+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de608c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:13.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:13.782+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:13.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:13.790+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:13.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:13.851+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:14.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:14.914+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbc990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:14.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:14.914+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:15.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:15.047+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:15.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:15.834+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:15.923 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:15.918+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbca00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:15.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:15.922+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:16.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:16.223+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:16.925 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:16.918+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbca70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:16.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:16.926+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:17.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:17.555+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100363 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:17.928 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:17.922+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:17.938 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:17.926+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:18.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:18.855+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:18.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:18.926+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:18.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:18.930+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:19.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:19.925+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcbc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:19.938 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:19.929+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:20.204 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:20.195+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:20.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:20.929+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcc30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:20.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:20.933+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:21.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:21.097+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:21.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:21.523+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:21.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:21.929+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:21.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:21.933+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:22.941 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:22.933+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcd10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:22.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:22.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:22.960 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:22.951+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:23.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:23.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcd80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:23.946 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:23.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:24.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:24.239+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:24.946 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:24.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcdf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:24.948 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:24.941+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:25.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:25.507+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:25.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:25.941+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbce60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:25.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:25.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de60fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:26.254 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:26.245+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:26.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:26.842+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:26.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:26.941+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbced0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:26.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:26.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:27.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:27.945+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcf40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:27.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:27.949+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de610a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:28.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:28.150+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100665 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:28.958 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:28.949+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:28.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:28.949+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbcfb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:29.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:29.342+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:29.967 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:29.957+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de611f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:29.967 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:29.961+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:30.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:30.494+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:30.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:30.961+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:30.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:30.965+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:31.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:31.381+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:31.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:31.842+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:31.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:31.965+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:31.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:31.969+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de612d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:32.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:32.969+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:32.978 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:32.969+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:33.183 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:33.174+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:33.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:33.973+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:33.985 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:33.977+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de613b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:34.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:34.382+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:35.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:35.025+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:35.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:35.025+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:35.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:35.706+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100857 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:36.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:36.029+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:36.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:36.029+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:36.455 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:36.453+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:36.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:36.946+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:37.035 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:37.033+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:37.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:37.033+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:38.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:38.033+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de615e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:38.040 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:38.037+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:38.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:38.182+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:38.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:34:38.545+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:39.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:39.041+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:39.044 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:39.041+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:39.386 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:39.382+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:40.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:40.101+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:40.125 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:40.101+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:40.545 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:40.538+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 100998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:41.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:41.101+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de617a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:41.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:41.105+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:41.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:41.613+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:41.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:41.762+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101031 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:42.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:42.105+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:42.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:42.105+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:43.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:43.050+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:43.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:43.109+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:43.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:43.109+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f360e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:44.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:44.109+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de618f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:44.115 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:44.109+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:44.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:44.238+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101092 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:45.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:45.113+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f361c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:45.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:45.113+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de619d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:45.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:45.410+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:46.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:46.117+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:46.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:46.117+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:46.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:46.614+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101152 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:46.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:46.637+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:47.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:47.117+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:47.123 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:47.121+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f362a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:47.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:47.806+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:48.129 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:48.121+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:48.129 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:48.121+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:48.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:48.958+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:49.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:49.125+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:49.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:49.125+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:50.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:50.162+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:50.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:50.545+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:50.551 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:50.549+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f363f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:51.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:51.318+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:51.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:51.545+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:51.554 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:51.549+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:51.682 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:51.677+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:52.553 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:52.549+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:52.556 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:52.553+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f364d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:52.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:52.578+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:53.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:53.549+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:53.558 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:53.553+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:53.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:53.938+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:54.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:54.553+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:54.561 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:54.557+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f365b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:55.365 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:55.358+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101399 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:55.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:55.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:55.563 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:55.557+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:56.563 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:56.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:56.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:56.561+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:56.677 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:56.670+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:56.697 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:34:56.693+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:57.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:57.560+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:57.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:57.720+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de61ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:57.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:57.938+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:58.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:58.564+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:58.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:58.724+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:59.216 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:34:59.206+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:34:59.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:34:59.568+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f367e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:34:59.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:34:59.728+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:00.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:00.418+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:00.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:00.568+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:00.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:00.728+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de621b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:01.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:01.572+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f368c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:01.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:01.606+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:01.736 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:01.732+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:01.930 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:01.924+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:02.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:02.572+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:02.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:02.732+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:02.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:02.858+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:03.582 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:03.576+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f369a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:03.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:03.736+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:04.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:04.122+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101620 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:04.584 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:04.580+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:04.744 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:04.740+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de623e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:05.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:05.270+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:05.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:05.584+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:05.747 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:05.740+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:06.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:06.438+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:06.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:06.588+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:06.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:06.744+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de624c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:07.082 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:07.076+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:07.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:07.592+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:07.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:07.634+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:07.760 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:07.756+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:08.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:08.592+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:08.650 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:35:08.644+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:08.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:08.756+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de625a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:08.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:08.805+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:09.601 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:09.596+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:09.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:09.764+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:10.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:10.257+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:10.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:10.600+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:10.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:10.764+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de626f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:11.519 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:11.513+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101795 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:11.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:11.600+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:11.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:11.768+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:12.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:12.460+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:12.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:12.604+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:12.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:12.697+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:12.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:12.768+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de627d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:13.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:13.608+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:13.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:13.772+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:13.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:13.889+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:14.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:14.608+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:14.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:14.772+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:15.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:15.361+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101875 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:15.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:15.612+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:15.784 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:15.776+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:16.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:16.573+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:16.618 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:16.612+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:16.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:16.780+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:17.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:17.460+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:17.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:17.660+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:17.787 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:17.780+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:17.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:17.813+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:18.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:18.664+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:18.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:18.784+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:19.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:19.121+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101960 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:19.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:19.668+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f370a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:19.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:19.788+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:20.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:20.441+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 101984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:20.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:20.668+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:20.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:20.792+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:21.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:21.672+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:21.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:21.689+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:21.800 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:21.796+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:22.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:22.484+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:22.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:22.672+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f371f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:22.803 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:22.796+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:22.893 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:22.885+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:23.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:23.676+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:23.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:23.800+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:24.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:24.125+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:24.684 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:24.680+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f372d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:24.807 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:24.804+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:25.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:25.657+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:25.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:25.680+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:25.810 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:25.804+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:26.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:26.684+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f373b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:26.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:26.808+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:26.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:26.897+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:27.672 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:27.664+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:27.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:27.688+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:27.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:27.808+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de62fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:28.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:28.149+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:28.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:28.688+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:28.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:28.812+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:29.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:29.429+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102218 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:29.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:29.692+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:29.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:29.816+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:30.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:30.689+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:30.701 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:30.696+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:30.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:30.816+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:31.702 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:31.696+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f375e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:31.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:31.820+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de631e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:31.918 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:31.913+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:32.704 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:32.700+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:32.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:32.764+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:32.828 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:32.824+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:33.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:33.309+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:33.707 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:33.700+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f376c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:33.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:33.828+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de632c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:34.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:34.581+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:34.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:34.704+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:34.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:34.828+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de633a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:35.711 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:35.703+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f377a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:35.837 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:35.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:35.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:35.853+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:36.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:36.707+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:36.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:36.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:37.283 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:37.277+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:37.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:37.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:37.806 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:37.799+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:37.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:37.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de634f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:38.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:38.637+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:38.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:35:38.643+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:38.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:38.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f378f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:38.843 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:38.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:39.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:39.715+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:39.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:39.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de63640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:39.954 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:39.949+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102479 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:40.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:40.715+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f379d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:40.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:40.843+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de636b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:41.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:41.249+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:41.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:41.719+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:41.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:41.847+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:42.548 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:42.541+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:42.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:42.723+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:42.855 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:42.847+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:42.938 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:42.931+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:43.730 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:43.723+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:43.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:43.851+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:43.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:43.989+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:44.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:44.727+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:44.860 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:44.855+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:45.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:45.445+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:45.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:45.727+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:45.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:45.855+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:46.737 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:46.731+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:46.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:46.813+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:46.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:46.859+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:47.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:47.735+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:47.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:47.863+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:47.976 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:47.971+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:48.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:48.189+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102669 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:48.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:48.735+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:48.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:48.863+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:49.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:49.441+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102704 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:49.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:49.739+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:49.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:49.867+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3baa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:50.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:50.743+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:50.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:50.797+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102740 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:50.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:50.867+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:51.751 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:51.747+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:51.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:51.871+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:52.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:52.156+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:52.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:52.747+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:52.880 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:52.875+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3ba30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:52.982 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:52.975+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:53.365 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:53.356+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:53.757 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:53.751+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:53.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:53.875+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:54.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:54.528+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102841 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:54.759 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:54.751+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f37ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:54.886 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:54.879+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:55.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:55.755+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:55.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:55.883+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:56.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:56.088+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:56.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:56.759+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f380d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:56.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:56.883+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3be20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:57.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:57.392+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102912 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:57.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:57.763+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:57.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:57.887+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:57.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:35:57.983+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:58.586 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:58.580+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:58.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:58.767+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f381b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:58.895 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:58.887+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bf00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:59.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:35:59.767+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:35:59.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:35:59.780+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 102979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:35:59.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:35:59.895+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de383f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:00.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:00.771+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:00.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:00.895+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3be90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:01.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:01.016+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:01.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:01.771+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:01.905 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:01.899+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de384d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:02.283 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:02.276+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:02.785 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:02.775+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:02.907 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:02.903+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bf70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:03.017 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:03.011+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:03.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:03.440+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:03.843 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:03.839+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f383e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:03.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:03.903+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de385b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:04.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:04.556+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:04.847 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:04.839+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:04.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:04.907+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:05.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:05.764+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:05.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:05.843+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f384c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:05.915 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:05.907+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:06.851 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:06.847+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:06.919 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:06.911+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:07.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:07.048+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:07.854 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:07.847+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f385a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:07.920 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:07.915+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:08.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:08.011+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:08.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:08.308+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:08.651 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:36:08.647+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:08.856 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:08.851+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:08.922 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:08.915+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:09.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:09.552+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:09.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:09.851+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:09.924 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:09.919+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:10.860 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:10.855+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f386f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:10.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:10.872+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103263 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:11.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:11.059+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:11.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:11.855+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:12.105 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:12.099+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:12.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:12.124+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103295 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:12.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:12.858+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f387d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:13.108 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:13.102+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de387e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:13.168 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:13.162+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:13.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:13.372+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:13.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:13.862+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:14.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:14.102+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:14.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:14.688+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:14.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:14.862+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f388b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:15.112 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:15.106+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56d960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:15.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:15.866+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:15.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:15.948+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:16.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:16.106+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56dab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:16.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:16.866+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:17.121 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:17.110+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56da40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:17.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:17.296+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103451 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:17.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:17.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:18.119 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:18.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56db90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:18.264 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:18.258+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:18.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:18.504+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:18.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:18.870+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:19.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:19.114+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56db20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:19.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:19.844+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:19.882 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:19.874+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:20.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:20.126+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56dc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:20.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:20.878+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:21.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:21.126+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56dd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:21.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:21.164+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:21.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:21.878+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:22.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:22.130+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56dce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:22.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:22.552+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:22.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:22.882+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:23.139 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:23.134+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56de30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:23.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:23.422+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:23.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:23.880+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:24.005 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:23.998+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:24.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:24.134+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ddc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:25.007 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:25.002+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:25.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:25.138+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56dea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:25.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:25.204+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103653 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:26.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:26.002+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:26.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:26.142+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56dff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:26.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:26.552+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:27.012 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:27.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:27.151 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:27.142+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56df80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:27.907 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:27.900+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103724 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:28.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:28.006+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:28.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:28.146+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:28.429 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:28.422+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:29.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:29.010+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:29.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:29.150+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:29.285 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:29.276+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103765 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:30.018 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:30.010+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:30.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:30.150+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:30.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:30.460+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:31.020 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:31.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:31.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:31.154+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:31.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:31.772+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:32.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:32.014+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:32.163 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:32.154+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:33.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:33.018+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:33.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:33.060+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 103854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:33.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:33.158+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:33.452 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:33.446+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:34.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:34.114+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:34.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:34.162+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:34.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:34.360+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:35.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:35.114+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:35.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:35.162+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:35.539 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:35.531+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:36.124 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:36.118+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f391e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:36.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:36.166+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:36.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:36.903+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:37.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:37.118+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:37.175 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:37.166+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:38.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:38.071+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:38.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:38.122+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f392c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:38.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:38.170+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:38.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:38.538+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:38.766 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:36:38.758+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:39.150 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:39.142+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:39.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:39.174+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:39.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:39.331+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:40.152 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:40.146+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f393a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:40.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:40.178+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:40.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:40.611+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:41.154 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:41.146+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:41.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:41.178+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:41.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:41.927+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:42.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:42.150+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:42.189 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:42.182+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:43.159 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:43.150+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f394f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:43.192 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:43.186+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:43.204 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:43.195+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:43.544 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:43.538+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:44.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:44.154+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f63e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:44.194 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:44.186+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:44.521 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:44.511+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:45.163 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:45.154+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:45.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:45.190+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56e920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:45.734 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:45.723+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:46.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:46.158+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f6610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:46.199 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:46.194+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ea70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:46.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:46.947+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:47.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:47.162+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:47.285 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:47.278+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ea00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:48.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:48.162+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f64c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:48.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:48.179+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104352 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:48.288 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:48.282+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56eb50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:48.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:48.538+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:49.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:49.218+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f60d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:49.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:49.282+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56eae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:49.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:49.395+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:50.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:50.222+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f65a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:50.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:50.286+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ebc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:50.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:50.867+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:51.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:51.225+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f61b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:51.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:51.289+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ed10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:52.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:52.103+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:52.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:52.229+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f43f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:52.301 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:52.293+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56eca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:53.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:53.229+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f6290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:53.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:53.297+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56edf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:53.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:53.415+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:53.600 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:53.593+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:54.318 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:54.309+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ed80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:54.319 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:54.313+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:54.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:54.803+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:55.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:55.313+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f79c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:55.323 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:55.313+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ee60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:56.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:55.995+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:56.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:56.317+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f7aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:56.330 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:56.317+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56efb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:57.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:57.321+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f78e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:57.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:57.321+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ef40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:57.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:57.391+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:58.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:58.321+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f66f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:58.332 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:58.325+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:58.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:58.679+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:36:58.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:36:58.733+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:59.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:36:59.361+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:59.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:36:59.361+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f7950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:36:59.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:36:59.903+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:00.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:00.361+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f7cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:00.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:00.365+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:01.373 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:01.365+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:01.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:01.365+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:01.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:01.391+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:02.376 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:02.369+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:02.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:02.369+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f7bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:02.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:02.639+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104737 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:03.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:03.373+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:03.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:03.373+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:03.751 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:03.745+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:03.983 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:03.975+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104769 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:04.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:04.373+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:04.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:04.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f7b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:05.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:05.343+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:05.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:05.377+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:05.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:05.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f55e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:06.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:06.385+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:06.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:06.385+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f47e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:06.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:06.571+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104836 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:07.389 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:07.385+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:07.392 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:07.389+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f56c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:07.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:07.947+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104871 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:08.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:08.389+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:08.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:08.389+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:08.816 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:37:08.813+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:09.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:09.005+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:09.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:09.263+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:09.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:09.393+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:09.397 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:09.393+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f57a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:10.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:10.393+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f51f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:10.453 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:10.449+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:10.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:10.567+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:11.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:11.397+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:11.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:11.453+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:11.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:11.791+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:12.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:12.453+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:12.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:12.593+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f49a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:13.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:12.995+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 104990 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:13.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:13.457+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:13.600 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:13.597+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:14.011 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:14.005+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:14.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:14.179+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:14.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:14.549+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:14.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:14.601+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:15.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:15.447+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:15.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:15.553+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:15.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:15.601+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:16.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:16.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fa30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:16.611 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:16.605+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:16.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:16.751+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:17.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:17.557+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56f9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:17.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:17.609+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f48c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:18.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:18.082+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:18.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:18.561+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:18.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:18.609+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:19.119 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:19.113+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:19.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:19.314+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105136 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:19.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:19.565+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:19.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:19.613+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:20.570 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:20.565+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:20.618 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:20.613+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f6e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:20.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:20.642+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:21.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:21.569+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:21.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:21.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:21.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:21.906+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:22.574 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:22.569+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:22.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:22.621+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f7250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:23.247 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:23.238+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:23.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:23.573+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fdb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:23.627 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:23.621+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:24.542 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:24.537+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:24.579 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:24.573+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fe90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:24.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:24.574+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:24.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:24.625+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:25.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:25.577+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56fe20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:25.632 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:25.629+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f6d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:25.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:25.834+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:26.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:26.577+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ff70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:26.634 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:26.629+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:27.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:27.510+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105331 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:27.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:27.585+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b56ff00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:27.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:27.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:28.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:28.584+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:28.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:28.636+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:28.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:28.858+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:29.601 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:29.592+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0119d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:29.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:29.636+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f6df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:29.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:29.696+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:30.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:30.066+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:30.600 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:30.596+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:30.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:30.640+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f6bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:31.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:31.354+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105416 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:31.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:31.600+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:31.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:31.640+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f4b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:32.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:32.600+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:32.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:32.634+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:32.649 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:32.644+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f50a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:33.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:33.604+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:33.653 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:33.648+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f5650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:33.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:33.910+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:34.767 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:34.760+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:34.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:34.852+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f7410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:34.858 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:34.852+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:35.269 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:35.258+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:35.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:35.856+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:35.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:35.856+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f82f53b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:36.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:36.638+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:36.863 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:36.860+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:36.864 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:36.860+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:37.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:37.860+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:37.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:37.860+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:38.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:38.038+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:38.870 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:38.864+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86200e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:38.931 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:38.864+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:38.932 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:37:38.872+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:39.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:39.178+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:39.823 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:39.764+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:39.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:39.868+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:39.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:39.868+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0118f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:40.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:40.350+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:40.875 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:40.872+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:40.876 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:40.872+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86201c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:41.611 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:41.606+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:41.878 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:41.872+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:41.879 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:41.872+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:42.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:42.876+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:42.881 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:42.876+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86202a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:42.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:42.962+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105704 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:43.883 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:43.880+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:43.884 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:43.880+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:44.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:44.302+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:44.884 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:44.880+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:44.888 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:44.884+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:44.890 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:44.884+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:45.837 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:45.830+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:45.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:45.888+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86203f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:45.891 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:45.888+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e3ba140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:46.893 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:46.888+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e3ba1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:46.894 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:46.888+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:47.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:47.106+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:47.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:47.892+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e3ba220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:47.897 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:47.892+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86204d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:48.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:48.342+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:48.898 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:48.892+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:48.900 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:48.896+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:49.567 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:49.562+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:49.885 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:49.880+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:49.901 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:49.896+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:49.902 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:49.896+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86205b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:50.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:50.882+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105895 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:50.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:50.896+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:50.909 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:50.900+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:51.906 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:51.900+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd886f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:51.908 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:51.904+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:52.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:52.058+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105923 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:52.908 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:52.904+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:52.910 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:52.904+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:53.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:53.266+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:53.911 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:53.908+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:53.912 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:53.908+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:54.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:54.602+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 105996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:55.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:37:55.008+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:55.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:55.012+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:55.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:55.012+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86207e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:55.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:55.986+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:56.021 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:56.016+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:56.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:56.016+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:57.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:57.020+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:57.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:57.020+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86208c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:57.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:57.286+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:58.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:58.020+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:58.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:58.024+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:58.509 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:58.502+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:37:59.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:37:59.024+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86209a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:59.030 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:37:59.024+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:37:59.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:37:59.734+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:00.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:00.028+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:00.033 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:00.028+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd895d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:00.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:00.348+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:01.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:01.028+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:01.036 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:01.032+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:01.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:01.061+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:02.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:02.032+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:02.038 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:02.032+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:02.418 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:02.413+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:03.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:03.036+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:03.051 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:03.036+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:03.655 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:03.649+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:04.044 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:04.040+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:04.050 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:04.040+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:04.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:04.853+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106243 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:05.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:05.040+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:05.047 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:05.040+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd878f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:05.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:05.504+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:06.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:06.041+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:06.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:06.043+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:06.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:06.047+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:07.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:07.047+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:07.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:07.051+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:07.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:07.257+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:08.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:08.051+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:08.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:08.051+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:08.666 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:08.649+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:08.878 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:38:08.871+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:09.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:09.051+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:09.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:09.055+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:09.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:09.865+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:10.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:10.055+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:10.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:10.059+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:10.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:10.503+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:11.047 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:11.041+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:11.064 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:11.059+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:11.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:11.063+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:12.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:12.059+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:12.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:12.063+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:12.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:12.289+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:13.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:13.063+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8620fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:13.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:13.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:13.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:13.673+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:14.070 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:14.063+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:14.074 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:14.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:14.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:14.961+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:15.291 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:15.287+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:15.292 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:15.287+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86210a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:15.609 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:15.599+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:16.273 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:16.261+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:16.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:16.287+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:16.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:16.287+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:17.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:17.291+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:17.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:17.291+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:17.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:17.553+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:18.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:18.291+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86211f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:18.301 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:18.295+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd883e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:18.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:18.753+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:19.300 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:19.295+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:19.302 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:19.295+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:19.960 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:19.953+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:20.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:20.295+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86212d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:20.305 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:20.299+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd880d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:20.665 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:20.659+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:21.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:21.173+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:21.306 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:21.299+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:21.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:21.303+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd884c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:22.307 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:22.303+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86213b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:22.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:22.303+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd881b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:22.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:22.445+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:23.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:23.307+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:23.386 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:23.379+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:23.920 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:23.913+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106729 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:24.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:24.307+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:24.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:24.383+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:25.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:25.169+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106769 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:25.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:25.383+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:25.433 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:25.427+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:25.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:25.939+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:26.394 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:26.387+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:26.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:26.431+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:26.573 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:26.565+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:27.396 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:27.391+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86215e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:27.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:27.431+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd898e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:27.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:27.709+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:28.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:28.391+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:28.445 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:28.435+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd896b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:29.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:29.077+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106871 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:29.400 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:29.395+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86216c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:29.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:29.459+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd899c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:30.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:30.281+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106908 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:30.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:30.447+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:30.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:30.463+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:31.058 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:31.051+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:31.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:31.455+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86217a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:31.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:31.467+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:31.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:31.629+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:32.466 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:32.459+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:32.479 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:32.467+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:32.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:32.877+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 106975 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:33.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:33.467+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:33.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:33.471+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:34.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:34.297+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107008 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:34.474 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:34.467+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86218f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:34.479 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:34.471+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:35.472 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:35.465+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:35.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:35.471+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:35.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:35.475+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:36.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:36.071+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:36.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:36.475+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86219d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:36.484 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:36.479+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:36.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:36.733+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:37.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:37.479+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:37.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:37.479+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:37.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:37.929+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:38.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:38.479+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:38.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:38.483+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:38.939 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:38:38.931+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:39.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:39.205+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:39.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:39.483+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:39.491 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:39.487+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:40.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:40.441+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:40.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:40.487+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:40.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:40.487+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:41.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:41.095+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:41.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:41.487+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:41.498 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:41.491+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3aca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:41.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:41.669+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:42.496 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:42.491+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:42.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:42.495+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3af40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:42.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:42.965+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107204 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:43.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:43.491+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:43.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:43.499+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:44.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:44.140+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:44.502 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:44.494+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:44.506 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:44.498+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de382a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:45.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:45.372+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:45.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:45.606+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:45.616 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:45.606+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:46.108 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:46.094+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:46.575 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:46.568+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:46.615 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:46.610+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3ac30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:46.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:46.618+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:47.618 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:47.610+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:47.626 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:47.618+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:47.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:47.716+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:48.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:48.614+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:48.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:48.622+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:48.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:48.956+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:49.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:49.614+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3abc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:49.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:49.622+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:50.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:50.260+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:50.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:50.626+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8621ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:50.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:50.650+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:51.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:51.098+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:51.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:51.628+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:51.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:51.630+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:51.661 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:51.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3aae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:52.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:52.630+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86220d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:52.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:52.658+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:52.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:52.960+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107440 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:53.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:53.634+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:53.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:53.658+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:54.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:54.420+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:54.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:54.638+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86221b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:54.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:54.662+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:55.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:55.732+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:55.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:55.762+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:55.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:55.762+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:56.272 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:38:56.266+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:56.773 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:56.766+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:56.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:56.766+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:56.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:56.984+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:57.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:57.770+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:57.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:57.770+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:58.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:58.156+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:58.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:58.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:58.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:58.774+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:59.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:38:59.476+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:38:59.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:38:59.774+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3b720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:38:59.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:38:59.774+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86223e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:00.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:00.660+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:00.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:00.806+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:00.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:00.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:01.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:01.578+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:01.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:01.810+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bb10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:01.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:01.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86224c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:01.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:01.912+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:02.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:02.814+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:02.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:02.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:03.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:03.380+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:03.823 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:03.814+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:03.824 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:03.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86225a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:04.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:04.636+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:04.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:04.818+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:04.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:04.822+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:05.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:05.852+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:05.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:05.850+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:05.862 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:05.850+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:06.661 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:06.654+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:06.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:06.854+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86226f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:06.868 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:06.854+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de393b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:07.135 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:07.128+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:07.865 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:07.858+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:07.866 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:07.858+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:08.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:08.332+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:08.867 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:08.862+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de390a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:08.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:08.862+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86227d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:09.038 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:39:09.030+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:09.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:09.524+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:09.873 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:09.866+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:10.037 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:10.030+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:10.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:10.768+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:10.926 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:10.918+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86228b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:11.039 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:11.030+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:11.664 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:11.654+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:11.929 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:11.922+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:11.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:11.944+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:12.041 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:12.034+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de387e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:12.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:12.926+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:13.043 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:13.038+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:13.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:13.208+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:13.935 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:13.930+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:14.046 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:14.038+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:14.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:14.476+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:14.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:14.930+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:15.049 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:15.042+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:15.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:15.696+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107956 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:15.940 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:15.934+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:16.146 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:16.138+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:16.812 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:16.806+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:16.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:16.934+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:16.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:16.948+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 107978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:17.149 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:17.142+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:17.946 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:17.938+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:18.153 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:18.142+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:18.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:18.568+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:18.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:18.942+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:19.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:19.146+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:19.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:19.792+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:19.951 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:19.942+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:20.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:20.150+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:20.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:20.990+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:21.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:21.008+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:21.158 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:21.150+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de384d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:22.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:21.993+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:22.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:22.125+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:22.160 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:22.153+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:22.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:22.252+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:23.003 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:22.993+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:23.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:23.153+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de383f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:23.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:23.596+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:24.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:23.997+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:24.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:24.157+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de398f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:24.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:24.992+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:25.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:25.001+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:25.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:25.161+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:26.084 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:26.065+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:26.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:26.161+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:26.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:26.339+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:27.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:27.069+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8622fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:27.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:27.125+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:27.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:27.169+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de389a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:27.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:27.663+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:28.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:28.073+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:28.180 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:28.173+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de399d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:28.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:28.887+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:29.082 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:29.073+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:29.182 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:29.173+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3bcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:30.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:30.077+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:30.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:30.177+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:30.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:30.191+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:31.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:31.097+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:31.194 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:31.181+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:31.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:31.467+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:32.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:32.101+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86231e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:32.190 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:32.181+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:32.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:32.325+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:32.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:32.791+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:33.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:33.101+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:33.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:33.185+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3be90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:34.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:34.031+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:34.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:34.105+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86232c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:34.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:34.189+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:35.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:35.109+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:35.200 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:35.189+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:35.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:35.251+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108399 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:36.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:36.161+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86233a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:36.201 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:36.193+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:36.482 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:36.475+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:37.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:37.161+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:37.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:37.193+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:37.492 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:37.485+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:37.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:37.839+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:38.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:38.169+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:38.205 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:38.201+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:39.030 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:39.023+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:39.071 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:39:39.065+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:39.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:39.173+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86234f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:39.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:39.205+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd900e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:40.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:40.177+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f8623560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:40.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:40.209+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:40.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:40.279+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108520 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:41.184 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:41.181+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f86235d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:41.215 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:41.209+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:41.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:41.579+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:42.186 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:42.181+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787d3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:42.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:42.213+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:42.625 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:42.617+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:42.828 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:42.819+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:43.188 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:43.185+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787d790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:43.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:43.217+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:44.191 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:44.185+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787c300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:44.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:44.195+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:44.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:44.217+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd93100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:45.193 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:45.189+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787dcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:45.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:45.221+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074997c690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:45.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:45.603+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:46.196 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:46.189+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787d330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:46.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:46.225+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:46.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:46.939+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:47.197 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:47.193+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787d4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:47.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:47.225+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd870a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:47.770 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:47.765+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:48.200 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:48.197+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787bc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:48.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:48.229+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:48.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:48.267+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108705 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:49.202 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:49.197+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787bc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:49.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:49.269+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:49.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:49.667+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108729 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:50.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:50.201+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787d870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:50.276 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:50.273+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:51.067 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:51.059+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:51.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:51.205+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787dd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:51.278 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:51.273+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:52.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:52.205+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787bab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:52.280 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:52.277+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:52.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:52.327+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:52.771 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:52.765+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:53.213 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:53.209+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787bf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:53.282 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:53.277+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:53.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:53.567+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:54.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:54.213+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787bd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:54.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:54.281+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:54.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:54.847+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:55.219 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:55.213+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f68c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:55.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:55.285+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:56.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:56.217+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:56.290 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:56.285+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:56.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:56.303+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:57.224 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:57.221+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:57.293 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:57.289+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:57.599 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:57.591+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:57.928 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:39:57.921+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:58.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:58.221+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:58.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:58.289+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:59.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:39:59.179+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 108969 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:39:59.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:39:59.225+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:39:59.297 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:39:59.293+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:00.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:00.229+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:00.299 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:00.297+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd869a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:00.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:00.355+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:01.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:01.228+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f65b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:01.301 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:01.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:01.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:01.767+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:02.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:02.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f67e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:02.304 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:02.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd868c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:03.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:03.043+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:03.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:03.100+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:03.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:03.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:03.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:03.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:04.242 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:04.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:04.309 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:04.304+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd867e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:04.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:04.523+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:05.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:05.240+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:05.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:05.308+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:05.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:05.755+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:06.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:06.244+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:06.314 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:06.308+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd864d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:07.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:07.051+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:07.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:07.244+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f62a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:07.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:07.312+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:08.113 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:08.108+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:08.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:08.248+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:08.326 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:08.312+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd863f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:08.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:08.511+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:09.098 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:40:09.092+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:09.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:09.248+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:09.321 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:09.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:10.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:10.026+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:10.256 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:10.252+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:10.324 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:10.320+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:11.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:11.312+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:11.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:11.320+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:11.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:11.350+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:12.323 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:12.320+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:12.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:12.324+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:12.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:12.822+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:13.326 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:13.320+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f69a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:13.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:13.324+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:13.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:13.324+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:13.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:13.986+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:14.328 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:14.324+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:14.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:14.328+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd862a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:15.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:15.246+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:15.330 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:15.324+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:15.444 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:15.440+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd861c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:16.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:16.328+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:16.447 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:16.444+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd860e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:16.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:16.450+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:17.338 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:17.332+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:17.450 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:17.444+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:17.794 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:17.786+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:18.339 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:18.332+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:18.452 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:18.448+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:18.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:18.476+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:19.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:18.998+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:19.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:19.336+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:19.455 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:19.448+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:20.344 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:20.340+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f60e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:20.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:20.386+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:20.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:20.452+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:21.403 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:21.392+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f7030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:21.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:21.456+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:21.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:21.610+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:22.402 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:22.396+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f61c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:22.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:22.460+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:23.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:22.998+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:23.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:23.400+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f7110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:23.468 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:23.464+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:23.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:23.488+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:24.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:24.282+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:24.407 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:24.400+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:24.471 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:24.464+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:25.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:25.404+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f7180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:25.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:25.446+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:25.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:25.468+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0123e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:26.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:26.480+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f64d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:26.487 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:26.480+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0121b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:26.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:26.670+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109621 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:27.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:27.484+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:27.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:27.484+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:27.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:27.798+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109649 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:28.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:28.488+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f6000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:28.493 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:28.488+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:28.667 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:28.664+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:29.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:29.182+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109682 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:29.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:29.672+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:29.676 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:29.672+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f99f63f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:30.388 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:30.382+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109704 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:30.679 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:30.672+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:30.680 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:30.676+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48c290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:31.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:31.642+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:31.681 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:31.676+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:31.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:31.676+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48c060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:32.683 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:32.680+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:32.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:32.680+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:32.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:32.870+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:33.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:33.680+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:33.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:33.684+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48bb90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:33.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:33.688+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:34.285 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:34.278+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:34.689 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:34.684+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:34.690 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:34.684+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48c1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:35.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:35.474+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:35.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:35.688+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0113b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:35.692 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:35.688+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48bff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:36.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:36.688+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:36.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:36.692+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48c0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:36.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:36.942+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109857 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:37.697 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:37.692+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:37.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:37.692+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48bea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:38.254 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:38.250+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:38.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:38.692+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:38.700 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:38.696+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48bf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:38.872 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:38.868+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:39.099 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:40:39.096+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:39.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:39.482+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:39.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:39.695+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:39.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:39.699+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48bb20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:40.702 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:40.695+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0139c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:40.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:40.703+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48bab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:40.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:40.906+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:41.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:41.699+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:41.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:41.703+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48ba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:42.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:42.210+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 109978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:42.706 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:42.699+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:42.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:42.707+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:43.573 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:43.570+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:43.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:43.703+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:43.715 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:43.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:44.004 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:43.999+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:44.715 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:44.707+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:44.718 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:44.711+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:44.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:44.894+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110035 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:45.718 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:45.711+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:45.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:45.715+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:46.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:46.282+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:46.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:46.715+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:46.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:46.719+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:47.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:47.686+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:47.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:47.715+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:47.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:47.719+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:48.723 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:48.719+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:48.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:48.723+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:48.901 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:48.894+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:49.043 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:49.039+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:49.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:49.719+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:49.733 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:49.727+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:50.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:50.174+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:50.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:50.723+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:50.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:50.727+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:51.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:51.373+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:51.825 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:51.819+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011f80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:51.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:51.819+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:52.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:52.741+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:52.828 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:52.823+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:52.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:52.823+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:53.831 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:53.827+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:53.832 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:53.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:53.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:53.941+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:54.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:54.039+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:54.835 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:54.827+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:54.836 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:54.827+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fd2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:55.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:55.205+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:55.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:55.831+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fdd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:55.838 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:55.831+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:56.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:56.461+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:56.839 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:56.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fd880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:56.840 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:56.835+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:57.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:57.813+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:57.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:57.835+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fda40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:57.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:57.835+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:58.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:58.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fd960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:58.844 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:58.839+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:59.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:40:59.131+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:59.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:40:59.177+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:40:59.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:40:59.839+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:40:59.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:40:59.839+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fde30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:00.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:00.653+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:00.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:00.843+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fdff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:00.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:00.843+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:02.003 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:01.995+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fdb20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:02.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:01.999+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:02.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:02.033+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:03.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:02.999+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:03.010 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:02.999+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:03.273 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:03.265+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:04.008 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:04.003+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fdc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:04.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:04.003+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:04.165 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:04.159+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:04.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:04.729+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:05.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:05.007+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4ff1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:05.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:05.007+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48de20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:06.015 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:06.007+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fdea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:06.016 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:06.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48d8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:06.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:06.241+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:07.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:07.011+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fdf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:07.019 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:07.011+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a7e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:07.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:07.493+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:08.022 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:08.015+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:08.023 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:08.015+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:08.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:08.725+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:09.025 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:09.019+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:09.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:09.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:09.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:09.435+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:09.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:41:09.467+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:10.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:10.019+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48df00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:10.027 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:10.019+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fdf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:10.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:10.129+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:11.028 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:11.023+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:11.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:11.023+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:11.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:11.393+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:12.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:12.063+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a8c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:12.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:12.063+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:12.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:12.785+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:13.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:13.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:13.073 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:13.067+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48aa10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:14.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:14.067+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:14.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:14.067+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a9a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:14.146 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:14.137+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110736 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:14.714 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:14.707+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:15.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:15.071+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:15.078 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:15.071+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48aaf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:15.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:15.445+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:16.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:16.075+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d4fe300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:16.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:16.075+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48aa80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:16.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:16.933+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:17.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:17.079+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48abd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:17.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:17.079+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de381c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:18.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:18.078+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:18.086 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:18.078+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48ab60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:18.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:18.405+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110840 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:19.089 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:19.082+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de380e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:19.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:19.082+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48acb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:19.822 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:19.817+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:19.941 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:19.930+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:20.096 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:20.090+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48ac40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:20.097 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:20.090+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:21.106 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:21.090+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48df70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:21.107 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:21.094+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:21.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:21.201+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:22.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:22.094+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48ad20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:22.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:22.094+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:22.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:22.489+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110920 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:23.103 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:23.098+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48ae00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:23.104 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:23.098+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b274ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:23.655 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:23.649+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:24.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:24.102+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:24.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:24.102+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48ad90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:24.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:24.937+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 110973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:24.960 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:24.954+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:25.109 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:25.102+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd92840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:25.110 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:25.102+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:26.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:26.106+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48ae70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:26.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:26.106+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd91ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:26.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:26.245+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:27.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:27.218+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48af50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:27.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:27.214+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd90f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:27.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:27.633+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:28.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:28.218+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074cd925a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:28.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:28.222+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48aee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:28.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:28.869+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:29.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:29.346+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:29.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:29.346+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074b58d5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:29.963 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:29.954+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:30.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:30.133+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:30.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:30.350+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:30.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:30.350+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:31.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:31.277+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:31.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:31.354+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:31.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:31.354+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:32.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:32.354+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:32.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:32.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:32.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:32.585+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:33.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:33.358+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:33.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:33.358+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:33.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:33.801+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:34.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:34.362+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:34.368 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:34.362+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48afc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:34.979 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:34.966+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:35.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:35.137+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:35.370 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:35.362+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:35.371 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:35.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48dcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:36.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:36.356+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111254 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:36.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:36.366+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd888b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:36.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:36.366+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:37.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:37.370+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:37.378 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:37.370+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:37.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:37.552+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:38.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:38.374+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd887d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:38.381 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:38.374+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:38.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:38.812+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:39.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:39.378+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:39.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:39.378+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:39.477 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:41:39.466+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:39.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:39.978+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:40.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:40.092+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:40.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:40.382+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd885a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:40.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:40.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:41.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:41.382+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48b180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:41.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:41.382+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:41.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:41.444+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:42.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:42.526+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631fa48a460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:42.532 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:42.526+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd879d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:42.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:42.672+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:43.536 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:43.530+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:43.537 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:43.530+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:43.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:43.892+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:44.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:44.530+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbb650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:44.538 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:44.530+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:44.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:44.978+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:45.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:45.104+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:45.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:45.542+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:45.549 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:45.542+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dbd100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:46.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:46.388+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:46.551 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:46.542+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd871f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:46.552 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:46.546+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:47.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:47.546+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:47.556 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:47.550+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:47.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:47.736+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:48.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:48.550+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:48.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:48.554+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd875e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:49.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:49.020+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:49.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:49.554+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:49.561 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:49.554+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd873b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:49.989 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:49.982+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:50.250 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:50.244+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:50.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:50.558+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:50.566 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:50.558+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd872d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:51.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:51.484+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111621 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:51.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:51.558+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:51.568 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:51.562+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd877a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:52.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:52.562+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:52.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:52.562+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd876c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:52.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:52.756+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:53.572 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:53.566+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:53.573 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:53.566+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:53.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:53.992+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111815 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:54.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:54.570+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:54.576 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:54.570+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:55.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:41:55.302+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:55.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:55.360+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111845 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:55.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:55.570+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:55.578 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:55.570+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:56.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:56.573+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:56.583 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:56.573+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:56.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:56.584+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111872 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:57.621 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:57.601+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:57.741 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:57.729+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:57.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:57.796+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:58.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:58.605+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:58.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:58.733+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:59.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:41:59.096+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111928 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:41:59.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:41:59.605+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:41:59.749 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:41:59.733+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:00.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:00.301+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:00.412 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:00.404+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:00.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:00.609+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:00.747 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:00.737+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:01.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:01.608+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 111979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:01.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:01.613+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:01.748 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:01.741+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:02.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:02.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:02.753 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:02.741+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd893a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:02.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:02.900+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:03.629 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:03.617+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:03.754 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:03.745+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:04.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:04.136+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:04.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:04.621+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:04.756 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:04.749+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd892c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:05.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:05.364+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:05.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:05.473+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:05.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:05.625+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:05.758 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:05.749+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd891e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:06.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:06.629+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:06.639 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:06.632+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:06.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:06.753+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:07.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:07.629+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:07.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:07.757+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:07.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:07.828+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:08.640 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:08.633+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:08.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:08.761+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:09.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:09.236+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:09.564 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:42:09.541+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:09.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:09.637+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:09.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:09.765+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:10.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:10.489+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:10.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:10.504+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:10.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:10.637+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:10.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:10.765+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:11.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:11.641+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999ba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:11.731 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:11.724+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:11.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:11.769+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:12.709 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:12.697+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:12.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:12.777+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:13.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:13.000+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:13.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:13.701+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999b9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:13.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:13.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:14.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:14.300+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:14.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:14.709+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:14.937 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:14.781+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:15.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:15.497+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:15.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:15.648+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112288 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:15.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:15.713+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:15.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:15.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:16.718 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:16.713+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:16.790 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:16.785+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:16.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:16.908+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:17.721 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:17.717+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:17.793 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:17.789+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:18.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:18.248+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:18.724 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:18.721+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999ca70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:18.795 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:18.793+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd895d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:19.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:19.484+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112379 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:19.726 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:19.721+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:19.805 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:19.793+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:20.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:20.517+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:20.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:20.720+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:20.728 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:20.725+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bb90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:20.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:20.797+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:21.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:21.725+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:21.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:21.801+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:22.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:22.099+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:22.845 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:22.841+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:22.957 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:22.841+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:23.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:23.359+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112463 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:23.849 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:23.845+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:23.850 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:23.845+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0132c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:24.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:24.547+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:24.852 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:24.849+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:24.853 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:24.849+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:25.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:25.517+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:25.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:25.715+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:25.857 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:25.853+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bdc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:26.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:26.053+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:26.859 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:26.857+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999be30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:26.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:26.991+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:27.059 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:27.053+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:27.861 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:27.857+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:28.061 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:28.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:28.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:28.291+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:28.864 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:28.861+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:29.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:29.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:29.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:29.527+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:29.869 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:29.865+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:30.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:30.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:30.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:30.537+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:30.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:30.863+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:30.872 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:30.869+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999bff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:31.069 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:31.065+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:31.874 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:31.869+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:32.072 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:32.069+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:32.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:32.223+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112661 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:32.962 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:32.957+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:33.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:33.073+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:33.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:33.651+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112695 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:33.964 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:33.961+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:34.079 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:34.073+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:34.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:34.907+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:34.966 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:34.960+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:35.081 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:35.076+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0135d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:35.541 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:35.536+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:35.981 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:35.964+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:36.083 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:36.076+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:36.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:36.171+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:36.979 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:36.968+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:37.088 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:37.080+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:37.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:37.435+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112775 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:38.113 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:38.108+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:38.114 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:38.108+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0100e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:38.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:38.731+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112801 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:39.117 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:39.112+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:39.118 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:39.112+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:39.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:42:39.552+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:40.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:40.116+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:40.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:40.116+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0111f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:40.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:40.203+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112836 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:40.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:40.752+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:41.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:41.116+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0125a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:41.127 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:41.120+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:41.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:41.691+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:42.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:42.120+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:42.126 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:42.120+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:43.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:43.063+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:43.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:43.124+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0138e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:43.130 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:43.124+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:44.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:44.128+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:44.132 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:44.128+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:44.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:44.367+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:45.134 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:45.128+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999c5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:45.135 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:45.128+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:45.755 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:45.747+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:45.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:45.752+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:46.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:46.132+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999de20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:46.137 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:46.132+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:47.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:47.015+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 112988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:47.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:47.136+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999de90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:47.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:47.136+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0120d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:48.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:48.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:48.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:48.224+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999dd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:48.401 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:48.387+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:49.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:49.228+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999dc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:49.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:49.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:49.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:49.563+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:50.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:50.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999ddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:50.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:50.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:50.787 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:50.784+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:51.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:51.039+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113072 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:51.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:51.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:51.240 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:51.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999dcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:52.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:52.236+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999db80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:52.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:52.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:52.348 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:52.335+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113100 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:53.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:53.404+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999daa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:53.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:53.404+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:53.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:53.591+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:54.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:54.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:54.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:54.408+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0131e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:54.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:54.871+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:55.414 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:55.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999df00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:55.415 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:55.412+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:55.862 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:42:55.856+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:56.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:56.143+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:56.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:56.412+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999dbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:56.417 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:56.412+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0126f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:57.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:57.335+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:57.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:57.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:57.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:57.416+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:58.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:58.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a0e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:58.424 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:58.420+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0127d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:58.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:58.519+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:42:59.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:42:59.420+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999db10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:59.426 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:42:59.420+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0124c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:42:59.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:42:59.811+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:00.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:00.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d8e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:00.428 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:00.424+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:01.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:01.095+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:01.191 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:01.188+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:01.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:01.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999df70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:01.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:01.424+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:02.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:02.307+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:02.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:02.428+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999da30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:02.436 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:02.428+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0128b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:03.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:03.503+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:04.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:04.160+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:04.172 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:04.160+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a1c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:04.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:04.783+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:05.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:05.160+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:05.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:05.164+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:06.168 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:06.164+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:06.170 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:06.164+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:06.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:06.308+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:06.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:06.442+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:07.171 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:07.164+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:07.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:07.168+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:07.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:07.642+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:08.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:08.168+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:08.177 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:08.172+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:08.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:08.906+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:09.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:09.220+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a2a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:09.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:09.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0133a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:09.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:43:09.580+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:10.223 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:10.214+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:10.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:10.224+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:10.230 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:10.224+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:11.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:11.228+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:11.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:11.228+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:11.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:11.490+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113544 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:11.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:11.504+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:12.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:12.232+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:12.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:12.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:12.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:12.914+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:13.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:13.232+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:13.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:13.236+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0101c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:14.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:14.174+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:14.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:14.239+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:14.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:14.239+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:15.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:15.239+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:15.252 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:15.243+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c7858f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:15.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:15.414+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:16.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:16.243+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:16.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:16.243+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c784000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:16.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:16.547+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:16.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:16.646+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:17.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:17.247+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999d480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:17.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:17.247+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c787090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:17.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:17.966+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:18.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:18.247+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:18.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:18.251+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c785810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:19.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:19.258+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:19.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:19.303+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:19.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:19.303+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074c785a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:20.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:20.307+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0136b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:20.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:20.307+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a3f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:20.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:20.490+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:21.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:21.311+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:21.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:21.311+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:21.556 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:21.547+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:21.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:21.702+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:22.320 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:22.311+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0112d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:22.320 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:22.311+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a4d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:23.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:23.034+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113816 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:23.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:23.315+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:23.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:23.315+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:24.434 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:24.430+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:25.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:25.159+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:25.166 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:25.159+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a5b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:25.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:25.702+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:26.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:26.163+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:26.169 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:26.163+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f999a700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:26.995 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:26.991+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:27.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:27.163+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0134f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:27.173 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:27.167+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:27.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:27.190+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:28.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:28.167+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:28.174 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:28.167+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:28.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:28.450+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:29.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:29.171+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:29.178 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:29.171+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:29.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:29.746+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:30.221 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:30.215+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0119d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:30.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:30.215+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f360e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:30.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:30.954+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 113998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:31.223 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:31.219+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:31.225 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:31.219+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:31.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:31.991+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:32.184 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:32.178+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:32.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:32.219+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:32.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:32.223+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:33.228 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:33.223+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:33.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:33.227+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:33.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:33.474+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:34.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:34.227+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:34.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:34.227+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f380d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:35.253 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:35.247+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:35.253 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:35.247+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:35.301 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:35.294+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114080 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:36.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:36.247+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:36.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:36.251+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:36.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:36.722+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:37.018 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:37.011+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:37.258 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:37.251+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:37.260 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:37.255+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:37.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:37.994+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:38.263 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:38.255+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0123e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:38.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:38.255+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:39.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:39.255+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0121b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:39.264 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:39.259+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:39.273 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:39.270+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:39.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:43:39.599+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:40.265 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:40.259+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:40.276 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:40.263+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:40.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:40.470+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:41.268 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:41.263+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:41.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:41.263+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:41.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:41.810+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:42.028 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:42.023+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:42.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:42.263+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:42.273 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:42.267+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:43.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:43.110+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:43.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:43.267+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:43.275 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:43.271+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:44.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:44.267+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:44.277 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:44.271+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:44.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:44.410+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:45.277 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:45.271+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:45.280 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:45.275+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:45.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:45.630+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:46.280 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:46.275+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0113b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:46.283 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:46.279+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:46.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:46.986+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:47.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:47.023+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:47.284 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:47.275+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:47.288 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:47.279+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f39bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:48.287 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:48.279+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:48.293 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:48.283+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f381b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:48.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:48.350+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:49.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:49.283+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:49.294 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:49.283+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f385a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:49.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:49.778+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:50.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:50.311+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0139c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:50.316 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:50.311+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:51.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:51.146+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:51.318 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:51.311+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:51.318 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:51.311+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:52.158 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:52.150+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:52.321 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:52.314+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:52.321 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:52.314+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:52.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:52.361+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114468 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:53.323 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:53.314+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:53.326 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:53.318+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:53.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:53.585+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:54.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:54.318+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:54.327 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:54.318+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f36770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:54.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:54.873+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:55.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:55.446+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:55.461 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:55.454+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:56.075 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:56.061+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:56.457 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:56.450+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9f38df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:56.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:56.458+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:57.167 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:43:57.158+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:57.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:57.325+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:57.459 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:57.454+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcde20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:57.467 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:57.458+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:58.465 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:58.454+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcdd40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:58.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:58.462+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:58.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:58.577+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114621 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:43:59.464 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:43:59.458+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcbff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:59.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:43:59.462+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:43:59.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:43:59.949+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:00.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:00.622+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:00.631 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:00.626+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:01.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:01.261+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114689 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:01.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:01.626+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:01.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:01.626+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb6c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:02.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:02.194+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:02.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:02.621+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:02.636 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:02.630+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:02.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:02.630+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:03.638 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:03.630+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:03.639 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:03.634+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc8b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:03.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:03.893+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114757 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:04.641 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:04.634+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:04.643 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:04.638+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:05.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:05.133+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:05.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:05.634+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:05.646 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:05.638+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:06.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:06.405+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:06.645 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:06.638+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:06.648 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:06.642+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:07.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:07.254+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:07.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:07.642+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd868c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:07.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:07.714+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:07.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:07.721+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:08.657 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:08.650+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd869a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:08.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:08.718+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcdcd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:08.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:08.933+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114880 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:09.653 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:44:09.646+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:09.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:09.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:09.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:09.718+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcca70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:10.235 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:10.229+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:10.662 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:10.654+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:10.729 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:10.722+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcca00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:11.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:11.569+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:11.664 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:11.658+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:11.734 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:11.726+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcdc60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:12.260 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:12.254+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:12.667 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:12.658+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:12.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:12.734+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:12.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:12.893+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114952 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:13.669 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:13.662+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:13.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:13.734+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:14.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:14.169+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 114979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:14.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:14.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:14.746 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:14.738+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:15.473 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:15.469+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:15.705 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:15.698+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:15.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:15.922+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:16.708 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:16.702+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:16.932 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:16.926+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:16.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:16.973+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115024 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:17.453 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:17.446+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:17.714 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:17.702+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:17.934 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:17.926+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb3b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:18.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:18.253+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:18.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:18.706+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:18.936 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:18.930+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:19.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:19.529+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115080 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:19.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:19.710+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd870a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:19.939 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:19.934+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb2d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:20.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:20.693+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:20.719 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:20.714+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:20.942 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:20.934+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcdbf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:21.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:21.714+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:21.944 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:21.938+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dccae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:22.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:22.329+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:22.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:22.522+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:22.724 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:22.718+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:22.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:22.942+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb0a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:23.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:23.621+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:23.727 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:23.718+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:23.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:23.942+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb1f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:24.731 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:24.722+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:24.953 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:24.946+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcafc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:25.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:25.037+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:25.732 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:25.726+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:25.956 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:25.950+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:26.354 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:26.349+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:26.735 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:26.730+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:26.960 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:26.950+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:27.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:27.526+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:27.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:27.573+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:27.738 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:27.730+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:27.961 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:27.954+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcaee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:28.740 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:28.734+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:28.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:28.837+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:28.964 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:28.958+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcde90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:29.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:29.734+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:29.967 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:29.958+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcae00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:30.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:30.113+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:30.841 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:30.833+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:30.973 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:30.961+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcaf50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:31.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:31.381+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115339 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:31.842 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:31.833+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd887d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:31.970 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:31.961+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcad20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:32.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:32.761+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:32.777 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:32.765+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:32.968 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:32.961+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:32.972 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:32.965+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd5d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:33.971 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:33.965+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd885a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:33.976 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:33.969+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcac40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:34.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:34.085+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:34.974 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:34.965+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:34.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:34.969+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcae70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:35.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:35.405+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:35.977 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:35.969+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:35.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:35.973+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:36.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:36.776+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:36.980 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:36.973+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:36.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:36.973+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcad90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:37.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:37.889+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:37.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:37.977+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:37.984 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:37.977+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcddb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:38.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:38.088+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:38.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:38.981+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:38.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:38.977+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd871f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:39.318 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:39.304+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:39.654 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:44:39.645+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:39.988 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:39.981+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:39.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:39.981+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcab60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:40.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:40.760+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:41.138 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:41.129+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd873b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:41.141 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:41.133+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:42.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:42.080+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:42.140 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:42.133+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd872d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:42.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:42.141+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:42.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:42.889+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:43.142 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:43.133+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd877a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:43.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:43.141+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:43.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:43.312+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:44.144 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:44.137+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd876c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:44.152 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:44.145+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcbf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:44.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:44.652+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:45.147 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:45.137+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:45.155 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:45.145+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:45.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:45.884+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:46.150 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:46.145+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:46.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:46.153+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd4f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:47.151 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:47.149+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:47.158 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:47.153+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:47.268 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:47.260+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:47.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:47.981+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:48.157 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:48.149+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:48.164 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:48.161+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:48.635 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:48.628+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115744 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:49.156 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:49.153+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:49.167 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:49.165+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:50.146 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:50.140+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115776 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:50.158 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:50.153+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:50.181 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:50.165+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:51.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:51.221+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:51.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:51.221+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:51.639 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:51.632+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:52.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:52.225+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:52.237 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:52.225+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd893a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:52.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:52.896+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:53.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:53.065+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:53.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:53.229+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:53.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:53.357+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:54.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:54.229+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd892c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:54.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:54.252+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115874 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:54.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:54.361+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:55.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:55.233+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:55.366 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:55.361+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:55.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:55.544+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:56.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:56.237+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:56.371 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:56.369+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:56.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:56.872+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:57.243 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:57.241+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:57.374 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:57.369+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc6f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:58.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:58.172+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:44:58.245 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:58.241+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:58.257 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:44:58.253+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:58.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:58.373+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcdb80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:59.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:44:59.245+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:59.380 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:44:59.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:44:59.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:44:59.628+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 115987 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:00.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:00.245+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:00.382 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:00.377+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:00.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:00.972+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:01.251 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:01.249+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:01.384 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:01.381+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:02.253 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:02.249+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:02.387 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:02.385+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc5a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:02.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:02.472+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:03.255 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:03.249+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:03.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:03.381+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:03.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:03.385+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc4c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:04.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:04.200+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:04.257 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:04.253+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:04.393 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:04.389+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:05.261 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:05.257+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd895d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:05.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:05.393+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:05.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:05.776+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:06.262 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:06.257+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:06.398 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:06.393+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc3e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:07.265 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:07.261+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de380e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:07.400 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:07.397+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:07.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:07.488+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:08.267 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:08.265+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:08.399 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:08.381+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:08.566 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:08.401+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:08.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:08.748+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:09.270 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:09.264+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de381c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:09.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:09.400+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:09.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:45:09.700+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:10.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:10.032+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:10.272 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:10.268+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:10.408 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:10.404+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:11.274 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:11.268+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:11.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:11.376+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:11.412 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:11.404+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:12.277 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:12.272+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:12.413 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:12.408+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb5e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:12.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:12.672+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116283 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:13.280 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:13.276+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3a7d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:13.416 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:13.412+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcdaa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:13.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:13.568+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:14.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:14.112+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:14.281 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:14.276+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de3abc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:14.418 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:14.412+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:15.284 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:15.280+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de395e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:15.421 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:15.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcda30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:15.428 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:15.420+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116356 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:16.296 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:16.284+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de38f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:16.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:16.416+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd9c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:16.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:16.676+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:17.293 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:17.288+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de39810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:17.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:17.420+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcb650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:17.981 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:17.972+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:18.295 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:18.292+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074de397a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:18.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:18.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:18.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:18.608+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:19.251 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:19.244+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:19.298 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:19.292+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:19.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:19.424+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:20.301 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:20.296+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd868c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:20.432 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:20.428+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd6b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:20.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:20.560+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:21.303 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:21.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd869a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:21.434 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:21.428+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9dcd870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:21.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:21.899+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116495 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:22.311 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:22.300+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:22.438 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:22.432+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:23.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:23.115+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:23.308 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:23.304+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:23.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:23.436+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db9d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:23.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:23.768+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:24.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:24.283+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:24.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:24.304+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:24.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:24.440+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbd50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:25.313 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:25.308+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:25.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:25.440+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:25.539 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:25.531+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:26.315 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:26.312+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:26.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:26.444+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:26.856 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:26.847+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116621 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:27.317 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:27.312+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:27.451 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:27.448+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbf80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:28.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:28.187+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:28.321 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:28.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:28.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:28.448+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbc00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:28.773 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:28.768+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:29.322 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:29.316+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:29.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:29.375+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116682 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:29.456 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:29.452+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:30.325 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:30.320+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd870a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:30.458 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:30.452+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd3a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:30.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:30.671+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:31.333 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:31.320+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd86f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:31.460 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:31.456+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:31.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:31.987+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:32.329 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:32.324+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd87490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:32.463 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:32.460+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db8f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:33.331 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:33.328+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:33.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:33.351+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:33.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:33.460+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:33.800 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:33.796+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:34.334 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:34.328+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89aa0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:34.469 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:34.464+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbf10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:35.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:34.995+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:35.336 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:35.332+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:35.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:35.468+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbb20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:36.338 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:36.332+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd89090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:36.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:36.371+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:36.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:36.472+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcdf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:37.341 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:37.336+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:37.480 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:37.476+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbb90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:37.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:37.595+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:38.346 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:38.340+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074bd88f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:38.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:38.476+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dce60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:38.810 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:38.804+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:38.969 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:38.959+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:39.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:39.340+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0132c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:39.484 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:39.480+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbc70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:39.775 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:45:39.772+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:40.244 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:40.235+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:40.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:40.344+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:40.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:40.480+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcfb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:41.351 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:41.348+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:41.478 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:41.471+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:41.489 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:41.484+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:42.353 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:42.348+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:42.491 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:42.488+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:42.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:42.879+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:43.356 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:43.352+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:43.495 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:43.488+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:43.811 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:43.808+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:44.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:44.131+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 116994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:44.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:44.352+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:44.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:44.492+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94db810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:45.365 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:45.356+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:45.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:45.383+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:45.501 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:45.496+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:46.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:46.360+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:46.504 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:46.500+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:46.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:46.655+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117051 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:47.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:47.359+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:47.508 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:47.503+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:47.984 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:47.975+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:48.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:48.363+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0135d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:48.511 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:48.503+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:48.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:48.903+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:49.372 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:49.367+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:49.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:49.439+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117112 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:49.514 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:49.507+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:50.377 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:50.367+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0100e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:50.516 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:50.511+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd1e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:50.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:50.855+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:51.376 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:51.371+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013950 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:51.519 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:51.511+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd330 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:52.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:52.183+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:52.379 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:52.371+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0111f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:52.521 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:52.515+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd2c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:53.385 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:53.375+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0125a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:53.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:53.455+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:53.529 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:53.519+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:53.949 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:53.943+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:54.383 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:54.379+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:54.533 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:54.523+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dd410 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:54.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:54.803+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:55.390 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:55.379+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013870 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:55.531 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:55.527+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc0d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:56.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:56.079+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:56.388 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:56.383+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:56.534 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:56.527+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbe30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:57.395 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:57.387+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:57.539 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:57.531+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:57.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:57.607+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:58.397 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:58.391+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0120d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:58.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:58.535+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc1b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:58.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:45:58.931+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:45:59.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:45:59.155+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:59.399 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:45:59.395+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:45:59.553 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:45:59.539+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:00.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:00.367+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:00.401 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:00.395+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013100 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:00.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:00.539+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dca00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:01.404 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:01.399+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:01.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:01.543+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:01.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:01.559+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:02.406 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:02.399+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:02.557 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:02.543+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dc300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:02.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:02.807+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:03.409 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:03.403+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010a80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:03.553 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:03.547+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dbdc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:04.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:04.047+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:04.414 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:04.407+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0131e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:04.556 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:04.551+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f94dcbc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:04.757 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:04.751+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:05.408 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:05.398+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117487 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:05.414 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:05.407+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0126f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:05.559 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:05.555+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:06.416 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:06.411+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:06.562 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:06.555+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:06.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:06.646+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:07.420 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:07.415+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0127d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:07.564 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:07.559+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:08.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:08.114+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:08.422 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:08.415+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0124c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:08.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:08.559+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:09.425 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:09.419+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:09.473 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:09.462+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:09.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:09.563+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6700 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:09.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:46:09.931+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:09.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:09.931+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:10.427 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:10.423+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0128b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:10.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:10.567+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db65b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:10.788 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:10.778+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:11.430 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:11.423+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:11.575 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:11.567+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:12.433 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:12.427+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:12.440 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:12.430+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:12.577 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:12.571+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:13.435 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:13.427+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:13.580 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:13.575+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:13.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:13.982+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:14.437 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:14.431+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:14.589 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:14.575+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db64d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:14.937 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:14.931+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:15.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:15.338+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:15.439 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:15.435+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0133a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:15.585 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:15.579+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:16.441 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:16.435+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:16.588 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:16.583+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:16.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:16.770+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:17.443 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:17.439+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013c60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:17.590 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:17.583+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:18.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:18.046+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:18.446 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:18.439+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:18.592 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:18.587+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:19.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:19.362+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:19.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:19.443+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0101c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:19.595 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:19.587+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:20.129 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:20.123+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:20.472 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:20.467+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0136b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:20.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:20.591+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:20.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:20.802+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:21.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:21.471+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:21.617 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:21.611+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:22.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:22.038+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117845 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:22.477 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:22.471+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0112d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:22.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:22.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db63f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:23.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:23.202+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117872 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:23.480 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:23.475+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010fc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:23.622 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:23.615+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db9090 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:24.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:24.475+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012d80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:24.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:24.550+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117908 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:24.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:24.619+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db62a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:25.180 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:25.170+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:25.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:25.478+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0134f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:25.628 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:25.622+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6460 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:25.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:25.814+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:26.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:26.478+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013560 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:26.630 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:26.622+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:27.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:27.166+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:27.488 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:27.482+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012ca0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:27.633 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:27.626+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:28.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:28.454+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 117992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:28.490 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:28.482+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0119d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:28.635 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:28.630+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db61c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:29.492 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:29.486+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013b80 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:29.637 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:29.630+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db9bf0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:29.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:29.738+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118028 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:30.255 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:30.246+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:30.494 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:30.486+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013b10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:30.642 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:30.634+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db92c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:31.051 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:31.046+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:31.497 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:31.490+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:31.644 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:31.638+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:32.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:32.266+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:32.500 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:32.494+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:32.647 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:32.642+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db73b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:33.503 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:33.498+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011260 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:33.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:33.578+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:33.649 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:33.642+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:34.505 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:34.498+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012b50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:34.652 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:34.646+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:34.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:34.882+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118152 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:35.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:35.490+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:35.545 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:35.538+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0121b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:35.655 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:35.650+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7b90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:36.387 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:36.382+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:36.548 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:36.542+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:36.658 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:36.650+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:37.550 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:37.542+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012370 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:37.660 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:37.654+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:37.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:37.682+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:38.553 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:38.546+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010070 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:38.663 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:38.654+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6000 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:39.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:39.034+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:39.555 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:39.550+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012060 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:39.666 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:39.658+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:40.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.smithi177.stderr:2019-12-16T23:46:40.150+0000 7f00f7086700 -1 rbd::mirror::PoolReplayer: 0x55cb4ebee000 list_mirroring_namespaces: failed to list namespaces: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:40.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:40.482+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:40.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:40.662+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:40.671 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:40.662+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db78f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:40.673 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:40.666+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:41.672 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:41.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0113b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:41.673 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:41.666+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7a40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:41.922 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:41.918+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:42.674 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:42.666+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:42.675 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:42.670+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7960 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:43.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:43.134+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:43.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:43.670+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:43.678 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:43.670+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:44.505 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:44.498+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:44.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:44.674+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012d10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:44.682 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:44.674+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7880 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:45.676 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:45.670+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:45.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:45.674+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013db0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:45.688 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:45.678+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db6e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:45.754 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:45.750+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:46.686 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:46.678+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013a30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:46.687 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:46.682+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7e30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:46.960 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:46.954+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:47.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:47.682+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011d50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:47.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:47.682+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:48.283 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:48.274+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:48.695 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:48.686+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011dc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:48.789 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:48.782+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8a70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:49.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:49.546+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:49.693 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:49.686+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013e90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:49.792 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:49.786+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8bc0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:50.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:50.682+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:50.699 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:50.690+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:50.794 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:50.786+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8ae0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:50.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:50.853+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:51.698 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:51.690+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:51.796 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:51.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8990 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:52.397 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:52.389+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:52.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:52.702+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011f10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:52.799 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:52.790+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db88b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:53.710 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:53.702+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ff0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:53.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:53.794+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8a00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:53.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:53.825+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:54.713 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:54.706+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010310 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:54.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:54.798+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8920 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:55.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:55.585+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:55.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:46:55.682+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:55.716 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:55.710+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012f40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:55.807 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:55.802+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db9480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:56.723 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:56.710+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:56.819 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:56.802+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db87d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:57.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:57.069+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:57.720 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:57.714+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0139c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:57.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:57.806+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:58.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:58.373+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118669 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:58.722 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:58.714+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013020 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:58.815 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:58.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db86f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:59.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:46:59.621+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:46:59.725 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:46:59.718+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010af0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:46:59.818 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:46:59.810+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:00.798 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:00.790+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010a10 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:00.820 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:00.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:01.131 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:01.122+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:01.216 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:01.209+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118720 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:01.801 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:01.794+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0108c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:01.822 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:01.814+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8df0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:02.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:02.505+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:02.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:02.798+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010930 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:02.829 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:02.818+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db9720 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:03.806 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:03.797+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0107e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:03.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:03.821+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118780 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:03.827 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:03.817+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8e60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:04.808 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:04.801+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010850 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:04.828 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:04.821+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7420 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:05.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:05.081+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:05.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:05.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010770 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:05.943 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:05.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:06.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:06.429+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:06.945 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:06.937+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010620 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:06.947 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:06.937+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:07.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:07.681+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:07.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:07.941+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010690 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:07.949 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:07.941+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8530 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:08.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:08.945+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db9250 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:08.952 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:08.945+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010540 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:09.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:09.021+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:09.954 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:09.945+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7500 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:10.053 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:10.045+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0105b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:10.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:10.265+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:10.991 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:10.981+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db91e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:11.055 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:11.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0104d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:11.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:11.441+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:11.994 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:11.985+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db93a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:12.057 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:12.049+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010380 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:12.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:12.673+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 118986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:12.997 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:12.989+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:13.060 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:13.053+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0103f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:13.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:13.917+0000 7f6702f62700 -1 osd.2 106 get_health_metrics reporting 119016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:14.000 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:13.993+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db7ea0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:14.063 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:14.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0102a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:15.002 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:14.993+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db95d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:15.066 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:15.057+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0117a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:15.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:15.861+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:16.004 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:15.997+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8450 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:16.068 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:16.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013d40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:17.006 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:16.997+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db81b0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:17.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:17.065+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119083 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:17.071 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:17.061+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0115e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:18.009 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:18.001+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:18.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:18.065+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012c30 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:18.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:18.261+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:19.011 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:19.009+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db80d0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:19.075 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:19.073+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011570 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:19.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:19.529+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119140 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:20.014 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:20.009+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:20.077 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:20.073+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:20.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:20.993+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:21.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:21.197+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db8140 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:21.203 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:21.197+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012ed0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:22.207 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:22.201+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f9db85a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:22.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:22.201+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ce0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:22.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:22.281+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:23.151 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:23.149+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:23.208 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:23.205+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787a150 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:23.209 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:23.205+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013f00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:23.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:23.989+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:24.211 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:24.205+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787b650 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:24.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:24.209+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013f70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:25.216 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:25.213+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012220 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:25.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:25.353+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119248 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:25.480 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:25.473+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787b7a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:26.218 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:26.213+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011ab0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:26.478 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:26.473+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787b810 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:26.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:26.545+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:27.220 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:27.217+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013790 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:27.481 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:27.477+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787ba40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:27.954 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:27.949+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:28.222 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:28.217+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010e70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:28.277 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:28.273+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:28.483 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:28.481+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787c760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:29.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:29.161+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:29.226 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:29.221+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010d90 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:29.485 INFO:tasks.rbd_mirror.cluster2.client.mirror.3.smithi177.stderr:2019-12-16T23:47:29.481+0000 7fbffaed5700 -1 rbd::mirror::image_map::UpdateRequest: 0x5631f787d170 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:30.227 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:30.225+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011730 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:30.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:30.509+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:31.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:31.225+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010e00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:32.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:31.993+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:32.232 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:32.229+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0118f0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:33.234 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:33.229+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010bd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:33.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:33.285+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:33.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:33.393+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:34.235 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:34.233+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010f50 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:34.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:34.812+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:35.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:35.233+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0110a0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:36.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:36.156+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:36.347 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:36.337+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010cb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:37.346 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:37.341+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010230 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:37.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:37.656+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:38.348 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:38.345+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011490 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:38.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:38.928+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:38.984 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:38.981+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:39.350 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:39.345+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012610 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:40.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:40.172+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:40.354 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:40.349+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013e20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:41.563 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:41.556+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012290 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:42.565 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:42.560+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011c70 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:42.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:42.636+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:43.567 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:43.564+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010d20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:43.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:43.972+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119795 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:44.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:44.564+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011030 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:44.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:44.908+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:45.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:45.472+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:45.571 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:45.568+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011340 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:46.592 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:46.584+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012840 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:46.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:46.944+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 119902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:47.593 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:47.588+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012300 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:48.595 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:48.592+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013cd0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:49.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:49.592+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e010b60 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:50.599 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:50.592+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013480 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:51.605 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:51.596+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0123e0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:52.602 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:52.596+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e0132c0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:53.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:53.600+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012fb0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:54.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:54.576+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:54.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:54.600+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011c00 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:54.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:54.736+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:55.608 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:55.604+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e011b20 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:56.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:56.732+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012760 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:57.742 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:57.736+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013800 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:58.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:58.180+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:58.743 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:58.740+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e012680 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:59.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:47:59.360+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:47:59.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:47:59.576+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:47:59.745 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:47:59.740+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074e013640 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:00.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:00.528+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:00.748 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:48:00.744+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d348c40 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:01.846 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:01.840+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:01.892 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:48:01.888+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d349180 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:02.896 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:48:02.892+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d348ee0 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:03.167 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:03.160+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120479 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:03.899 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.smithi177.stderr:2019-12-16T23:48:03.892+0000 7f06ed300700 -1 rbd::mirror::image_map::UpdateRequest: 0x56074d349110 handle_update_image_map: failed to update image map: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:04.440 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:04.432+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:04.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:04.592+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:05.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:05.676+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:07.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:07.016+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:08.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:08.236+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:09.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:09.440+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120700 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:09.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:09.592+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:10.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:10.680+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:11.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:11.956+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:13.216 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:13.208+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120836 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:14.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:14.408+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:14.603 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:14.600+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:15.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:15.588+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:16.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:16.828+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 120963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:17.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:17.987+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121008 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:19.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:19.267+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:19.608 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:19.603+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:20.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:20.439+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:21.788 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:21.779+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:23.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:23.075+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:24.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:24.415+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:24.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:24.611+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:25.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:25.615+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:27.009 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:26.999+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:28.222 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:28.215+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:29.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:29.367+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:29.627 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:29.615+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:30.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:30.507+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:32.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:32.003+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:33.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:33.267+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121480 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:34.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:34.627+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:34.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:34.655+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:36.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:36.011+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:37.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:37.335+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:38.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:38.631+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:39.634 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:39.627+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:40.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:40.079+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:41.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:41.371+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:42.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:42.643+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:43.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:43.811+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:44.679 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:44.675+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:45.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:45.067+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:46.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:46.439+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:47.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:47.771+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:49.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:49.047+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:49.691 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:49.687+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:50.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:50.319+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121815 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:51.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:51.607+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:52.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:52.911+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:54.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:54.187+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:54.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:54.687+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:48:55.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:55.563+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121928 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:56.846 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:56.839+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:58.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:58.203+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 121978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:59.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:48:59.491+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:48:59.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:48:59.686+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:00.837 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:00.831+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:02.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:02.186+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122051 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:03.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:03.466+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122083 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:04.693 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:04.686+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:04.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:04.718+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:06.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:06.010+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:07.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:07.358+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:08.731 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:08.722+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:09.749 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:09.742+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:09.970 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:09.962+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:11.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:11.270+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:12.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:12.638+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:13.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:13.830+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122302 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:14.750 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:14.742+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:15.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:15.066+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:16.247 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:16.242+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:17.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:17.546+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:18.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:18.778+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:19.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:19.746+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:20.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:20.006+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:21.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:21.258+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122456 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:22.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:22.674+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:23.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:23.942+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122515 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:24.764 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:24.750+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:25.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:25.162+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:26.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:26.442+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:27.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:27.678+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:29.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:29.034+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:29.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:29.750+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:30.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:30.270+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:31.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:31.558+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:32.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:32.958+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:34.372 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:34.366+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:34.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:34.750+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:35.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:35.622+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:36.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:36.982+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:38.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:38.302+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:39.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:39.594+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:39.759 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:39.753+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:40.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:40.754+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:42.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:42.046+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:43.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:43.326+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122924 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:44.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:44.678+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122952 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:44.795 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:44.785+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:46.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:46.013+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 122977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:47.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:47.337+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123008 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:48.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:48.557+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:49.813 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:49.805+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:49.823 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:49.817+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:51.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:51.097+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:52.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:52.413+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:53.660 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:53.653+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123128 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:54.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:49:54.813+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:49:54.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:54.961+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:56.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:56.293+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:58.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:57.997+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:49:58.622 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:49:58.617+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-16T23:49:58.622 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:49:58.617+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-16T23:49:58.622 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:49:58.617+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-16T23:49:59.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:49:59.365+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:00.051 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:00.045+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:00.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:00.585+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:01.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:01.933+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:03.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:03.117+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:04.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:04.501+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:05.080 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:05.077+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:05.788 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:05.781+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:06.681 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:50:06.677+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-16T23:50:06.681 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:50:06.677+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-16T23:50:06.681 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:50:06.677+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-16T23:50:07.127 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:07.121+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:08.386 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:08.377+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:09.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:09.557+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123455 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:10.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:10.097+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:10.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:10.801+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123480 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:12.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:12.041+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123507 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:13.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:13.321+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:14.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:14.541+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:15.102 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:15.096+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:15.823 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:15.813+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:17.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:17.013+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:18.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:18.285+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123644 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:19.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:19.525+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:20.103 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:20.100+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:20.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:20.781+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:21.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:21.973+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123723 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:23.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:23.157+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:24.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:24.305+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:25.104 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:25.100+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:25.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:25.513+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:26.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:26.685+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:28.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:27.997+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:29.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:29.620+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:30.120 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:30.116+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:30.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:30.844+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123903 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:32.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:32.112+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:33.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:33.416+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:34.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:34.716+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 123984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:35.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:35.132+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:36.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:36.024+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:37.236 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:37.228+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:38.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:38.424+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:39.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:39.620+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:40.136 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:40.132+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:40.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:40.740+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:41.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:41.940+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:43.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:43.204+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:44.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:44.384+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124165 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:45.137 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:45.132+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:45.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:45.544+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:46.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:46.888+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:48.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:48.140+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:49.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:49.556+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:50.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:50.132+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:50.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:50.860+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:52.254 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:52.244+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:53.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:53.516+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:54.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:54.772+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:55.197 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:50:55.191+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:50:56.074 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:56.068+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:57.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:57.336+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:58.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:58.680+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:50:59.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:50:59.988+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124447 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:00.276 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:00.271+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:01.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:01.368+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:02.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:02.636+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:03.918 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:03.908+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:05.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:05.232+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124549 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:05.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:05.323+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:06.484 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:06.476+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:07.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:07.976+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:09.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:09.252+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:10.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:10.371+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:10.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:10.492+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:11.762 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:11.752+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:13.139 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:13.127+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:14.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:14.447+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:15.376 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:15.371+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:15.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:15.751+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:17.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:17.087+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124775 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:18.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:18.391+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:19.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:19.659+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:20.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:20.391+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:20.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:20.943+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:22.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:22.311+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:23.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:23.619+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:25.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:25.151+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:25.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:25.391+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:26.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:26.555+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:27.799 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:27.791+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 124994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:29.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:29.155+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:30.401 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:30.390+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:30.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:30.519+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:31.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:31.735+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:33.036 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:33.027+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:34.273 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:34.263+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125118 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:35.420 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:35.414+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:35.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:35.635+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:36.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:36.939+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:38.258 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:38.251+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:39.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:39.555+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:40.421 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:40.414+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:40.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:40.851+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:42.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:42.179+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:43.480 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:51:43.458+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-16T23:51:43.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:43.615+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:44.906 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:44.899+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:45.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:45.486+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:46.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:46.243+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:47.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:47.559+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125379 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:48.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:48.851+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:50.149 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:50.139+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:50.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:50.510+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:50.521 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:51:50.514+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-16T23:51:50.521 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:51:50.514+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-16T23:51:51.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:51.387+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125456 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:52.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:52.603+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:53.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:53.911+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:55.151 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:55.143+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:55.529 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:51:55.522+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:51:56.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:56.430+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:57.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:57.698+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:51:59.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:51:59.030+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:00.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:00.514+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125629 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:00.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:00.522+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:02.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:02.046+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125655 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:03.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:03.350+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:04.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:04.634+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125707 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:05.628 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:05.622+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:06.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:06.010+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:07.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:07.246+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125755 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:08.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:08.442+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125780 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:09.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:09.746+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:10.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:10.621+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:11.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:11.014+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125831 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:12.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:12.314+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:13.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:13.594+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 125886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:14.966 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:14.962+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:15.644 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:15.637+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:16.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:16.282+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126245 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:17.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:17.566+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:18.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:18.842+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:20.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:20.170+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:20.713 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:20.709+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:21.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:21.450+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126339 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:22.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:22.734+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:23.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:23.962+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:25.268 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:25.262+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126411 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:25.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:25.725+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:26.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:26.582+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:27.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:27.902+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:29.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:29.214+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:29.835 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:52:29.829+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-16T23:52:29.835 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:52:29.829+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-16T23:52:29.836 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:52:29.829+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-16T23:52:30.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:30.554+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126515 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:30.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:30.725+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:31.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:31.742+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:33.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:33.010+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:34.282 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:34.278+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:35.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:35.626+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126615 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:35.729 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:35.725+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:36.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:36.814+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126635 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:38.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:38.042+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:39.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:39.457+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:40.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:40.741+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:40.760 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:40.753+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:41.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:41.969+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126729 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:43.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:43.257+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:44.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:44.485+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126781 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:45.725 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:45.717+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:45.745 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:45.740+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:46.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:46.873+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126828 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:48.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:48.081+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:49.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:49.313+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126878 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:50.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:50.597+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:50.805 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:50.800+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:51.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:51.801+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126923 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:53.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:53.189+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:54.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:54.589+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 126983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:55.815 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:52:55.808+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:52:55.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:55.821+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127004 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:57.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:57.133+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127029 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:58.440 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:58.429+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:52:59.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:52:59.797+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:00.824 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:00.816+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:01.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:01.145+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:02.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:02.473+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:03.725 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:03.717+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:04.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:04.989+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:05.849 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:05.844+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:06.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:06.217+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127200 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:07.412 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:07.405+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:08.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:08.637+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:09.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:09.897+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:10.159 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:53:10.156+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-16T23:53:10.159 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:53:10.156+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-16T23:53:10.160 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:53:10.156+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-16T23:53:10.852 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:10.844+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:11.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:11.393+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:12.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:12.805+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:14.115 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:14.109+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:14.141 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:53:14.136+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-16T23:53:14.142 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:53:14.136+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-16T23:53:14.142 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:53:14.136+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-16T23:53:14.142 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:53:14.136+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-16T23:53:14.142 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:53:14.136+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-16T23:53:14.142 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:53:14.136+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-16T23:53:14.142 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:53:14.136+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-16T23:53:15.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:15.509+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:15.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:15.884+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:16.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:16.849+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:18.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:18.201+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:19.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:19.677+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:20.889 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:20.884+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:20.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:20.893+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127455 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:22.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:22.217+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:23.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:23.544+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:24.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:24.820+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:25.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:25.891+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:26.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:26.132+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:27.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:27.452+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:28.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:28.812+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:30.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:30.280+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:30.897 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:30.891+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:31.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:31.744+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:33.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:33.128+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127691 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:34.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:34.492+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:35.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:35.891+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:36.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:36.012+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127740 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:37.240 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:37.232+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127757 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:38.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:38.560+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127782 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:39.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:39.836+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:40.925 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:40.915+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:41.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:41.072+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:42.301 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:42.296+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:43.521 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:43.496+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:44.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:44.756+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:45.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:45.947+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:46.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:46.008+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:47.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:47.288+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:48.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:48.584+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:49.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:49.904+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 127994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:51.029 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:51.023+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:51.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:51.256+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:52.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:52.644+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:53.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:53.900+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:55.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:55.204+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:56.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:53:56.023+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:53:56.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:56.528+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128107 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:57.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:57.772+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:53:59.149 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:53:59.144+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:00.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:00.552+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128180 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:01.030 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:01.022+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:01.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:01.816+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:03.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:03.256+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:04.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:04.804+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128259 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:06.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:06.026+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:06.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:06.283+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:07.608 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:07.599+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:08.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:08.863+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:10.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:10.039+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:11.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:11.082+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:11.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:11.331+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:12.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:12.763+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:14.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:14.075+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128416 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:18.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:17.995+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:18.069 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:18.062+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:19.365 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:19.355+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:19.481 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:19.474+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-16T23:54:19.481 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:19.474+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-16T23:54:19.481 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:19.474+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-16T23:54:19.481 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:19.474+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-16T23:54:19.482 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:19.474+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-16T23:54:19.482 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:19.474+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-16T23:54:19.482 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:19.474+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-16T23:54:21.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:21.803+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:23.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:23.082+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:23.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:23.147+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:24.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:24.531+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:25.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:25.791+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:27.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:27.083+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:28.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:28.082+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:28.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:28.519+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128680 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:30.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:30.939+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:32.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:32.191+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:33.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:33.082+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:33.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:33.419+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:35.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:35.243+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:36.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:36.919+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 128950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:38.092 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:38.081+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:38.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:38.339+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:39.676 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:39.667+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:40.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:40.927+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:41.699 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:41.689+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-16T23:54:41.699 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:41.689+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-16T23:54:41.699 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:41.689+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-16T23:54:41.699 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:41.689+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-16T23:54:41.700 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:41.689+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-16T23:54:41.700 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:41.689+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-16T23:54:41.700 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:54:41.689+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-16T23:54:42.327 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:42.319+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:43.124 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:43.117+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:43.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:43.811+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:45.099 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:45.091+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:46.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:46.459+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:47.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:47.827+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:48.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:48.165+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:49.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:49.202+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:50.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:50.562+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:52.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:52.114+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:53.236 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:53.233+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:53.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:53.390+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:54.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:54.634+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:55.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:55.886+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:57.276 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:57.266+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:58.278 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:54:58.273+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:54:58.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:58.578+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:54:59.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:54:59.882+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:01.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:01.218+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:02.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:02.486+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:03.298 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:03.293+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:03.770 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:03.766+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:05.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:05.050+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 129991 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:06.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:06.438+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130044 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:07.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:07.806+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:08.345 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:08.341+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:09.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:09.106+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:10.538 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:10.534+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:11.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:11.770+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:13.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:13.070+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:13.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:13.340+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:14.318 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:14.314+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:15.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:15.626+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:16.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:16.886+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:18.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:18.154+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:18.382 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:18.376+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:19.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:19.490+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:20.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:20.754+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:22.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:22.098+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:22.220 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:55:22.216+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-16T23:55:22.220 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:55:22.216+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-16T23:55:22.221 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-16T23:55:22.216+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-16T23:55:23.391 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:23.388+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:23.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:23.386+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:24.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:24.606+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:25.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:25.978+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:27.244 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:27.238+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:28.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:28.432+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:28.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:28.710+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:30.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:30.194+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:31.556 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:31.550+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:32.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:32.777+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130635 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:33.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:33.492+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:34.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:34.309+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:35.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:35.705+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:36.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:36.933+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130715 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:38.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:38.165+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:38.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:38.492+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:39.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:39.425+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:40.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:40.769+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:42.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:42.009+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:43.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:43.321+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130828 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:43.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:43.492+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:44.227 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:55:44.224+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-16T23:55:44.227 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:55:44.224+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-16T23:55:44.227 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:55:44.224+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-16T23:55:44.227 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:55:44.224+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-16T23:55:44.228 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:55:44.224+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-16T23:55:44.228 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:55:44.224+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-16T23:55:44.228 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:55:44.224+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-16T23:55:44.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:44.517+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:45.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:45.737+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:47.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:47.177+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:48.444 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:48.437+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:48.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:48.492+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:49.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:49.625+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:50.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:50.861+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:52.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:52.137+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:53.341 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:53.333+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 130989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:53.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:53.491+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:54.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:54.589+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:55.793 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:55.789+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131028 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:57.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:57.029+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:58.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:58.249+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:55:59.067 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:55:59.059+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:55:59.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:55:59.409+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:00.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:00.609+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:01.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:01.801+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:02.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:02.985+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131152 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:04.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:04.281+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:05.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:05.517+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131200 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:06.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:06.861+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:07.126 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:56:07.119+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:56:08.047 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:08.033+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:09.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:09.281+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:10.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:10.573+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131285 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:11.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:11.777+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:13.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:13.005+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131325 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:14.236 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:14.229+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:15.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:15.432+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:16.754 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:16.748+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:17.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:17.984+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:19.419 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:19.412+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131429 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:19.868 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:56:19.863+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:56:20.599 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:20.592+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:21.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:21.852+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131471 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:23.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:23.096+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:24.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:24.296+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131507 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:25.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:25.492+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:26.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:26.736+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:27.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:27.944+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 131980 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:29.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:29.180+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 132122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:30.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:30.360+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 132243 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:31.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:31.560+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 132375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:33.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:33.308+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 132540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:33.875 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:56:33.870+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:56:34.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:34.692+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 132701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:35.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:35.944+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 132904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:37.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:37.220+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:38.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:38.432+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:39.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:39.872+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:41.137 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:41.128+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:42.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:42.332+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:43.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:43.596+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:44.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:44.904+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:46.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:46.208+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:47.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:47.424+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 133949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:48.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:48.632+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:49.942 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:49.936+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:51.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:51.240+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:52.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:52.544+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:53.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:53.832+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:55.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:55.184+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:56.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:56.460+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134664 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:57.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:57.755+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:56:59.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:56:58.995+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134828 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:00.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:00.227+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 134972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:01.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:01.559+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135117 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:02.950 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:02.943+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:03.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:03.126+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:04.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:04.163+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:05.397 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:05.387+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:06.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:06.599+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:07.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:07.907+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:08.135 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:08.129+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:09.219 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:09.207+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:10.511 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:10.503+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:11.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:11.811+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:13.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:13.131+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:13.161 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:13.153+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:14.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:14.571+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 135939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:15.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:15.891+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:17.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:17.155+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:18.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:18.157+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:18.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:18.539+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:19.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:19.903+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:21.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:21.283+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:22.504 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:22.495+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:23.162 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:23.157+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:23.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:23.843+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:25.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:25.171+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:26.490 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:26.483+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:27.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:27.771+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:28.163 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:28.161+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:29.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:29.251+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 136950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:30.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:30.611+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137080 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:32.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:32.115+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137140 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:33.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:33.197+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:33.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:33.487+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:34.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:34.795+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:36.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:36.187+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:37.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:37.491+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:38.304 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:38.301+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:38.989 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:38.979+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:40.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:40.235+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:41.587 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:41.578+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137331 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:42.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:42.910+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:43.436 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:43.432+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:44.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:44.294+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:45.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:45.670+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:47.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:46.998+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:48.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:48.446+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:48.457 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:48.452+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:49.799 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:49.794+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137471 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:51.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:51.122+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:52.474 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:52.466+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:53.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:53.500+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:53.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:53.934+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:55.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:55.194+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:56.682 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:56.678+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:58.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:58.026+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:57:58.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:57:58.500+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:57:59.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:57:59.262+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137620 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:00.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:00.490+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:01.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:01.842+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:03.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:03.226+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:03.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:03.500+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:04.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:04.802+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:06.204 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:06.198+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:07.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:07.402+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137760 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:08.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:08.540+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:08.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:08.674+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137784 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:09.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:09.894+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:11.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:11.134+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:12.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:12.510+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:13.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:13.548+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:14.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:14.014+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:15.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:15.318+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:16.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:16.690+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:18.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:18.034+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:18.554 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:18.548+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:19.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:19.474+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:20.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:20.930+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 137999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:22.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:22.294+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:23.519 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:23.513+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138047 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:23.680 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:23.675+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:24.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:24.761+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138064 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:26.023 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:26.017+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:27.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:27.325+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:28.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:28.683+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:28.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:28.713+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:29.741 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:58:29.731+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-16T23:58:29.742 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:58:29.731+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-16T23:58:29.742 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:58:29.731+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-16T23:58:29.742 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:58:29.731+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-16T23:58:29.742 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:58:29.731+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-16T23:58:29.743 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:58:29.731+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-16T23:58:29.743 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-16T23:58:29.731+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-16T23:58:30.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:30.045+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:31.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:31.317+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:32.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:32.609+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:33.702 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:33.695+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:33.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:33.905+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:35.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:35.097+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:36.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:36.357+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:37.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:37.617+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:38.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:38.727+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:38.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:38.821+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138295 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:40.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:40.141+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:41.547 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:41.541+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138331 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:43.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:43.053+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138352 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:43.865 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:43.851+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:44.441 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:44.433+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:45.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:45.821+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:47.184 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:47.177+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:48.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:48.577+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:48.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:48.851+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:49.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:49.949+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:51.273 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:51.265+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:52.556 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:52.549+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:53.860 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:53.851+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:58:54.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:54.233+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:56.076 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:56.069+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:57.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:57.557+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138599 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:58.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:58:58.853+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:58:58.866 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:58:58.854+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:00.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:00.277+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:01.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:01.529+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:02.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:02.881+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138682 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:03.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:03.874+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:04.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:04.177+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138700 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:05.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:05.521+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:06.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:06.989+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138741 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:08.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:08.388+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138765 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:08.880 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:08.874+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:09.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:09.876+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:11.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:11.264+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:12.966 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:12.960+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:13.896 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:13.890+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:14.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:14.152+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:15.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:15.460+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138884 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:16.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:16.812+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:18.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:18.152+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:18.943 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:18.938+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:19.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:19.472+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:20.793 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:20.780+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:22.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:22.092+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 138996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:23.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:23.340+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139020 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:23.965 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:23.962+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:24.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:24.692+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139044 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:26.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:26.084+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:27.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:27.284+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:28.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:28.452+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:28.966 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:28.958+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:29.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:29.716+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:31.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:31.016+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:32.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:32.368+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:33.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:33.752+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:33.998 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:33.994+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:35.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:35.048+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:36.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:36.480+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139233 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:37.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:37.752+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:39.019 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:39.013+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:39.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:39.012+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:40.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:40.372+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:41.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:41.728+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139316 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:43.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:43.484+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:44.139 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:44.129+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:44.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:44.764+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:46.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:46.096+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:47.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:47.344+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:48.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:48.612+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:49.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:49.225+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:49.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:49.968+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:51.430 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:51.420+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:52.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:52.883+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:54.245 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:54.237+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:54.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:54.379+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:55.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:55.831+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:57.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:57.171+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:58.538 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:58.531+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-16T23:59:59.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-16T23:59:59.345+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-16T23:59:59.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-16T23:59:59.847+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:01.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:01.239+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:02.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:02.487+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:03.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:03.795+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:04.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:04.345+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:05.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:05.191+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:06.531 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:06.523+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:07.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:07.951+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139720 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:09.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:09.275+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:09.358 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:09.349+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:10.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:10.623+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:11.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:11.939+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:13.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:13.267+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:14.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:14.364+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:14.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:14.679+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:15.609 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:15.604+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:00:15.609 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:15.604+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:00:15.609 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:15.604+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:00:15.609 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:15.604+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:00:15.609 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:15.604+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:00:15.609 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:15.604+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:00:15.989 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:15.975+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:17.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:17.311+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:18.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:18.635+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139895 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:19.441 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:19.436+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:19.942 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:19.935+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:21.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:21.175+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:22.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:22.487+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:24.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:23.995+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 139986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:24.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:24.456+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:25.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:25.383+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140007 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:26.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:26.711+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:28.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:28.387+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:29.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:29.464+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:29.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:29.715+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140080 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:31.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:31.143+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140103 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:31.738 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:31.732+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:00:31.738 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:31.732+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:00:31.738 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:31.732+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:00:31.738 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:31.732+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:00:31.738 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:31.732+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:00:31.739 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:31.732+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:00:31.739 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:31.732+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:00:32.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:32.455+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:32.754 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:32.748+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:00:32.755 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:32.748+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:00:32.755 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:32.748+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:00:32.755 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:32.748+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:00:32.755 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:32.748+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:00:32.755 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:00:32.748+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:00:33.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:33.919+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:34.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:34.464+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:35.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:35.311+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:36.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:36.682+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:38.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:38.150+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:39.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:39.512+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:39.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:39.518+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:40.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:40.978+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:42.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:42.290+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:43.575 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:43.566+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:44.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:44.512+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:44.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:44.886+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:46.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:46.142+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140344 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:47.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:47.506+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:48.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:48.850+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:49.534 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:49.527+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:50.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:50.122+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:51.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:51.314+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:52.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:52.614+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140452 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:53.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:53.870+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:54.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:54.539+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:00:55.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:55.050+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:56.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:56.362+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:57.753 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:57.746+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:59.030 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:00:59.026+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:00:59.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:00:59.543+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:00.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:00.302+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:01.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:01.594+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:02.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:02.926+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:04.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:04.559+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:04.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:04.558+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:05.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:05.914+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140664 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:07.232 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:07.226+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:08.625 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:08.622+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:09.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:09.559+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:10.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:10.014+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:11.297 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:11.294+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:12.729 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:12.726+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:14.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:14.074+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:14.638 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:14.631+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:15.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:15.482+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140820 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:16.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:16.826+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:18.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:18.378+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:19.659 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:19.655+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:19.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:19.790+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140895 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:21.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:21.249+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:22.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:22.685+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:24.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:24.053+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140955 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:24.912 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:24.907+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:25.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:25.373+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140971 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:26.743 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:26.737+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 140993 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:28.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:28.053+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:29.729 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:29.717+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:29.924 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:29.918+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:31.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:31.113+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:32.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:32.501+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:33.954 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:33.949+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:34.969 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:34.962+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:35.299 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:35.293+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:36.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:36.649+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:37.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:37.949+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141165 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:39.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:39.197+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141188 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:40.013 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:40.006+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:40.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:40.469+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:41.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:41.769+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:43.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:43.261+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141253 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:44.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:44.725+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:45.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:45.010+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:46.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:46.037+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:47.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:47.305+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:48.543 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:48.537+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:49.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:49.761+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:50.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:50.010+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:51.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:51.049+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:52.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:52.337+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:53.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:53.549+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:55.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:01:55.034+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:01:55.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:55.065+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:56.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:56.361+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:57.722 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:57.717+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:01:59.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:01:59.013+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:00.041 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:00.034+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:00.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:00.261+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:01.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:01.525+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:02.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:02.829+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:04.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:04.117+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:05.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:05.130+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:05.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:05.396+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:06.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:06.684+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:07.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:07.940+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:09.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:09.188+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:10.178 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:10.169+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:10.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:10.468+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141685 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:11.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:11.816+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:13.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:13.012+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:14.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:14.256+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:15.213 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:15.205+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:15.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:15.484+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141755 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:16.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:16.856+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:18.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:18.112+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:19.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:19.456+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:20.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:20.233+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:20.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:20.844+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141836 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:22.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:22.052+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:23.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:23.412+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:24.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:24.660+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:25.310 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:25.305+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:26.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:26.032+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:27.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:27.344+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141924 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:28.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:28.664+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:30.001 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:29.992+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:30.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:30.529+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:31.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:31.592+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 141984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:32.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:32.956+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:34.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:34.368+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142020 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:35.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:35.605+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:35.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:35.740+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:37.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:37.184+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142056 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:38.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:38.528+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:39.901 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:39.892+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:40.610 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:40.609+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:41.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:41.128+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:42.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:42.304+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:43.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:43.584+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:44.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:44.856+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:45.633 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:45.628+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:46.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:46.140+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:47.419 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:47.412+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:48.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:48.612+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:49.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:49.863+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142248 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:50.652 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:50.648+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:51.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:51.123+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:52.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:52.519+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:53.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:53.759+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:55.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:55.075+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:55.825 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:02:55.820+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:02:56.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:56.327+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:57.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:57.679+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:02:58.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:02:58.943+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:00.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:00.239+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:00.888 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:00.884+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:01.559 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:01.551+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:02.848 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:02.839+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:04.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:04.051+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:05.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:05.419+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:05.900 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:05.896+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:06.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:06.703+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:08.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:08.011+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:09.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:09.363+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:10.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:10.903+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:10.934 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:10.928+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:12.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:12.359+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:13.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:13.791+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:15.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:15.523+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:16.044 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:16.040+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:16.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:16.779+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:18.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:18.151+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142645 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:19.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:19.439+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:21.110 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:21.103+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:21.175 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:21.172+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:22.611 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:22.603+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:23.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:23.907+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:25.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:25.255+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:26.234 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:26.231+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:26.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:26.503+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:27.185 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:03:27.179+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:03:27.185 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:03:27.179+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:03:27.185 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:03:27.179+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:03:28.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:27.991+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:30.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:30.127+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:31.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:31.395+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:31.579 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:31.567+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142828 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:33.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:33.006+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:34.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:34.450+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:35.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:35.758+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:36.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:36.547+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:37.332 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:37.318+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142908 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:38.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:38.830+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:40.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:40.098+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:41.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:41.458+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:41.553 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:41.547+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:42.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:42.862+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 142989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:44.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:44.374+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:45.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:45.642+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:46.560 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:46.555+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:46.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:46.934+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:48.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:48.198+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:49.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:49.446+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:50.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:50.666+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:51.561 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:51.555+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:52.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:52.122+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:53.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:53.590+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:54.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:54.962+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:56.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:56.470+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:56.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:03:56.575+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:03:58.099 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:58.094+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:03:59.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:03:59.402+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:00.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:00.782+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:01.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:01.686+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:02.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:02.310+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:03.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:03.842+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:05.175 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:05.170+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:06.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:06.586+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:06.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:06.682+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:08.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:08.018+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:09.535 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:09.530+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:04:09.536 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:09.530+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:04:09.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:09.530+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:04:09.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:09.530+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:04:09.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:09.530+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:04:09.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:09.530+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:04:09.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:09.530+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:04:09.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:09.546+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143356 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:11.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:11.226+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:11.689 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:11.682+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:12.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:12.586+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:14.087 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:14.082+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:15.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:15.434+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:16.692 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:16.690+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:16.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:16.822+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:18.223 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:18.217+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:19.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:19.649+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:21.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:21.137+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:21.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:21.850+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:23.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:23.253+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:24.666 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:24.661+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:26.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:26.117+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:26.857 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:26.850+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:27.622 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:27.617+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:29.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:29.701+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:31.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:31.341+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143669 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:32.121 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:32.114+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:32.723 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:32.717+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143689 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:34.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:34.037+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:35.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:35.353+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:36.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:36.813+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:37.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:37.194+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:38.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:38.201+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:39.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:39.897+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:41.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:41.337+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143815 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:41.831 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:41.825+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:04:41.831 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:41.825+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:04:41.832 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:41.825+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:04:41.832 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:41.825+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:04:41.832 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:04:41.825+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:04:42.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:42.193+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:42.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:42.701+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:44.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:44.409+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:46.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:46.593+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:47.202 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:47.197+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:48.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:48.105+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143915 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:49.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:49.549+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:51.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:51.273+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:52.207 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:52.205+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:52.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:52.729+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:54.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:54.205+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 143999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:55.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:55.793+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144020 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:57.209 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:04:57.205+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:04:57.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:57.353+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:04:58.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:04:58.713+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:00.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:00.157+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:01.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:01.372+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:02.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:02.317+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:02.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:02.572+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144112 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:03.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:03.876+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:05.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:05.200+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:06.478 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:06.472+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:07.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:07.385+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:07.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:07.836+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:09.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:09.212+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:10.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:10.500+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:11.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:11.852+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144245 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:12.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:12.465+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:13.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:13.136+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:14.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:14.528+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:16.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:16.288+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144299 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:17.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:17.492+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:17.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:17.656+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:19.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:19.048+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:20.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:20.500+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:21.725 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:21.720+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:22.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:22.492+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:23.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:23.080+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:24.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:24.472+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:25.753 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:25.748+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:27.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:27.012+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:27.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:27.516+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:28.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:28.260+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:29.447 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:29.440+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:31.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:31.056+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:32.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:32.452+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:32.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:32.520+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:33.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:33.704+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:35.009 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:35.000+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:36.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:36.416+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:37.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:37.560+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:37.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:37.640+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:38.932 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:38.924+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144596 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:39.385 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:05:39.380+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:05:39.386 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:05:39.380+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:05:39.386 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:05:39.380+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:05:39.386 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:05:39.380+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:05:40.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:40.172+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:41.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:41.448+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:42.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:42.608+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:42.894 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:42.888+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:44.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:44.264+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:45.822 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:45.815+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:47.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:47.495+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:47.647 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:47.644+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:49.214 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:49.207+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:50.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:50.767+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:52.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:52.343+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144780 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:52.677 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:52.676+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:53.756 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:53.747+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144802 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:55.135 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:55.127+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:56.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:56.511+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:57.706 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:05:57.703+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:05:57.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:57.919+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:05:59.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:05:59.443+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:00.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:00.963+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:02.707 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:02.703+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:02.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:02.787+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:04.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:04.271+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:05.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:05.495+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144952 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:06.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:06.931+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:07.734 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:07.731+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:08.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:08.403+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 144985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:09.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:09.891+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:11.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:11.447+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:12.752 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:12.747+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:12.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:12.899+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:14.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:14.675+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:16.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:16.199+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:17.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:17.627+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:17.772 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:17.767+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:18.845 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:18.835+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:20.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:20.119+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:21.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:21.371+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:22.841 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:22.835+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:23.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:23.107+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:24.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:24.579+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:25.942 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:25.935+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:27.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:27.403+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:27.972 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:27.967+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:28.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:28.842+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:30.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:30.154+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:31.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:31.474+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:32.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:32.726+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:33.010 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:33.006+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:34.097 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:34.086+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:35.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:35.402+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:36.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:36.694+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:38.200 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:38.198+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:38.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:38.274+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:39.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:39.558+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:41.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:41.070+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:42.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:42.470+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:43.201 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:43.194+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:44.027 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:44.022+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:45.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:45.458+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145507 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:47.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:47.014+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:48.319 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:48.314+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:48.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:48.614+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:50.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:49.998+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:51.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:51.290+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:52.635 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:52.630+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:53.618 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:53.614+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:53.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:53.882+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:55.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:55.214+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:56.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:56.602+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145664 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:57.954 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:57.950+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:06:58.758 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:06:58.746+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:06:59.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:06:59.286+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:00.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:00.642+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:01.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:01.914+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:03.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:03.226+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:04.031 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:04.026+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:04.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:04.546+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:05.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:05.798+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145784 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:07.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:07.762+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:09.217 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:09.209+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:09.468 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:09.462+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:10.788 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:10.782+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145847 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:12.325 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:12.321+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:13.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:13.677+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145884 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:14.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:14.225+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:14.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:14.985+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:16.297 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:16.289+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:16.491 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:07:16.485+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:07:16.491 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:07:16.485+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:07:16.492 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:07:16.485+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:07:17.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:17.761+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:19.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:19.377+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:19.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:19.465+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:20.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:20.969+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:22.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:22.273+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 145998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:23.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:23.741+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:24.632 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:24.629+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:25.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:25.185+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:26.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:26.501+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:27.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:27.893+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146072 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:29.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:29.277+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:30.445 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:30.445+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:30.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:30.729+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:32.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:32.593+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:33.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:33.905+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:35.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:35.297+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:35.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:35.481+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:36.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:36.893+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:38.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:38.401+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:39.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:39.865+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146233 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:40.485 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:40.481+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:41.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:41.521+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:42.930 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:42.925+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:44.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:44.253+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146299 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:45.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:45.489+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:45.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:45.585+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:47.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:47.037+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:48.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:48.341+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:49.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:49.781+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:50.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:50.500+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:51.397 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:51.389+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146392 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:52.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:52.717+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:54.274 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:54.269+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146443 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:55.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:07:55.528+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:07:55.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:55.728+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:57.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:57.140+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:58.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:58.496+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:07:59.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:07:59.876+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:00.533 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:00.528+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:01.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:01.304+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:02.665 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:02.656+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146544 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:04.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:04.052+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:05.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:05.504+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:05.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:05.580+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:07.222 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:07.212+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146604 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:08.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:08.688+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:10.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:10.092+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:10.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:10.588+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:11.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:11.520+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146669 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:12.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:12.700+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:13.960 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:13.952+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146707 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:15.232 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:15.224+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:15.614 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:15.612+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:16.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:16.416+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:17.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:17.728+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146757 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:19.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:19.052+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:20.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:20.444+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:20.688 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:20.684+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:21.788 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:21.780+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:23.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:23.124+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:24.489 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:24.484+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:25.730 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:25.727+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:25.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:25.860+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:27.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:27.024+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:28.250 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:28.244+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:29.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:29.460+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:30.913 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:30.907+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:31.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:31.004+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:32.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:32.308+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:33.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:33.532+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146969 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:34.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:34.888+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 146990 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:36.087 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:36.083+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:36.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:36.508+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:37.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:37.720+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:39.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:39.047+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:40.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:40.279+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147068 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:41.143 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:41.139+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:41.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:41.651+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147088 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:42.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:42.931+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:44.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:44.199+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:45.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:45.451+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:46.185 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:46.179+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:46.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:46.751+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:48.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:48.151+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147165 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:49.424 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:49.415+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:50.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:50.975+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:51.259 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:51.255+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:52.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:52.319+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:53.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:53.875+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:55.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:55.187+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:56.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:08:56.311+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:08:56.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:56.467+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:57.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:57.735+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:08:58.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:08:58.939+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:00.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:00.263+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:01.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:01.331+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:01.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:01.567+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:03.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:03.247+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:04.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:04.587+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:05.981 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:05.967+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:06.339 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:06.334+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:07.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:07.399+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:09.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:09.247+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:10.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:10.663+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:11.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:11.366+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:12.028 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:12.019+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:13.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:13.903+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:15.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:15.939+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:16.649 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:16.642+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:17.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:17.759+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:20.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:20.231+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:21.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:21.587+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147583 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:21.690 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:21.686+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:23.795 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:23.786+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:25.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:25.194+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147629 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:26.755 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:26.750+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:26.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:26.950+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147651 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:28.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:28.942+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:30.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:30.302+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:31.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:31.690+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147715 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:31.797 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:31.790+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:33.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:33.002+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:34.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:34.406+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147751 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:35.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:35.774+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:36.703 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:36.698+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:09:36.703 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:36.698+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:09:36.703 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:36.698+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:09:36.833 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:36.830+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:36.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:36.958+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:37.713 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:37.706+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:09:37.713 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:37.706+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:09:41.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:41.010+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:41.732 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:41.725+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:09:41.732 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:41.725+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:09:41.733 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:09:41.725+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:09:41.873 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:41.869+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:42.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:42.526+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:43.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:43.806+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:45.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:45.410+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:46.968 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:46.965+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:47.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:47.110+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:48.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:48.502+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:49.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:49.778+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:51.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:51.650+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:51.983 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:51.981+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:53.167 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:53.162+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:54.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:54.746+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:56.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:56.158+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:57.134 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:09:57.129+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:09:57.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:57.702+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:09:59.009 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:09:59.006+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 147998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:00.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:00.406+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:02.133 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:02.133+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:02.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:02.722+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148031 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:04.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:04.458+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:06.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:06.093+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:07.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:07.345+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:07.622 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.621+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:10:07.626 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.621+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:10:07.627 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.621+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:10:07.627 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.621+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:10:07.627 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.621+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:10:07.627 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.621+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:10:07.629 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.625+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:10:07.630 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.625+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:10:07.630 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.625+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:10:07.630 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.625+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:10:07.630 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.625+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:10:07.630 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.625+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:10:07.630 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:07.625+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:10:07.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:07.845+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:09.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:09.373+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:10.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:10.805+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148116 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:12.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:12.501+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:12.553 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:12.545+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:13.700 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:13.685+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:10:13.700 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:13.685+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:10:13.700 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:13.685+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:10:13.700 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:13.685+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:10:13.701 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:13.685+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:10:13.701 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:13.685+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:10:14.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:14.145+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:15.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:15.597+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:17.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:17.197+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:17.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:17.592+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:18.590 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:18.585+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:20.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:20.097+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:21.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:21.813+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:22.612 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:22.608+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:23.115 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:23.097+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:24.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:24.453+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:24.793 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.792+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:10:24.794 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.792+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:10:24.802 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.792+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:10:24.802 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.792+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:10:24.802 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.792+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:10:24.802 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.792+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:10:24.802 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.792+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:10:24.802 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.796+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:10:24.802 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.796+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:10:24.803 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.796+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:10:24.803 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.796+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:10:24.803 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.796+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:10:24.803 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:24.796+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:10:25.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:25.681+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:26.901 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:26.897+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:27.663 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:27.660+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:27.678 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:27.672+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:10:27.679 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:27.672+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:10:27.679 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:27.672+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:10:27.679 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:27.676+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:10:27.679 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:27.676+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:10:27.679 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:27.676+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:10:28.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:28.117+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:29.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:29.461+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:30.859 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:30.852+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:10:30.859 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:30.856+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:10:30.859 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:30.856+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:10:30.860 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:30.856+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:10:30.860 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:30.856+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:10:30.861 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:10:30.856+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:10:30.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:30.873+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:32.847 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:32.844+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:32.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:32.961+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:34.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:34.217+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:36.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:36.089+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:37.905 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:37.900+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:38.026 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:38.021+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:43.075 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:43.072+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:43.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:43.393+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148520 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:44.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:44.801+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:46.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:46.129+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:48.189 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:48.188+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:48.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:48.324+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148583 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:49.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:49.788+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148596 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:51.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:51.720+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:53.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:53.284+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:53.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:53.460+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:54.725 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:54.720+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:56.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:56.164+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:57.575 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:57.568+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:10:58.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:10:58.299+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:10:59.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:10:59.232+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:00.626 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:00.620+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148720 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:01.989 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:01.980+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148729 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:03.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:03.363+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:04.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:04.072+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:05.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:05.616+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:07.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:07.352+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:08.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:08.427+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:09.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:09.108+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:10.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:10.844+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148832 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:16.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:16.763+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:18.884 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:17.744+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148864 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:19.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:19.828+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:21.769 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:21.767+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:22.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:21.864+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148912 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:23.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:23.332+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:24.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:24.732+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:26.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:26.148+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148961 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:26.894 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:26.891+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:27.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:27.892+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:29.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:29.588+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 148998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:31.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:31.867+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:31.893 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:31.890+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:33.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:33.371+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:35.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:35.103+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:36.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:36.950+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:36.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:36.975+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:38.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:38.327+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:39.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:39.799+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:41.067 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:41.059+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:41.956 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:41.950+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:43.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:43.483+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:46.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:46.111+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:46.967 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:46.962+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:47.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:47.919+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:49.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:49.563+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:51.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:51.111+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:51.973 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:51.970+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:53.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:53.115+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:54.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:54.583+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:55.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:55.867+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:56.985 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:11:56.982+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:11:57.730 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:57.723+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:11:59.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:11:59.771+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:01.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:01.095+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:01.986 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:01.982+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:02.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:02.967+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:04.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:04.279+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149343 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:05.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:05.867+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:07.040 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:07.034+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:08.174 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:08.167+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149363 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:10.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:10.663+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:12.224 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:12.217+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:12.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:12.275+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:14.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:14.271+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:17.294 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:17.289+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:17.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:17.666+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:19.258 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:19.250+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:20.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:20.694+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:22.050 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:22.045+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:12:22.053 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:22.045+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:12:22.054 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:22.045+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:12:22.054 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:22.049+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:12:22.054 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:22.049+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:12:22.054 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:22.049+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:12:22.054 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:22.049+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:12:22.308 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:22.305+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:23.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:23.034+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149503 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:24.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:24.530+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:26.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:26.610+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:27.313 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:27.309+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:28.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:28.586+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:30.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:30.222+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:32.161 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:32.158+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:33.286 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:33.285+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:35.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:35.554+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:37.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:37.302+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:38.307 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:38.305+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:39.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:39.114+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:40.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:40.702+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:42.277 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:42.277+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:12:42.277 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:42.277+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:12:42.277 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:42.277+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:12:42.277 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:42.277+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:12:42.278 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:42.277+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:12:42.278 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:42.277+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:12:42.278 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:12:42.277+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:12:44.015 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:44.013+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:45.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:44.098+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:48.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:48.434+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:49.016 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:49.012+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:51.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:51.118+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:53.575 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:53.570+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:54.026 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:54.024+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:55.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:55.198+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:57.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:57.006+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:12:59.045 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:12:59.044+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:12:59.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:12:59.081+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:00.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:00.617+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:02.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:02.285+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:03.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:03.765+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:04.046 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:04.044+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:05.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:05.589+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149920 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:06.922 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:06.917+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:08.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:08.681+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:09.088 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:09.084+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:10.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:10.361+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:11.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:11.981+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 149987 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:13.316 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:13.309+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:14.093 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:14.088+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:14.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:14.609+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:15.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:15.933+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:19.144 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:19.140+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:24.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:23.401+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:24.454 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:24.451+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:27.009 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:27.001+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:28.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:28.773+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150139 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:29.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:29.527+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:30.307 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:30.301+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:32.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:32.053+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:34.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:34.101+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:34.531 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:34.527+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:34.748 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:13:34.743+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:13:34.748 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:13:34.743+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:13:34.749 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:13:34.743+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:13:36.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:36.013+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:38.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:38.669+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:39.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:39.587+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:40.350 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:40.345+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:43.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:43.008+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:44.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:44.587+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:44.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:44.612+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:47.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:47.056+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:49.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:49.356+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:49.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:49.587+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:50.894 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:13:50.891+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:13:50.894 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:13:50.891+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:13:50.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:13:50.891+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:13:50.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:13:50.891+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:13:50.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:13:50.891+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:13:50.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:13:50.891+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:13:50.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:13:50.891+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:13:51.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:51.944+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150343 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:54.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:54.500+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150364 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:54.615 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:54.611+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:13:56.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:56.692+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:59.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:13:59.280+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:13:59.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:13:59.611+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:01.834 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:01.828+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:04.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:04.400+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:04.617 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:04.610+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:06.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:06.112+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:09.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:09.172+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:09.645 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:09.642+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:10.062 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:14:10.058+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:14:10.062 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:14:10.058+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:14:10.063 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:14:10.058+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:14:10.892 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:10.876+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:13.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:13.304+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:14.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:14.642+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:14.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:14.944+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150560 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:17.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:17.028+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:18.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:18.560+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150597 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:19.648 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:19.642+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:20.504 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:20.500+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:22.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:22.044+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:23.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:23.668+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150635 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:24.700 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:24.694+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:25.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:25.543+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:27.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:27.307+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150664 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:28.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:28.759+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:29.737 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:29.726+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:30.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:30.307+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:32.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:32.007+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:33.505 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:33.499+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150705 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:34.898 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:34.894+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:35.354 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:35.347+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:36.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:36.943+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:38.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:38.687+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:39.942 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:39.941+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:40.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:40.443+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150760 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:42.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:42.171+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:43.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:43.671+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:44.996 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:44.993+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:45.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:45.259+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:46.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:46.971+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:49.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:49.367+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:50.002 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:49.997+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:50.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:50.743+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:52.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:52.255+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:53.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:53.711+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:55.020 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:14:55.017+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:14:55.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:55.367+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:57.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:57.259+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:14:59.355 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:14:59.347+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:00.101 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:00.097+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:00.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:00.927+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:02.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:02.483+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:04.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:04.255+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:05.183 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:05.181+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:05.691 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:05.683+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:07.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:07.582+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150969 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:09.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:09.442+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:10.248 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:10.245+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:10.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:10.950+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 150995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:12.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:12.854+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:15.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:14.854+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:15.250 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:15.248+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:16.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:16.118+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:18.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:18.194+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151051 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:19.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:19.986+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:20.303 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:20.300+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:22.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:22.086+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:23.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:23.470+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:23.757 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:15:23.752+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:15:23.757 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:15:23.752+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:15:24.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:24.906+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:25.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:25.320+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:26.258 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:26.254+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:28.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:28.186+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:29.936 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:29.930+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:30.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:30.388+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:31.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:31.802+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:33.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:33.550+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:35.250 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:35.246+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:35.397 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:35.396+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:36.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:36.878+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151204 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:38.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:38.366+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:40.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:39.998+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:40.440 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:40.440+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:41.440 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:41.434+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:43.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:43.466+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:45.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:45.262+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:45.459 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:45.456+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:47.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:47.166+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151288 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:48.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:48.898+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:50.532 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:50.527+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:50.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:50.777+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:50.982 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:15:50.975+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:15:50.982 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:15:50.975+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:15:50.982 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:15:50.975+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:15:53.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:53.385+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:55.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:55.557+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151352 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:15:55.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:15:55.559+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:15:57.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:15:57.513+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:00.668 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:00.661+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:00.668 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:00.667+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:02.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:02.921+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:04.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:04.621+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:05.715 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:05.711+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:06.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:06.221+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151440 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:08.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:08.185+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:10.397 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:10.377+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151467 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:10.740 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:10.735+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:12.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:12.201+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:14.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:14.421+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:15.781 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:15.775+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:16.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:16.061+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:18.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:18.621+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:21.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:21.331+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:23.385 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:22.061+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:23.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:23.669+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:26.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:26.157+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:26.333 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:26.331+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:35.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:35.344+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:47.388 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:46.656+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151744 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:50.040 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:50.034+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:51.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:51.656+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:53.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:53.812+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:55.321 INFO:tasks.rbd_mirror.cluster1.client.mirror.3.smithi177.stderr:2019-12-17T00:16:55.318+0000 7fdd60929700 -1 rbd::mirror::LeaderWatcher: 0x562e292e7300 handle_get_locker: error retrieving leader locker: (108) Cannot send after transport endpoint shutdown 2019-12-17T00:16:55.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:55.540+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:58.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:58.092+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151871 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:16:59.521 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:16:59.516+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151880 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:00.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:00.768+0000 7f6702f62700 -1 osd.2 107 get_health_metrics reporting 151891 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:01.964 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:01.956+0000 7f6702f62700 -1 osd.2 108 get_health_metrics reporting 151896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:03.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:03.232+0000 7f6702f62700 -1 osd.2 108 get_health_metrics reporting 151896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:04.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:04.892+0000 7f6702f62700 -1 osd.2 108 get_health_metrics reporting 151896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:06.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:06.128+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:07.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:07.392+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:08.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:08.648+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151896 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:09.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:09.876+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:11.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:11.048+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151920 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:12.247 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:12.240+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151936 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:13.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:13.460+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:14.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:14.704+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:15.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:15.871+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151952 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:17.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:17.107+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151956 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:18.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:18.299+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151961 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:19.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:19.551+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:20.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:20.771+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:22.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:22.031+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:23.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:23.287+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 151992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:24.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:24.503+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:25.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:25.679+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:26.077 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:17:26.073+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:17:26.077 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:17:26.073+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:17:26.077 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:17:26.073+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:17:26.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:26.847+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:27.111 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:17:27.109+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:17:27.111 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:17:27.109+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:17:27.112 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:17:27.109+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:17:28.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:28.123+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:29.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:29.503+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:30.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:30.707+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:31.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:31.879+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:33.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:33.119+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:34.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:34.351+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152061 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:35.608 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:35.599+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:36.819 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:36.807+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:38.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:38.059+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:39.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:39.283+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:40.522 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:40.511+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:41.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:41.787+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:43.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:43.095+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:44.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:44.343+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:45.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:45.527+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:46.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:46.771+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:48.007 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:47.999+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:49.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:49.291+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:50.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:50.455+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:51.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:51.727+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:53.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:53.015+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:54.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:54.307+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:55.519 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:55.511+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:56.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:56.799+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:58.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:58.095+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:17:59.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:17:59.354+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:00.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:00.874+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:02.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:02.094+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:03.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:03.334+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:04.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:04.574+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:05.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:05.778+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:06.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:06.954+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:08.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:08.130+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:09.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:09.350+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:10.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:10.542+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:11.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:11.802+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152216 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:13.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:13.118+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:14.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:14.410+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:15.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:15.630+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:16.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:16.830+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:18.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:18.086+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:19.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:19.338+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152248 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:20.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:20.586+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:21.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:21.814+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:23.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:23.050+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:24.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:24.346+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:25.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:25.514+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:26.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:26.802+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:28.007 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:28.002+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:29.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:29.318+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152288 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:30.553 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:30.542+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:31.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:31.822+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:33.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:33.062+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:34.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:34.366+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:35.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:35.594+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:36.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:36.818+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:38.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:38.026+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:39.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:39.358+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:40.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:40.566+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:41.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:41.825+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:43.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:43.037+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:44.354 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:44.349+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:45.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:45.545+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152990 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:45.890 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:18:45.887+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:18:45.890 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:18:45.887+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:18:45.890 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:18:45.887+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:18:45.890 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:18:45.887+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:18:45.890 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:18:45.887+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:18:45.891 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:18:45.887+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:18:45.891 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:18:45.887+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:18:46.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:46.829+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:48.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:48.053+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 152999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:49.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:49.377+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:50.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:50.581+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:51.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:51.837+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:53.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:53.157+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:54.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:54.361+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:55.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:55.597+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:56.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:56.857+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:58.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:58.121+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:18:59.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:18:59.369+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:00.635 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:00.629+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:01.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:01.897+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:03.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:03.149+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:04.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:04.381+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:05.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:05.637+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:06.873 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:06.869+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:08.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:08.149+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:09.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:09.401+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:10.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:10.649+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:11.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:11.865+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:13.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:13.153+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:14.154 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:19:14.150+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:19:14.155 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:19:14.150+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:19:14.155 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:19:14.150+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:19:14.155 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:19:14.150+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:19:14.155 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:19:14.150+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:19:14.155 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:19:14.150+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:19:14.156 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:19:14.150+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:19:14.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:14.393+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:15.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:15.593+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:16.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:16.861+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:18.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:18.217+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:19.401 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:19.397+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:20.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:20.641+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:21.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:21.873+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:23.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:23.077+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:24.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:24.392+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:25.624 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:25.616+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:26.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:26.884+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:28.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:28.096+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:29.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:29.400+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:30.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:30.672+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:31.884 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:31.876+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:33.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:33.084+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:34.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:34.392+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:35.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:35.572+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:36.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:36.820+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:38.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:38.096+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:39.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:39.408+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:40.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:40.608+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:41.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:41.884+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:43.115 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:43.108+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:44.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:44.400+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:45.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:45.612+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:46.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:46.868+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:48.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:48.160+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153239 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:49.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:49.384+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:50.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:50.680+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:51.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:51.884+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153254 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:53.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:53.204+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:54.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:54.400+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:55.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:55.648+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:56.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:56.880+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:58.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:58.092+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:19:59.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:19:59.404+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:00.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:00.664+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:01.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:01.904+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:03.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:03.112+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:03.260 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:20:03.256+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:20:03.260 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:20:03.256+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:20:03.260 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:20:03.256+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:20:04.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:04.404+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:05.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:05.624+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:06.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:06.904+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:08.191 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:08.183+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:09.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:09.407+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:09.696 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:09.692+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:20:09.697 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:09.692+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:20:09.698 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:09.696+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:20:09.698 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:09.696+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:20:10.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:10.627+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153330 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:11.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:11.903+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:13.269 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:13.263+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153339 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:14.478 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:14.471+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:16.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:16.219+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:17.482 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:17.475+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:19.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:19.047+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:22.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:22.303+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:24.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:24.087+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153379 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:25.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:25.683+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:27.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:27.171+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:28.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:28.823+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153399 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:30.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:30.187+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:31.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:31.507+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:32.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:32.799+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:34.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:34.219+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153419 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:34.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:34.928+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:20:34.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:34.928+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:20:34.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:34.928+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:20:34.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:34.928+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:20:34.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:34.928+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:20:34.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:34.928+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:20:34.933 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:20:34.928+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:20:35.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:35.515+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:36.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:36.835+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:38.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:38.071+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:39.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:39.347+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:40.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:40.587+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:41.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:41.835+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:43.146 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:43.139+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:44.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:44.451+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:45.723 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:45.715+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:46.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:46.907+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:48.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:48.111+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153820 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:49.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:49.447+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153875 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:50.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:50.634+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 153924 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:51.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:51.950+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:53.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:53.218+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:54.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:54.470+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:55.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:55.662+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154244 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:56.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:56.950+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:58.241 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:58.234+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:20:59.474 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:20:59.470+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:00.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:00.710+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:01.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:01.938+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154881 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:03.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:03.290+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:04.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:04.478+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 154979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:05.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:05.718+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:06.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:06.962+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:08.227 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:08.222+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:09.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:09.482+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:10.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:10.734+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:11.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:11.974+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:13.240 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:13.234+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155031 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:14.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:14.474+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:15.723 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:15.718+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:16.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:16.958+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:18.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:18.310+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155051 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:19.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:19.562+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:20.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:20.802+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:21.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:21.966+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:23.258 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:23.254+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:24.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:24.502+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155078 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:25.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:25.766+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:26.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:26.982+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:28.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:28.278+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:29.545 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:29.538+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:30.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:30.774+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:32.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:31.998+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:33.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:33.249+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:34.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:34.605+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155118 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:36.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:36.113+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:37.387 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:37.381+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:38.666 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:38.661+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:39.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:39.861+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:41.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:41.113+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:42.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:42.345+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:43.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:43.557+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:44.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:44.801+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:46.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:46.073+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:46.211 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:21:46.206+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:21:46.211 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:21:46.206+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:21:47.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:47.337+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:48.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:48.573+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:49.790 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:49.785+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:51.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:51.037+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:51.863 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:21:51.857+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:21:51.863 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:21:51.857+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:21:51.863 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:21:51.857+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:21:52.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:52.317+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:53.556 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:53.549+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:54.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:54.797+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:56.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:56.025+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:57.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:57.249+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:58.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:58.425+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:21:59.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:21:59.625+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:00.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:00.837+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:02.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:02.061+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:03.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:03.341+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155233 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:04.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:04.597+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:05.814 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:05.809+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155244 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:07.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:07.053+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155248 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:08.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:08.329+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155253 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:09.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:09.617+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:10.845 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:10.841+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:12.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:12.077+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:13.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:13.357+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:14.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:14.541+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:15.078 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:22:15.077+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:22:15.079 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:22:15.077+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:22:15.079 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:22:15.077+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:22:15.085 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:22:15.077+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:22:15.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:15.768+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:17.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:17.016+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155288 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:18.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:18.288+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:19.511 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:19.504+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:20.514 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:22:20.513+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:22:20.515 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:22:20.513+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:22:20.515 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:22:20.513+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:22:20.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:20.760+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:22.008 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:22.000+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:23.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:23.292+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:24.540 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:24.532+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:25.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:25.780+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155324 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:27.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:26.996+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:28.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:28.304+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:29.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:29.688+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155340 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:30.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:30.892+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155344 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:31.231 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:22:31.228+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:22:31.232 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:22:31.228+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:22:32.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:32.108+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:33.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:33.400+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:34.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:34.712+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:35.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:35.956+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155364 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:37.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:37.176+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:38.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:38.352+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:39.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:39.520+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155380 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:40.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:40.692+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155384 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:41.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:41.936+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155384 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:43.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:43.192+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:44.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:44.544+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:45.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:45.812+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:47.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:47.040+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:48.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:48.372+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:49.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:49.616+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:50.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:50.820+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:52.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:52.048+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:53.235 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:53.228+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:54.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:54.552+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:55.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:55.792+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:57.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:57.048+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:58.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:58.276+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:59.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:22:59.547+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:22:59.889 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:22:59.887+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:23:00.478 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:23:00.475+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:23:00.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:00.835+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:02.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:02.063+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:03.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:03.323+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:04.533 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:23:04.531+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:23:04.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:23:04.531+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:23:04.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:23:04.531+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:23:04.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:23:04.531+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:23:04.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:23:04.531+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:23:04.538 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:23:04.531+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:23:04.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:04.559+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:05.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:05.775+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:07.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:07.031+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:08.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:08.283+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155503 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:09.538 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:09.531+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:10.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:10.823+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155515 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:12.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:12.043+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:13.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:13.407+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:14.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:14.623+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:15.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:15.843+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155535 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:17.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:17.063+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:18.348 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:18.339+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155544 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:19.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:19.579+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:20.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:20.835+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155555 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:22.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:22.083+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:23.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:23.371+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:24.599 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:24.591+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:25.819 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:25.811+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:27.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:27.043+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:28.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:28.343+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:29.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:29.571+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:30.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:30.771+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:32.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:32.075+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155599 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:33.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:33.355+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155604 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:34.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:34.587+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:35.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:35.795+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155615 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:37.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:37.071+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:38.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:38.303+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:39.242 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:23:39.238+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:23:39.242 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:23:39.238+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:23:39.242 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:23:39.238+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:23:39.575 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:39.567+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:40.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:40.823+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:42.071 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:42.062+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:43.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:43.362+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:44.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:44.606+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155653 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:45.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:45.830+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:47.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:47.058+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155661 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:48.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:48.250+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155664 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:49.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:49.558+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:50.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:50.790+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:52.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:52.070+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:53.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:53.414+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:54.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:54.674+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:55.880 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:55.874+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:57.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:57.142+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:23:58.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:23:58.390+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:00.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:00.274+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:02.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:02.282+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:03.611 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:03.606+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:04.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:04.918+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:06.250 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:06.246+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:07.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:07.486+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155743 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:08.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:08.810+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:10.149 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:10.146+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155755 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:10.194 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:24:10.189+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:24:10.195 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:24:10.189+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:24:10.529 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:24:10.525+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:24:10.529 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:24:10.525+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:24:10.529 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:24:10.525+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:24:11.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:11.434+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:12.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:12.882+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:14.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:14.126+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:15.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:15.462+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155775 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:16.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:16.706+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:18.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:18.006+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:19.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:19.414+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:20.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:20.778+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:22.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:22.226+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:23.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:23.498+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:24.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:24.797+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155815 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:26.689 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:24:26.685+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:24:26.689 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:24:26.685+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:24:26.689 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:24:26.685+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:24:30.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:30.857+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:32.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:32.317+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:33.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:33.633+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:35.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:35.129+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 155984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:36.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:36.457+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:37.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:37.825+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156064 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:39.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:39.161+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:40.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:40.453+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:41.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:41.781+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:43.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:43.249+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156203 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:44.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:44.521+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:45.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:45.765+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:47.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:47.109+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:48.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:48.449+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:49.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:49.677+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:50.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:50.877+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156416 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:52.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:52.129+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:53.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:53.489+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:54.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:54.769+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:56.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:56.065+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:57.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:57.285+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:58.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:58.553+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:24:59.666 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:24:59.664+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:24:59.667 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:24:59.664+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:24:59.668 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:24:59.664+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:24:59.668 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:24:59.664+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:24:59.668 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:24:59.664+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:24:59.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:24:59.753+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:01.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:01.037+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156689 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:02.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:02.289+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:03.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:03.513+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:04.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:04.773+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:05.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:05.981+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:07.232 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:07.228+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:08.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:08.468+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:09.683 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:09.676+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156911 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:10.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:10.876+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:12.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:12.140+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 156974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:13.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:13.476+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:14.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:14.696+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:15.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:15.920+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:17.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:17.144+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:18.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:18.464+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:19.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:19.692+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:20.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:20.864+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:22.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:22.140+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:23.496 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:23.488+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:24.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:24.684+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:25.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:25.888+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:27.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:27.156+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:28.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:28.480+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:29.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:29.700+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:30.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:30.940+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:32.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:32.172+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:33.484 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:33.476+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:34.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:34.720+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:35.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:35.924+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:37.191 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:37.184+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:38.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:38.508+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:39.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:39.744+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:40.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:40.928+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:42.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:42.188+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:43.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:43.548+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:44.790 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:44.784+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:46.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:46.044+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:47.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:47.244+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:48.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:48.500+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:49.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:49.723+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:50.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:50.991+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:52.232 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:52.223+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:53.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:53.515+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:54.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:54.711+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:55.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:55.939+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:57.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:57.179+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:58.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:58.375+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:25:59.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:25:59.711+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:00.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:00.971+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:02.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:02.231+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:03.542 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:03.535+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:04.795 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:04.787+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:06.036 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:06.027+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:07.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:07.279+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:08.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:08.519+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:09.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:09.703+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:10.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:10.907+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:12.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:12.239+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:13.521 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:13.515+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:14.762 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:14.755+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:15.422 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:15.418+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:26:15.422 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:15.418+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:26:15.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:15.919+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:17.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:17.167+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:18.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:18.411+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157295 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:19.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:19.679+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157302 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:20.449 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:20.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:26:20.449 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:20.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:26:20.449 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:20.442+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:26:20.449 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:20.442+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:26:20.450 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:20.442+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:26:20.450 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:20.442+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:26:20.450 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:26:20.442+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:26:20.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:20.907+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:22.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:22.187+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:23.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:23.427+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:24.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:24.695+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:25.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:25.951+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:27.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:27.203+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157330 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:28.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:28.559+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157335 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:29.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:29.735+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:30.966 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:30.955+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:32.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:32.211+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:33.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:33.554+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:34.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:34.794+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:36.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:36.046+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:37.227 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:37.218+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:38.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:38.602+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:39.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:39.870+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:41.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:41.062+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:42.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:42.286+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:43.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:43.558+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:44.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:44.770+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:46.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:46.058+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:47.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:47.266+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:48.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:48.782+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157415 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:50.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:50.010+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:51.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:51.262+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:52.519 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:52.514+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:53.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:53.774+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:55.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:55.026+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:56.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:56.254+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:57.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:57.518+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:58.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:58.718+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157455 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:26:59.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:26:59.958+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:01.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:01.206+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:02.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:02.450+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:03.755 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:03.750+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:05.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:05.030+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:06.269 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:06.266+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157487 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:07.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:07.462+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157491 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:08.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:08.642+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157496 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:09.838 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:09.834+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157503 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:09.893 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:09.893+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:27:09.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:09.893+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:27:09.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:09.893+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:27:09.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:09.893+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:27:09.895 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:09.893+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:27:09.896 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:09.893+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:27:09.896 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:09.893+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:27:11.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:11.110+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157507 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:12.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:12.282+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:13.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:13.566+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:14.822 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:14.818+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157523 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:15.959 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:15.956+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:27:15.959 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:15.956+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:27:15.964 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:15.960+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:27:15.964 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:15.960+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:27:15.964 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:15.960+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:27:15.964 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:15.960+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:27:15.965 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:15.960+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:27:16.028 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:16.021+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:17.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:17.325+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:18.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:18.601+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:19.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:19.809+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:21.027 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:21.021+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:22.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:22.257+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:23.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:23.581+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157556 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:24.018 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:24.016+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:27:24.022 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:24.020+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:27:24.819 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:24.813+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:26.062 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:26.057+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:27.276 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:27.269+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:28.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:28.605+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:29.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:29.797+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157583 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:31.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:31.065+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:32.332 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:32.325+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:33.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:33.609+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157596 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:34.117 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:34.112+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:27:34.117 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:34.112+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:27:34.117 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:34.112+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:27:34.117 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:34.112+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:27:34.118 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:34.112+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:27:34.118 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:27:34.112+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:27:34.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:34.861+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:36.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:36.073+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:37.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:37.261+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:38.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:38.921+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157616 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:40.183 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:40.177+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:41.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:41.389+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:42.608 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:42.597+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:44.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:44.013+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157636 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:45.250 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:45.245+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:46.472 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:46.469+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:47.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:47.733+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:48.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:48.977+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157661 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:50.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:50.221+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:51.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:51.389+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:52.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:52.593+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:53.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:53.861+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:55.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:55.105+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:56.385 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:56.361+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157692 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:57.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:57.601+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:58.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:58.760+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:27:59.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:27:59.988+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:01.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:01.192+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:02.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:02.376+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:03.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:03.604+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:04.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:04.856+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:06.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:06.092+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157881 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:07.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:07.340+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:08.626 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:08.620+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:09.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:09.808+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:11.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:11.088+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:12.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:12.360+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:13.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:13.616+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:14.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:14.784+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:15.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:15.960+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157921 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:17.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:17.220+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:18.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:18.452+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:19.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:19.800+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:21.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:21.032+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:22.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:22.292+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:23.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:23.508+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:24.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:24.812+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157961 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:26.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:26.008+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157965 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:27.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:27.300+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157969 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:28.624 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:28.616+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:29.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:29.776+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157981 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:31.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:31.032+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:32.301 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:32.288+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:33.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:33.596+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 157994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:34.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:34.812+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:36.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:36.072+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:37.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:37.300+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:38.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:38.624+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:39.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:39.824+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:41.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:41.055+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:42.323 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:42.315+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158029 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:43.656 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:43.647+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:44.922 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:44.915+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:46.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:46.135+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:47.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:47.371+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:48.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:48.663+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:49.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:49.859+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158061 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:51.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:51.115+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:52.301 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:52.295+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:53.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:53.643+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:54.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:54.867+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:56.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:56.071+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:57.318 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:57.311+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:58.228 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:28:58.222+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:28:58.228 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:28:58.222+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:28:58.229 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:28:58.222+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:28:58.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:58.659+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:28:59.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:28:59.915+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:01.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:01.127+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:02.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:02.363+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:03.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:03.655+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:03.931 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:29:03.925+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:29:03.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:29:03.925+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:29:03.932 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:29:03.925+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:29:04.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:04.955+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:06.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:06.179+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:07.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:07.407+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:08.665 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:08.659+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:09.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:09.927+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:11.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:11.159+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:12.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:12.371+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:13.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:13.639+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:14.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:14.851+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:16.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:16.099+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158165 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:17.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:17.351+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:18.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:18.631+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:19.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:19.859+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:21.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:21.079+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:22.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:22.311+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:23.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:23.503+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:24.129 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:29:24.129+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:29:24.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:24.846+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:26.137 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:26.130+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:27.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:27.350+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:28.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:28.666+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:29.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:29.842+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:31.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:31.030+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:32.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:32.342+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:33.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:33.690+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:34.880 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:34.874+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:36.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:36.110+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158245 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:36.786 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:29:36.784+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:29:37.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:37.330+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:38.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:38.546+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:39.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:39.846+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:41.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:41.078+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:42.556 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:42.554+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:43.859 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:43.854+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:45.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:45.134+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:46.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:46.418+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158285 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:47.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:47.670+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:48.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:48.906+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:50.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:50.166+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:51.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:51.358+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158305 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:52.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:52.614+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158309 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:53.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:53.866+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:55.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:55.130+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:56.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:56.342+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158325 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:57.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:57.530+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:58.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:58.714+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:29:59.936 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:29:59.930+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:01.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:01.110+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:02.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:02.366+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:03.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:03.614+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:04.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:04.902+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:06.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:06.154+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:07.374 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:07.353+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:08.090 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:30:08.088+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:30:08.091 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:30:08.088+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:30:08.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:08.565+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:09.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:09.881+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:11.151 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:11.145+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:12.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:12.365+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:13.671 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:13.665+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158399 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:14.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:14.929+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:16.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:16.105+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:17.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:17.361+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:18.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:18.601+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158419 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:20.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:20.009+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:21.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:21.237+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:22.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:22.485+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:23.723 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:23.717+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:24.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:24.921+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:26.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:26.161+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:27.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:27.393+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:28.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:28.721+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:29.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:29.909+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:31.146 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:31.141+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:32.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:32.409+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:33.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:33.945+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158479 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:35.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:35.169+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:36.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:36.401+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:37.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:37.765+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:39.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:39.113+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:40.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:40.353+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:41.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:41.573+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:42.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:42.817+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:44.075 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:44.069+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:45.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:45.297+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:46.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:46.497+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:47.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:47.745+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158535 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:48.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:48.933+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:50.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:50.132+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:50.929 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:30:50.922+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:30:50.929 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:30:50.926+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:30:50.930 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:30:50.926+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:30:50.930 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:30:50.926+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:30:50.930 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:30:50.926+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:30:51.318 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:51.312+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158555 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:52.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:52.548+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:53.884 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:53.876+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:55.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:55.084+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:56.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:56.304+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:57.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:57.556+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:30:58.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:30:58.864+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:00.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:00.032+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:01.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:01.268+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:02.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:02.488+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:03.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:03.740+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 158985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:04.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:04.940+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:06.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:06.120+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:07.434 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:07.428+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:08.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:08.628+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159325 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:09.936 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:09.932+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:11.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:11.180+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:12.408 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:12.404+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:13.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:13.764+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:14.943 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:14.936+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:16.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:16.136+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:17.428 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:17.420+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:18.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:18.604+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:19.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:19.932+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:21.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:21.156+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:22.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:22.424+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:23.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:23.740+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:24.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:24.968+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:26.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:26.152+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:27.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:27.420+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:28.668 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:28.664+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:29.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:29.948+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:31.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:31.220+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:32.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:32.439+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:33.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:33.711+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:34.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:34.939+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:36.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:36.203+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:37.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:37.443+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:38.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:38.923+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:40.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:40.107+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:41.388 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:41.383+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:42.639 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:42.631+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:44.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:44.187+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:45.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:45.455+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:46.696 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:46.687+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:47.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:47.919+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:49.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:49.139+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:50.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:50.343+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:51.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:51.575+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:52.838 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:52.827+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:54.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:54.103+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:55.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:55.275+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159537 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:56.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:56.527+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:57.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:57.747+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:31:59.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:31:59.087+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159550 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:00.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:00.287+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:01.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:01.631+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:03.063 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:03.051+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:04.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:04.295+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:05.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:05.779+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:07.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:07.599+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:09.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:09.007+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:10.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:10.263+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159597 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:11.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:11.599+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159601 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:12.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:12.867+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:14.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:14.251+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159610 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:15.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:15.602+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:19.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:19.490+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:20.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:20.758+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:22.917 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:22.910+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159651 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:24.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:24.362+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:25.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:25.658+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:27.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:27.882+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159671 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:29.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:29.450+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:30.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:30.746+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:32.051 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:32.046+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:33.403 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:33.398+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:34.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:34.850+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:36.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:36.474+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159856 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:38.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:38.254+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159875 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:39.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:39.666+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:41.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:41.046+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:42.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:42.350+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 159977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:43.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:43.750+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160015 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:45.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:45.038+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:46.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:46.790+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:48.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:48.282+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:49.677 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:49.674+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:51.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:51.874+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:53.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:53.242+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:54.918 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:54.914+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:56.412 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:56.406+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:57.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:57.721+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:32:59.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:32:59.033+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:00.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:00.437+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:01.725 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:01.717+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 160483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:14.297 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:14.286+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:33:14.298 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:14.286+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:33:14.298 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:14.286+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:33:14.298 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:14.286+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:33:14.298 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:14.286+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:33:14.298 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:14.286+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:33:14.298 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:14.286+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:33:30.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:30.809+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:32.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:32.257+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:33.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:33.789+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161924 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:35.548 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:35.541+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:36.477 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:36.474+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:33:36.477 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:36.474+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:33:36.479 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:33:36.474+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:33:36.923 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:36.917+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:38.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:38.125+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:39.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:39.317+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:40.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:40.696+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161928 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:41.975 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:41.968+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161929 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:43.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:43.200+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161929 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:44.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:44.464+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161929 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:45.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:45.696+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:46.906 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:46.900+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:48.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:48.172+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:49.374 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:49.368+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:50.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:50.776+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:52.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:52.028+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161936 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:53.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:53.264+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161936 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:54.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:54.484+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:55.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:55.656+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:56.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:56.836+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:58.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:58.028+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:33:59.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:33:59.228+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:00.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:00.520+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 161956 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:01.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:01.872+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162043 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:03.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:03.120+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:04.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:04.448+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:05.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:05.660+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:05.739 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:05.737+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:34:05.740 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:05.737+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:34:06.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:06.860+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:08.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:08.128+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:09.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:09.336+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:10.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:10.600+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:11.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:11.812+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:13.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:13.012+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:14.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:14.280+0000 7f6702f62700 -1 osd.2 109 get_health_metrics reporting 162249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:15.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:15.504+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:16.770 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:16.764+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:18.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:18.044+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:19.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:19.316+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:20.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:20.576+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:21.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:21.776+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:23.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:23.035+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162285 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:24.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:24.283+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:25.527 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:25.519+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:25.938 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:25.932+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:34:25.938 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:25.932+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:34:25.938 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:25.932+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:34:25.939 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:25.932+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:34:26.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:26.731+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:27.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:27.927+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162305 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:28.971 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:28.968+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad4270 2019-12-17T00:34:28.972 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:28.968+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad4750 2019-12-17T00:34:28.972 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:34:28.968+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad79b0 2019-12-17T00:34:29.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:29.183+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:30.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:30.403+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:31.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:31.635+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:32.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:32.875+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162325 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:34.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:34.103+0000 7f6702f62700 -1 osd.2 110 get_health_metrics reporting 162330 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:35.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:35.339+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:36.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:36.583+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:37.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:37.759+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:38.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:38.939+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:40.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:40.123+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:41.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:41.319+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:42.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:42.567+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:43.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:43.919+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:45.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:45.143+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:46.387 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:46.379+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:47.599 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:47.591+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:48.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:48.919+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:50.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:50.207+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:51.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:51.427+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:52.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:52.595+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:53.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:53.943+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:55.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:55.167+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:56.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:56.395+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:57.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:57.643+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:34:58.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:34:58.935+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:00.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:00.223+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:01.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:01.439+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:02.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:02.703+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:03.975 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:03.967+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:05.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:05.235+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:06.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:06.454+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:07.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:07.654+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:08.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:08.946+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162471 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:10.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:10.130+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:11.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:11.334+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:12.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:12.594+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:13.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:13.826+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162491 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:15.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:15.146+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:16.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:16.326+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:17.655 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:17.650+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:18.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:18.962+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:20.197 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:20.186+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:20.411 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:20.407+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:35:20.411 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:20.407+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:35:20.411 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:20.407+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:35:20.411 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:20.407+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:35:20.411 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:20.407+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:35:20.412 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:20.411+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:35:21.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:21.426+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:22.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:22.770+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:24.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:24.006+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:25.204 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:25.198+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:26.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:26.406+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:27.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:27.686+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:28.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:28.978+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:29.537 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:29.535+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:35:29.561 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:29.535+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:35:29.561 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:35:29.535+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:35:30.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:30.246+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:31.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:31.514+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:32.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:32.762+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:34.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:34.066+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:35.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:35.322+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:36.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:36.610+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:37.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:37.858+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:39.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:39.050+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:40.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:40.310+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:41.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:41.542+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162602 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:42.755 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:42.750+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:43.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:43.990+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:45.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:45.250+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:46.504 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:46.498+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:47.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:47.794+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:48.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:48.990+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:50.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:50.173+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:51.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:51.449+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:52.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:52.713+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:53.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:53.965+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:55.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:55.165+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:56.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:56.421+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:57.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:57.689+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:35:58.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:35:58.993+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:00.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:00.189+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:01.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:01.461+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:02.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:02.709+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:04.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:03.997+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:05.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:05.305+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:06.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:06.521+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162710 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:07.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:07.713+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:09.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:09.013+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:10.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:10.217+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:11.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:11.493+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162730 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:12.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:12.709+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:14.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:14.017+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:15.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:15.305+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:16.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:16.521+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:17.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:17.761+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:17.974 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:36:17.969+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:36:17.974 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:36:17.969+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:36:17.975 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:36:17.969+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:36:17.975 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:36:17.969+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:36:17.975 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:36:17.969+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:36:17.975 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:36:17.969+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:36:19.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:19.017+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:20.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:20.237+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162766 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:21.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:21.457+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:22.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:22.685+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:24.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:24.129+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:25.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:25.417+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:26.658 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:26.653+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:27.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:27.929+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:29.135 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:29.129+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:30.365 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:30.361+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:31.559 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:31.553+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:32.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:32.756+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:34.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:34.036+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:35.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:35.288+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:36.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:36.480+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:37.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:37.688+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:39.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:39.012+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:40.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:40.272+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:41.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:41.520+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:42.794 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:42.788+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:44.026 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:44.020+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:45.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:45.272+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:46.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:46.492+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:47.668 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:47.660+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162874 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:48.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:48.964+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:50.214 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:50.208+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:51.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:51.400+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:52.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:52.696+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:54.063 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:54.056+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:55.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:55.324+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:56.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:56.508+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 162962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:57.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:57.708+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163233 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:36:59.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:36:59.012+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:00.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:00.288+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163245 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:01.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:01.564+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:02.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:02.792+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163253 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:04.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:04.072+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163258 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:05.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:05.320+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:06.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:06.608+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:07.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:07.856+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:09.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:09.084+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:10.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:10.252+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163285 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:11.531 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:11.524+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:12.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:12.796+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:14.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:14.096+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:15.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:15.316+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163305 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:16.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:16.519+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163309 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:17.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:17.771+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:19.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:19.223+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:20.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:20.515+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163325 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:21.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:21.775+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:23.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:23.027+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:24.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:24.263+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:25.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:25.571+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:26.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:26.827+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:28.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:28.083+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:29.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:29.359+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:30.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:30.587+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:31.837 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:31.831+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:33.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:33.051+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:34.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:34.279+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:35.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:35.527+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:36.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:36.739+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:37.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:37.979+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:39.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:39.159+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163552 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:40.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:40.347+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:41.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:41.635+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:42.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:42.907+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:43.778 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:37:43.775+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:37:43.778 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:37:43.775+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:37:44.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:44.139+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:45.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:45.399+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:46.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:46.623+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163583 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:47.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:47.819+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:49.071 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:49.063+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:50.301 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:50.287+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163599 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:51.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:51.559+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:52.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:52.759+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:54.031 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:54.023+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:55.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:55.295+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:56.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:56.507+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:57.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:57.763+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:37:59.097 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:37:59.091+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:00.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:00.354+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:01.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:01.562+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:01.701 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:01.699+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:38:01.701 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:01.699+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:38:02.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:02.758+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:04.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:04.078+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:05.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:05.266+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:06.473 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:06.466+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:07.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:07.746+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:09.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:09.086+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:10.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:10.262+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:11.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:11.490+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:12.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:12.754+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:14.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:14.110+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163692 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:15.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:15.338+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:16.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:16.614+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:17.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:17.898+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163707 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:19.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:19.086+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:20.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:20.354+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:21.559 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:21.554+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163723 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:22.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:22.782+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:24.116 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:24.114+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:25.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:25.310+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:26.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:26.510+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163743 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:27.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:27.778+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:27.937 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:27.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:38:27.937 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:27.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:38:27.937 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:27.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:38:29.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:29.086+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:30.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:30.282+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:31.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:31.522+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:32.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:32.774+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:34.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:34.102+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:35.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:35.302+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:36.573 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:36.570+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:37.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:37.754+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163787 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:38.969 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:38.962+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:40.052 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:40.046+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:38:40.052 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:40.046+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:38:40.052 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:38:40.046+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:38:40.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:40.306+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:41.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:41.582+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:42.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:42.805+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:44.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:44.137+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:45.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:45.405+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:46.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:46.641+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:47.856 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:47.849+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:49.131 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:49.125+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163832 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:50.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:50.385+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:51.668 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:51.661+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:52.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:52.869+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163847 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:54.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:54.061+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163852 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:55.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:55.305+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:56.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:56.545+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:57.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:57.797+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:38:58.528 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:38:58.525+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:38:58.528 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:38:58.525+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:38:59.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:38:59.117+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163872 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:00.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:00.341+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:01.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:01.565+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163883 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:02.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:02.769+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:04.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:04.065+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:05.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:05.337+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:06.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:06.545+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163903 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:07.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:07.797+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:09.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:09.141+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163912 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:10.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:10.369+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163919 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:11.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:11.553+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163923 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:12.814 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:12.809+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:14.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:14.117+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:15.511 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:15.505+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:16.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:16.721+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:17.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:17.909+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:19.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:19.133+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163952 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:20.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:20.457+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:20.741 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:39:20.736+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:39:20.741 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:39:20.736+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:39:20.741 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:39:20.736+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:39:20.742 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:39:20.736+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:39:20.742 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:39:20.736+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:39:20.742 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:39:20.736+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:39:21.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:21.681+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:22.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:22.929+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:24.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:24.161+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:25.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:25.437+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:26.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:26.692+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:27.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:27.968+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163987 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:29.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:29.240+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:30.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:30.464+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 163999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:31.743 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:31.736+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:32.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:32.988+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164007 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:34.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:34.228+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:35.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:35.680+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:36.959 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:36.952+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:38.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:38.172+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:39.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:39.372+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:40.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:40.604+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:41.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:41.828+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164043 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:43.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:43.096+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164047 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:44.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:44.392+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:45.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:45.840+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:47.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:47.072+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:48.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:48.264+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164067 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:49.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:49.448+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164072 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:50.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:50.672+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:51.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:51.880+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164083 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:53.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:53.120+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164087 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:54.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:54.364+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164092 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:55.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:55.652+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:56.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:56.856+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164103 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:58.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:58.068+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164107 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:39:59.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:39:59.320+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164112 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:00.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:00.548+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:01.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:01.792+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:02.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:02.976+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:04.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:04.192+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164132 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:05.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:05.444+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164139 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:06.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:06.684+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164143 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:07.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:07.904+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:08.202 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:08.191+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:40:08.202 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:08.195+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:40:08.202 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:08.195+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:40:08.202 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:08.195+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:40:08.203 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:08.195+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:40:08.203 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:08.195+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:40:08.203 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:08.195+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:40:09.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:09.179+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164152 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:10.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:10.419+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:11.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:11.699+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:12.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:12.971+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:14.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:14.183+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164172 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:15.408 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:15.399+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:16.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:16.699+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:17.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:17.927+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:19.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:19.187+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:20.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:20.399+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:21.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:21.643+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164203 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:22.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:22.855+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:24.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:24.087+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:25.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:25.395+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:26.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:26.591+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:27.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:27.847+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:29.222 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:29.215+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:30.468 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:30.459+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164239 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:31.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:31.723+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164243 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:32.984 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:32.979+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:34.204 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:34.195+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:35.412 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:35.407+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164259 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:36.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:36.635+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164263 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:37.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:37.867+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:38.508 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:38.502+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:40:38.508 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:40:38.502+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:40:39.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:39.219+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:40.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:40.511+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:41.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:41.767+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164283 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:42.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:42.951+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:44.214 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:44.207+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:45.485 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:45.479+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164299 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:46.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:46.691+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:47.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:47.927+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:49.251 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:49.243+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:50.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:50.523+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:51.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:51.791+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164323 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:52.989 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:52.978+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:54.232 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:54.226+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:55.464 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:55.446+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:56.730 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:56.722+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:57.917 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:57.906+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:40:59.222 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:40:59.214+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:00.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:00.430+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:01.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:01.650+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:02.884 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:02.878+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:04.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:04.094+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:05.419 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:05.414+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:06.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:06.702+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:07.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:07.970+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:09.236 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:09.230+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:10.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:10.426+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:11.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:11.602+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164409 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:12.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:12.890+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:14.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:14.230+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:15.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:15.430+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:16.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:16.626+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164429 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:17.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:17.894+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:19.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:19.222+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:20.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:20.518+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:21.790 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:21.786+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:23.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:22.998+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:24.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:24.258+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:24.939 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:24.937+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:41:24.939 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:24.937+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:41:24.939 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:24.937+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:41:24.940 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:24.937+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:41:25.504 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:25.498+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:26.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:26.734+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:27.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:27.926+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:29.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:29.346+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:30.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:30.630+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:31.907 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:31.902+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:33.131 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:33.126+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:34.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:34.350+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:35.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:35.557+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:36.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:36.769+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:37.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:37.985+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:39.268 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:39.261+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:40.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:40.497+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:41.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:41.773+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:43.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:43.005+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:44.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:44.269+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:45.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:45.509+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:46.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:46.777+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164549 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:48.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:47.997+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:49.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:49.257+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:50.519 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:50.513+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:51.722 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:51.717+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:52.209 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:41:52.208+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25dc560 2019-12-17T00:41:52.209 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:41:52.208+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2684340 2019-12-17T00:41:52.209 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:41:52.208+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:41:52.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:52.973+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164573 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:54.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:54.197+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:55.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:55.429+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:56.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:56.653+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:57.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:57.929+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:59.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:41:59.265+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:41:59.289 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:59.284+0000 7fb660f13700 -1 reset not still connected to 0x55f63dbc0a40 2019-12-17T00:41:59.289 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:59.284+0000 7fb660f13700 -1 reset not still connected to 0x55f63ec05a80 2019-12-17T00:41:59.289 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:59.284+0000 7fb660f13700 -1 reset not still connected to 0x55f63f13e490 2019-12-17T00:41:59.290 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:59.284+0000 7fb660f13700 -1 reset not still connected to 0x55f6405249c0 2019-12-17T00:41:59.290 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:59.284+0000 7fb660f13700 -1 reset not still connected to 0x55f640527810 2019-12-17T00:41:59.290 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:59.284+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad5380 2019-12-17T00:41:59.290 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:41:59.284+0000 7fb660f13700 -1 reset not still connected to 0x55f640ad6490 2019-12-17T00:42:00.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:00.445+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:01.722 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:01.717+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164609 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:02.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:02.921+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:04.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:04.273+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:05.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:05.509+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:06.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:06.757+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:07.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:07.945+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:09.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:09.269+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:10.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:10.501+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:11.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:11.761+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:12.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:12.957+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:13.423 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:42:13.420+0000 7fb64eb0f700 -1 osd.0 pg_epoch: 99 pg[2.11( v 99'2736 (0'0,99'2736] local-lis/les=13/14 n=33 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [0,1] r=0 lpr=13 luod=99'2734 crt=99'2733 lcod 99'2733 mlcod 99'2733 active+clean] bad op order, already applied 43284313 > this 43284217 2019-12-17T00:42:13.423 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:42:13.420+0000 7fb650312700 -1 osd.0 pg_epoch: 99 pg[2.26( v 99'3181 (28'100,99'3181] local-lis/les=13/14 n=26 ec=13/13 lis/c=13/13 les/c/f=14/14/0 sis=13) [0,2] r=0 lpr=13 luod=99'3178 crt=99'3177 lcod 99'3177 mlcod 99'3177 active+clean] bad op order, already applied 43284312 > this 43284218 2019-12-17T00:42:13.543 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fb64eb0f700 time 2019-12-17T00:42:13.424117+0000 2019-12-17T00:42:13.543 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T00:42:13.543 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T00:42:13.544 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55f62f835140] 2019-12-17T00:42:13.544 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55f62fa11729] 2019-12-17T00:42:13.544 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55f62fa15660] 2019-12-17T00:42:13.544 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55f62fa20761] 2019-12-17T00:42:13.544 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55f62f8a667b] 2019-12-17T00:42:13.544 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55f62fb00817] 2019-12-17T00:42:13.545 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55f62f8c2b0c] 2019-12-17T00:42:13.545 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55f62ff0247c] 2019-12-17T00:42:13.545 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55f62ff056d0] 2019-12-17T00:42:13.545 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 10: (()+0x76db) [0x7fb6722586db] 2019-12-17T00:42:13.545 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 11: (clone()+0x3f) [0x7fb670ff888f] 2019-12-17T00:42:13.545 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:*** Caught signal (Aborted) ** 2019-12-17T00:42:13.546 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: in thread 7fb64eb0f700 thread_name:tp_osd_tp 2019-12-17T00:42:13.546 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:2019-12-17T00:42:13.536+0000 7fb64eb0f700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fb64eb0f700 time 2019-12-17T00:42:13.424117+0000 2019-12-17T00:42:13.546 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T00:42:13.546 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 2019-12-17T00:42:13.546 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T00:42:13.546 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55f62f835140] 2019-12-17T00:42:13.546 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55f62fa11729] 2019-12-17T00:42:13.547 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55f62fa15660] 2019-12-17T00:42:13.547 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55f62fa20761] 2019-12-17T00:42:13.547 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55f62f8a667b] 2019-12-17T00:42:13.547 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55f62fb00817] 2019-12-17T00:42:13.547 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55f62f8c2b0c] 2019-12-17T00:42:13.547 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55f62ff0247c] 2019-12-17T00:42:13.550 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55f62ff056d0] 2019-12-17T00:42:13.550 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 10: (()+0x76db) [0x7fb6722586db] 2019-12-17T00:42:13.550 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 11: (clone()+0x3f) [0x7fb670ff888f] 2019-12-17T00:42:13.551 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 2019-12-17T00:42:13.551 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fb650312700 time 2019-12-17T00:42:13.424620+0000 2019-12-17T00:42:13.551 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T00:42:13.551 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T00:42:13.551 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55f62f835140] 2019-12-17T00:42:13.551 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55f62fa11729] 2019-12-17T00:42:13.551 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55f62fa15660] 2019-12-17T00:42:13.552 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55f62fa20761] 2019-12-17T00:42:13.552 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55f62f8a667b] 2019-12-17T00:42:13.552 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55f62fb00817] 2019-12-17T00:42:13.552 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55f62f8c2b0c] 2019-12-17T00:42:13.552 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55f62ff0247c] 2019-12-17T00:42:13.552 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55f62ff056d0] 2019-12-17T00:42:13.552 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 10: (()+0x76db) [0x7fb6722586db] 2019-12-17T00:42:13.553 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr: 11: (clone()+0x3f) [0x7fb670ff888f] 2019-12-17T00:42:14.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:14.273+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:14.587 INFO:tasks.ceph.cluster2.osd.0.smithi177.stderr:daemon-helper: command crashed with signal 6 2019-12-17T00:42:15.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:15.473+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:16.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:16.741+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:17.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:17.933+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:19.239 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:19.232+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:20.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:20.488+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:21.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:21.740+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:23.008 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:23.000+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:24.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:24.816+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:26.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:26.072+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:27.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:27.332+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164710 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:28.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:28.580+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:29.850 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:29.844+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:31.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:31.040+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:32.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:32.252+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164730 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:33.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:33.492+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:34.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:34.728+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:35.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:35.956+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:37.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:37.176+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:38.438 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:38.432+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:39.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:39.828+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:41.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:41.076+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164766 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:42.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:42.308+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:43.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:43.576+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:44.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:44.776+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:45.334 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:42:45.331+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e9330 2019-12-17T00:42:45.334 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:42:45.331+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25da1a0 2019-12-17T00:42:45.334 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:42:45.331+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2871790 2019-12-17T00:42:45.334 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:42:45.331+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2a2ecb0 2019-12-17T00:42:45.334 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:42:45.331+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2b7f6c0 2019-12-17T00:42:45.335 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:42:45.331+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81dc0 2019-12-17T00:42:45.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:45.980+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:47.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:47.228+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:48.485 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:48.480+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:49.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:49.856+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:51.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:51.088+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:52.326 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:52.320+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:53.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:53.580+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:54.770 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:54.764+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:55.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:55.968+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:57.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:57.184+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:58.401 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:58.396+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:42:59.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:42:59.668+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:00.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:00.936+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:02.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:02.123+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:03.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:03.327+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:04.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:04.531+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:05.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:05.759+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:07.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:07.015+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:08.205 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:08.199+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164874 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:09.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:09.391+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:10.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:10.623+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:11.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:11.863+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:13.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:13.051+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:14.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:14.315+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:15.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:15.543+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:16.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:16.739+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:17.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:17.975+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:19.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:19.171+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:19.677 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:19.674+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25da1a0 2019-12-17T00:43:19.677 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:19.674+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2871790 2019-12-17T00:43:19.677 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:19.674+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2a2ecb0 2019-12-17T00:43:19.677 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:19.674+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2b7f6c0 2019-12-17T00:43:19.681 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:19.674+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81dc0 2019-12-17T00:43:20.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:20.499+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:21.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:21.759+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:23.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:22.995+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:24.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:24.227+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:25.522 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:25.511+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:26.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:26.751+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:28.007 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:27.999+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:29.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:29.359+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:30.561 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:30.551+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:31.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:31.831+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:33.087 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:33.079+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:34.365 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:34.359+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:35.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:35.587+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:36.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:36.815+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164990 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:38.036 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:38.031+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:39.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:39.351+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 164999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:40.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:40.615+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:40.873 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:40.869+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1946f70 2019-12-17T00:43:40.873 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:40.869+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25da4e0 2019-12-17T00:43:40.873 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:40.869+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2a2ca90 2019-12-17T00:43:40.873 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:40.869+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2b7f380 2019-12-17T00:43:40.874 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:43:40.869+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:43:41.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:41.879+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:43.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:43.087+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:44.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:44.366+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:45.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:45.578+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:46.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:46.810+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:48.071 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:48.062+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:49.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:49.330+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:50.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:50.522+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:51.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:51.794+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:53.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:53.054+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:54.316 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:54.314+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:55.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:55.530+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:56.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:56.782+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:58.028 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:58.018+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:43:59.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:43:59.250+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:00.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:00.574+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:01.793 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:01.790+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:03.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:03.042+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:04.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:04.370+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:05.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:05.590+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:06.893 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:06.886+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:08.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:08.238+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:09.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:09.454+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:10.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:10.698+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:11.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:11.906+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:13.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:13.130+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:14.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:14.406+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165139 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:15.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:15.698+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:16.943 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:16.938+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:18.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:18.122+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:19.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:19.390+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:20.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:20.582+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:21.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:21.786+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:23.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:23.114+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:24.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:24.394+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:25.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:25.670+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:26.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:26.946+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:28.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:28.217+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:29.428 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:29.421+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:30.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:30.605+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:31.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:31.837+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:33.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:33.053+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:34.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:34.361+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:35.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:35.585+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:36.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:36.825+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:38.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:38.069+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:39.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:39.397+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:40.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:40.585+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165254 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:41.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:41.801+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165258 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:43.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:43.049+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:44.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:44.377+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:45.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:45.569+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:46.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:46.793+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:48.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:48.073+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:49.430 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:49.425+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:50.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:50.681+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:51.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:51.969+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:53.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:53.209+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:54.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:54.429+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:55.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:55.637+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:56.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:56.889+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:58.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:58.129+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165330 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:44:59.372 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:44:59.369+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165335 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:00.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:00.625+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:01.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:01.809+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:03.097 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:03.093+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:04.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:04.421+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:05.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:05.697+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:06.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:06.961+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:08.175 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:08.165+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:09.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:09.405+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:10.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:10.648+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:11.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:11.920+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:13.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:13.172+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:13.766 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:45:13.755+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b13e9330 2019-12-17T00:45:13.769 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:45:13.755+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25da1a0 2019-12-17T00:45:13.770 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:45:13.755+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2871790 2019-12-17T00:45:13.770 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:45:13.755+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2b7f6c0 2019-12-17T00:45:13.770 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:45:13.755+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81dc0 2019-12-17T00:45:14.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:14.424+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:15.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:15.684+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:16.959 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:16.952+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:18.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:18.136+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:19.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:19.432+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165415 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:20.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:20.648+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:21.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:21.932+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:23.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:23.164+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:24.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:24.416+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:25.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:25.640+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:26.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:26.892+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:28.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:28.076+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:29.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:29.284+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165455 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:30.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:30.624+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:31.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:31.904+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:33.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:33.088+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:34.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:34.436+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:35.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:35.708+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:37.027 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:37.020+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:38.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:38.248+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:39.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:39.472+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165495 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:40.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:40.700+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:41.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:41.932+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:43.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:43.148+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:44.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:44.476+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165515 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:45.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:45.736+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165523 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:46.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:46.948+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:48.240 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:48.232+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165531 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:49.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:49.492+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:50.756 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:50.748+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:52.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:52.020+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:53.274 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:53.268+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:54.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:54.575+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165556 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:55.846 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:55.839+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:57.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:57.099+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:58.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:58.351+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:45:59.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:45:59.623+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:00.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:00.831+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165583 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:02.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:02.055+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:03.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:03.263+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:04.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:04.519+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165596 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:05.734 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:05.719+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:06.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:06.903+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:08.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:08.147+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:09.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:09.471+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165616 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:10.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:10.735+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:11.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:11.979+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:13.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:13.195+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:14.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:14.479+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165636 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:15.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:15.667+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:16.892 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:16.883+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:18.135 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:18.127+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165651 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:19.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:19.331+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:20.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:20.647+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:21.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:21.903+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:23.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:23.123+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165671 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:24.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:24.451+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:25.668 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:25.663+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:26.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:26.867+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:28.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:28.139+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165691 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:29.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:29.479+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:30.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:30.679+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:31.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:31.947+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165707 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:33.137 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:33.131+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165711 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:34.489 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:34.479+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:35.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:35.743+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165723 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:37.036 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:37.026+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:38.227 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:38.218+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:39.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:39.518+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165736 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:40.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:40.782+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165743 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:42.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:42.350+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:43.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:43.594+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165751 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:44.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:44.818+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165756 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:46.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:46.082+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:47.307 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:47.302+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:48.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:48.574+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165771 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:49.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:49.766+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165776 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:50.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:50.950+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:52.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:52.210+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165787 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:53.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:53.490+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:54.736 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:54.730+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165796 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:56.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:56.322+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:57.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:57.606+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:46:58.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:46:58.862+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:00.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:00.098+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165816 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:01.341 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:01.338+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:02.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:02.538+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:03.755 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:03.750+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165831 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:04.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:04.982+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165836 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:06.240 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:06.238+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:07.474 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:07.470+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165847 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:08.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:08.678+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:09.877 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:47:09.876+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2871790 2019-12-17T00:47:09.878 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:47:09.876+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2b7f6c0 2019-12-17T00:47:09.878 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:47:09.876+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81dc0 2019-12-17T00:47:09.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:09.874+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165856 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:11.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:11.110+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:12.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:12.354+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:13.543 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:13.538+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165871 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:14.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:14.814+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:16.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:16.010+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165883 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:17.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:17.394+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:18.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:18.586+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:19.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:19.793+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:21.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:21.041+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:22.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:22.761+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165908 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:24.001 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:23.993+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165912 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:25.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:25.189+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 165917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:26.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:26.445+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:27.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:27.745+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:28.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:28.993+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:30.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:30.221+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:31.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:31.469+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:32.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:32.733+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:33.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:33.981+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:35.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:35.161+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:36.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:36.365+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166118 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:37.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:37.625+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:38.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:38.913+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:40.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:40.177+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:41.430 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:41.425+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:42.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:42.625+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:43.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:43.837+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:45.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:45.101+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:46.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:46.389+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:47.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:47.677+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:48.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:48.933+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:50.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:50.209+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:51.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:51.485+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:52.762 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:52.753+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:53.289 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:47:53.286+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b1946f70 2019-12-17T00:47:53.289 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:47:53.286+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2b7f380 2019-12-17T00:47:53.290 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:47:53.286+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:47:53.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:53.993+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:55.258 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:55.249+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:56.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:56.533+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:57.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:57.761+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:47:59.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:47:59.061+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:00.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:00.329+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:01.547 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:01.541+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166218 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:02.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:02.832+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:04.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:04.172+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:05.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:05.416+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:06.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:06.700+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:08.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:08.036+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:09.360+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:10.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:10.628+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:11.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:11.880+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:13.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:13.228+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:14.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:14.568+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:15.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:15.740+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:16.529 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:48:16.526+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b25da4e0 2019-12-17T00:48:16.529 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:48:16.526+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2a2ca90 2019-12-17T00:48:16.529 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:48:16.526+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2b7f380 2019-12-17T00:48:16.529 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:48:16.526+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:48:16.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:16.972+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:18.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:18.220+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166288 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:19.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:19.420+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:20.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:20.752+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:22.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:21.996+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:23.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:23.248+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:24.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:24.600+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:25.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:25.784+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:27.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:27.020+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166324 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:28.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:28.240+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:29.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:29.604+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:30.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:30.832+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166340 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:32.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:32.112+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166344 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:33.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:33.332+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:34.587 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:34.580+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:35.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:35.848+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:37.131 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:37.124+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166364 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:38.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:38.340+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:39.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:39.624+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:40.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:40.860+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166380 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:42.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:42.096+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166384 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:43.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:43.324+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:44.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:44.576+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:45.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:45.767+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166400 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:47.009 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:47.003+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:48.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:48.259+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:49.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:49.583+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:50.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:50.771+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166420 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:52.026 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:52.019+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:53.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:53.271+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:54.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:54.607+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:55.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:55.867+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166440 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:57.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:57.055+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:58.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:58.323+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:48:59.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:48:59.591+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:00.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:00.879+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:02.139 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:02.131+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166464 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:03.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:03.383+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166468 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:04.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:04.643+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:05.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:05.819+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166480 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:07.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:07.087+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:08.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:08.347+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:09.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:09.619+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:10.822 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:10.815+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:12.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:12.067+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:13.547 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:13.539+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:14.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:14.747+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:16.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:16.031+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166520 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:17.269 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:17.263+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:18.473 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:18.467+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:19.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:19.711+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:20.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:20.955+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:22.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:22.187+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166544 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:23.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:23.571+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:24.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:24.783+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:26.009 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:26.003+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166560 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:27.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:27.223+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:28.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:28.507+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:29.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:29.702+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166573 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:30.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:30.954+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:32.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:32.178+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:33.474 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:33.466+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:34.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:34.742+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:36.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:35.998+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:37.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:37.258+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166604 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:38.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:38.502+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166611 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:39.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:39.702+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:40.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:40.894+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:42.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:42.078+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:43.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:43.290+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:44.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:44.634+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:45.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:45.910+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166644 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:47.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:47.090+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:48.323 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:48.318+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:49.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:49.630+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:50.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:50.878+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166664 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:52.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:52.062+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:53.291 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:53.286+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:54.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:54.626+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:55.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:55.846+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:57.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:57.130+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:58.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:58.478+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166692 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:49:59.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:49:59.710+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:00.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:00.890+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166704 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:02.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:02.118+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:03.386 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:03.382+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:04.660 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:04.650+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:05.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:05.838+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166724 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:07.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:07.054+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:08.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:08.306+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:09.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:09.658+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166737 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:10.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:10.874+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166744 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:12.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:12.125+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:13.403 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:13.397+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:14.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:14.665+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166757 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:15.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:15.941+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:17.240 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:17.237+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:18.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:18.421+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:19.658 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:19.653+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:20.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:20.897+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166784 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:22.158 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:22.153+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:23.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:23.325+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166792 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:24.540 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:24.533+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:25.845 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:25.841+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:27.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:27.109+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:28.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:28.389+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:29.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:29.701+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:30.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:30.933+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:32.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:32.141+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:33.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:33.381+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166837 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:34.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:34.689+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:35.989 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:35.981+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:37.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:37.225+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:38.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:38.425+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166857 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:39.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:39.689+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:40.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:40.897+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:42.184 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:42.173+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:43.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:43.425+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:44.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:44.697+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:45.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:45.977+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:47.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:47.257+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:48.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:48.549+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:49.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:49.761+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:51.032 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:51.029+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:52.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:52.333+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:53.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:53.609+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:54.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:54.876+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:56.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:56.108+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166929 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:57.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:57.356+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:58.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:58.544+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:50:59.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:50:59.808+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:01.047 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:01.040+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:02.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:02.296+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:03.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:03.508+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:04.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:04.768+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:05.975 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:05.968+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166969 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:07.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:07.240+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:08.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:08.444+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:09.697 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:09.688+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:10.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:10.964+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:12.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:12.256+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166993 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:13.521 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:13.516+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 166997 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:14.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:14.768+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:16.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:16.000+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:17.283 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:17.276+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:18.547 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:18.540+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:19.755 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:19.748+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:20.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:20.952+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167029 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:22.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:22.220+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167033 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:23.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:23.444+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:24.736 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:24.732+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:25.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:25.968+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:27.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:27.212+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:28.509 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:28.504+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:29.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:29.728+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:30.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:30.940+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:32.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:32.396+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:33.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:33.684+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:34.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:34.864+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:36.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:36.116+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:37.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:37.344+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:38.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:38.575+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:39.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:39.827+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:41.075 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:41.067+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:42.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:42.251+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:43.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:43.499+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167117 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:44.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:44.715+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:45.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:45.927+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:47.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:47.107+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:48.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:48.387+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:49.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:49.719+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:50.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:50.891+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:52.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:52.083+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:53.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:53.375+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:54.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:54.719+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:55.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:55.899+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:57.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:57.155+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:58.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:58.419+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:51:59.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:51:59.735+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:00.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:00.971+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:02.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:02.235+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167203 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:03.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:03.435+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:04.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:04.743+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:05.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:05.971+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:07.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:07.431+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:08.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:08.639+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:09.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:09.835+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:11.299 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:11.291+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167239 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:12.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:12.583+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167243 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:13.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:13.835+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:15.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:15.075+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:16.350 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:16.343+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167259 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:17.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:17.599+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167263 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:18.848 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:18.843+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:20.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:20.115+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:21.372 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:21.366+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:22.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:22.774+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167283 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:24.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:24.030+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:24.944 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:52:24.943+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:52:24.945 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:52:24.943+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:52:25.268 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:25.262+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:26.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:26.486+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167299 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:27.753 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:27.746+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:29.015 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:29.006+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:30.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:30.246+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:31.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:31.518+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:32.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:32.762+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167323 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:33.040 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:52:33.027+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:52:33.040 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:52:33.031+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:52:33.040 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:52:33.031+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:52:33.040 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:52:33.031+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:52:33.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:33.974+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:35.241 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:35.238+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:36.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:36.494+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167339 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:37.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:37.846+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167343 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:39.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:39.114+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:40.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:40.366+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167352 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:41.579 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:41.574+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:42.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:42.818+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167363 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:44.030 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:44.026+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:45.214 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:45.210+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:46.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:46.414+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167379 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:47.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:47.694+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167383 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:48.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:48.966+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:50.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:50.250+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167392 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:51.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:51.446+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167399 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:52.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:52.682+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:53.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:53.958+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:55.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:55.186+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:56.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:56.458+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167419 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:57.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:57.774+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167423 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:52:59.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:52:59.014+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167427 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:00.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:00.222+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:01.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:01.410+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:02.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:02.614+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167443 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:03.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:03.925+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167447 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:05.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:05.173+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167452 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:06.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:06.361+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:07.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:07.557+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167463 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:08.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:08.805+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:10.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:10.029+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:11.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:11.233+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:12.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:12.425+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:13.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:13.649+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:14.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:14.909+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:16.131 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:16.125+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:17.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:17.369+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:18.506 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.501+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:53:18.510 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T00:53:18.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T00:53:18.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:53:18.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:53:18.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:53:18.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:53:18.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T00:53:18.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:53:18.512 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:18.505+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:53:18.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:18.609+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:19.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:19.833+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:21.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:21.085+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:22.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:22.341+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:23.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:23.581+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:24.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:24.861+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:25.554 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:25.549+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T00:53:25.554 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:25.549+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:53:25.554 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:25.549+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:53:25.554 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:25.549+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:53:25.555 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:25.553+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T00:53:25.557 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:25.553+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:53:26.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:26.113+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:27.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:27.365+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:28.601+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:29.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:29.865+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167556 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:30.619 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:30.617+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:53:30.620 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:30.621+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:53:30.620 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:30.621+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:53:31.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:31.101+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:32.316 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:32.313+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:33.639 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:33.637+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:53:33.639 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:33.637+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T00:53:33.639 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:33.637+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T00:53:33.640 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:33.637+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:53:33.640 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:33.637+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:53:33.640 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:33.637+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:53:33.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:33.697+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:34.943 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:34.937+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:36.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:36.189+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167583 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:37.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:37.457+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:38.708 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:38.705+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:39.711 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.709+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:53:39.712 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.709+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:53:39.712 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.709+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:53:39.712 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.709+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T00:53:39.713 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.713+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T00:53:39.714 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.713+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:53:39.714 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.713+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:53:39.714 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:39.713+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:53:39.983 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:39.977+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:41.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:41.237+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:42.509 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:42.497+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167621 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:43.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:43.733+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:44.754 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:44.753+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:53:44.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:44.929+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:46.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:46.164+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:47.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:47.404+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:47.793 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:47.789+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T00:53:47.793 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:47.789+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:53:47.793 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:47.793+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:53:47.794 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:47.793+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T00:53:47.794 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:47.793+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:53:48.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:48.640+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167645 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:49.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:49.924+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:50.817 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:50.816+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:53:50.817 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:53:50.816+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:53:51.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:51.116+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:52.365 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:52.360+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167661 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:53.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:53.588+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167665 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:54.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:54.848+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:56.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:56.084+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:57.299 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:57.292+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:58.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:58.508+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167685 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:53:59.848 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:53:59.844+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:01.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:01.028+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:02.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:02.236+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:03.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:03.488+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:04.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:04.692+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:04.959 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:04.956+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:54:04.963 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:04.960+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:54:04.964 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:04.960+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:54:05.964 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:05.964+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T00:54:05.964 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:05.964+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:54:05.965 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:05.964+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:54:05.966 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:05.964+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:54:06.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:06.020+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:07.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:07.304+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167729 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:08.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:08.528+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:09.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:09.820+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:11.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:11.044+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:12.304 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:12.300+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:13.587 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:13.580+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:14.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:14.856+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:16.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:16.092+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167765 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:17.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:17.340+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167769 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:18.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:18.592+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:19.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:19.860+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:21.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:21.096+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:22.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:22.364+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167789 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:23.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:23.628+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:24.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:24.864+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:26.139 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:26.132+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167805 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:27.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:27.352+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167809 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:28.599 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:28.591+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:29.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:29.867+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:31.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:31.107+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:32.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:32.335+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:33.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:33.715+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:34.591 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T00:54:34.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3bae750 2019-12-17T00:54:34.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:34.943+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:36.131 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:36.123+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167845 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:36.258 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:36.255+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T00:54:36.258 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:36.255+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:54:36.258 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:36.255+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:54:36.259 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:36.255+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:54:36.259 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:36.255+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:54:37.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:37.331+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:38.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:38.587+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:39.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:39.863+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:41.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:41.067+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167865 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:42.304 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:42.299+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:43.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:43.543+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:44.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:44.867+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167878 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:46.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:46.123+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:47.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:47.331+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:48.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:48.599+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:49.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:49.875+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:51.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:51.139+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:52.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:52.339+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:53.418 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:53.415+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:54:53.418 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:53.415+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T00:54:53.419 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:53.415+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T00:54:53.419 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:53.415+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:54:53.419 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:53.415+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:54:53.420 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:53.415+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:54:53.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:53.563+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:54.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:54.859+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:55.453 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:55.451+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:54:55.459 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:55.451+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T00:54:55.459 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:55.451+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T00:54:55.459 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:55.451+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:54:55.459 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:55.451+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:54:55.459 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:54:55.451+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:54:56.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:56.063+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:57.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:57.243+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167929 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:58.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:58.531+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:54:59.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:54:59.831+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:01.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:01.039+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:02.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:02.259+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:03.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:03.547+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:04.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:04.819+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:06.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:06.055+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167965 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:07.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:07.279+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167969 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:08.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:08.563+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:09.894 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:09.887+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:10.578 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:10.574+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T00:55:10.579 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:10.574+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:55:10.580 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:10.578+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:55:10.580 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:10.578+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:55:11.175 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:11.166+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:11.615 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:11.610+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T00:55:11.615 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:11.610+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:55:11.616 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:11.610+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:55:11.616 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:55:11.610+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:55:12.430 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:12.422+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:13.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:13.638+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167993 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:14.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:14.902+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 167998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:16.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:16.158+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:17.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:17.414+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:18.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:18.610+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:19.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:19.910+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:21.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:21.154+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:22.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:22.390+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168029 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:23.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:23.694+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168033 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:24.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:24.894+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:26.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:26.150+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:27.441 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:27.434+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:28.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:28.610+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:29.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:29.902+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:31.101 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:31.098+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:32.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:32.398+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:33.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:33.634+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:34.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:34.906+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168078 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:36.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:36.098+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:37.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:37.318+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:38.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:38.574+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:39.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:39.910+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:41.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:41.178+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:42.434 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:42.430+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:43.665 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:43.662+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:44.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:44.914+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168118 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:46.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:46.134+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:47.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:47.374+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:48.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:48.582+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:49.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:49.906+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:51.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:51.150+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:52.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:52.438+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:53.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:53.629+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:54.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:54.913+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168160 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:56.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:56.149+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:57.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:57.409+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:58.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:58.685+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:55:59.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:55:59.953+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168180 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:01.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:01.177+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:02.438 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:02.433+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:03.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:03.705+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:04.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:04.921+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168200 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:06.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:06.113+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:07.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:07.369+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:08.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:08.589+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:09.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:09.937+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:11.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:11.149+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:12.206 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:12.204+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T00:56:12.206 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:12.204+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:56:12.207 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:12.204+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:56:12.207 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:12.204+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:56:12.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:12.361+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:13.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:13.769+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:15.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:15.029+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:16.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:16.265+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:17.527 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:17.521+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:18.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:18.741+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:19.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:19.977+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:21.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:21.257+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:22.484 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:22.481+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:23.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:23.821+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:25.110 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:25.105+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:25.333 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:25.328+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:56:26.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:26.333+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:27.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:27.601+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:28.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:28.809+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168295 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:29.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:29.993+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:31.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:31.261+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:32.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:32.449+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:33.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:33.705+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:34.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:34.969+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:36.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:36.280+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:37.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:37.628+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168331 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:38.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:38.984+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168335 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:40.241 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:40.236+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168340 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:41.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:41.524+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:42.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:42.824+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:44.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:44.084+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:45.431 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:45.424+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168360 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:46.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:46.764+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:48.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:48.116+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:48.564 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:48.563+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:56:48.565 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:48.563+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T00:56:48.565 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:48.563+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:56:48.565 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:48.563+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:56:48.571 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:48.567+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:56:48.571 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:48.567+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:56:48.572 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:56:48.567+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:56:49.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:49.512+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168375 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:50.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:50.932+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168380 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:52.258 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:52.252+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:53.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:53.544+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168396 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:54.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:54.980+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:56.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:56.388+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168415 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:57.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:57.652+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168419 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:56:59.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:56:59.208+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168423 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:00.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:00.508+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:01.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:01.796+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:03.161 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:03.156+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:04.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:04.444+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168443 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:05.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:05.740+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:07.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:07.036+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:08.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:08.328+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:09.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:09.740+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:11.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:10.996+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:12.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:12.524+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:13.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:13.812+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:15.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:15.116+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:16.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:16.488+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:17.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:17.760+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 168994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:19.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:19.107+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:20.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:20.387+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:21.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:21.643+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:22.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:22.879+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:24.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:24.131+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:25.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:25.343+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169511 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:26.660 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:26.655+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:27.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:27.955+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:29.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:29.275+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:30.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:30.559+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169720 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:32.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:32.019+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:32.989 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:57:32.986+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:57:32.989 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:57:32.986+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:57:32.991 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:57:32.986+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:57:33.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:33.375+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:34.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:34.631+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:35.856 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:35.851+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 169948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:37.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:37.191+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:38.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:38.443+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:39.795 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:39.787+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:41.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:41.115+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:42.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:42.819+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:44.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:44.323+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:45.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:45.631+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:46.098 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:57:46.094+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:57:46.103 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:57:46.098+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:57:46.104 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:57:46.098+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:57:46.104 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:57:46.098+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:57:46.930 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:46.923+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170419 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:48.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:48.251+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:49.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:49.623+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:50.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:50.919+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:52.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:52.211+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170640 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:53.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:53.427+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:54.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:54.915+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:56.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:56.575+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170817 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:57.850 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:57.843+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:57:59.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:57:59.047+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 170954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:00.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:00.231+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:01.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:01.514+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:02.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:02.710+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:03.942 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:03.934+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:05.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:05.214+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171288 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:06.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:06.434+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171340 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:07.676 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:07.670+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:08.880 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:08.874+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171440 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:10.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:10.078+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171491 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:11.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:11.278+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:12.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:12.542+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:13.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:13.786+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:15.067 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:15.062+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:15.381 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:15.381+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:58:15.382 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:15.381+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:58:15.382 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:15.381+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:58:16.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:16.278+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171715 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:17.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:17.570+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:18.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:18.830+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:20.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:20.054+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171865 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:20.428 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:20.425+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:58:20.428 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:20.425+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:58:20.429 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:20.425+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:58:21.301 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:21.298+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 171982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:22.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:22.586+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:23.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:23.826+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:25.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:25.062+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:26.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:26.330+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:27.491 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:27.488+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:58:27.493 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:27.492+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:58:27.497 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:27.496+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:58:27.498 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:58:27.496+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:58:27.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:27.562+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:28.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:28.846+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:30.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:30.054+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:31.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:31.330+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:32.567 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:32.562+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:33.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:33.794+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:35.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:35.062+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:36.360 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:36.358+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:37.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:37.606+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:38.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:38.850+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:40.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:40.046+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:41.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:41.222+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:42.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:42.458+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172409 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:43.743 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:43.737+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:45.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:45.085+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:46.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:46.325+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:47.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:47.597+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172429 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:48.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:48.857+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:50.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:50.077+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:51.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:51.285+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:52.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:52.529+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:53.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:53.729+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:55.063 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:55.057+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:56.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:56.253+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:57.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:57.501+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:58:58.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:58:58.745+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:00.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:00.077+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:01.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:01.325+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:02.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:02.537+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:03.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:03.801+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:05.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:05.085+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:06.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:06.281+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:07.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:07.521+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:08.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:08.769+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:10.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:10.061+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:11.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:11.249+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:12.468 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:12.465+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:13.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:13.741+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:15.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:15.065+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:16.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:16.349+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:17.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:17.561+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172549 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:18.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:18.781+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:20.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:20.077+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:21.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:21.317+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172565 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:22.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:22.625+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:23.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:23.857+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172573 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:25.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:25.149+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:26.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:26.424+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172585 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:27.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:27.712+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:28.981 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:28.972+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:30.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:30.200+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:31.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:31.388+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:32.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:32.596+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172609 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:33.795 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:33.788+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:35.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:35.172+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:36.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:36.396+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172625 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:37.665 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:37.648+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172629 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:38.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:38.868+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:40.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:40.140+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:41.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:41.348+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172645 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:42.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:42.556+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172649 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:43.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:43.780+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172653 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:45.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:45.288+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:46.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:46.472+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172665 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:47.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:47.704+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172669 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:48.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:48.972+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:50.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:50.244+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:51.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:51.464+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172685 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:52.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:52.752+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172689 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:53.996 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:53.992+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:55.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:55.288+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:55.354 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.350+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T00:59:55.358 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.354+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T00:59:55.361 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T00:59:55.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T00:59:55.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T00:59:55.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T00:59:55.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T00:59:55.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T00:59:55.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T00:59:55.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T00:59:55.358+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T00:59:56.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:56.496+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172705 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:57.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:57.720+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T00:59:58.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T00:59:58.948+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:00.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:00.204+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:01.408 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:01.402+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:00:01.408 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:01.402+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:00:01.409 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:01.406+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:00:01.409 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:01.406+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:00:01.409 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:01.406+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:00:01.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:01.480+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:02.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:02.720+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172729 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:03.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:03.940+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:05.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:05.136+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:06.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:06.316+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:06.448 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:06.442+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:00:06.449 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:06.446+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:00:06.452 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:06.446+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:00:06.453 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:06.446+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:00:06.453 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:06.446+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:00:06.453 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:06.446+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:00:07.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:07.608+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:08.849 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:08.831+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:10.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:10.107+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:11.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:11.359+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172765 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:12.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:12.603+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172769 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:13.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:13.851+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:15.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:15.295+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:16.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:16.511+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:17.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:17.743+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172789 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:18.964 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:18.955+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:20.149 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:20.143+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:21.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:21.375+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172805 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:22.671 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:22.663+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172809 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:23.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:23.911+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:24.666 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:24.665+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:00:24.667 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:24.665+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:00:25.139 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:25.131+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:26.316 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:26.311+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:27.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:27.607+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:28.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:28.887+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172837 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:30.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:30.159+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:31.447 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:31.439+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:32.729 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:32.723+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:32.737 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:32.733+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:00:32.738 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:00:32.737+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:00:34.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:34.091+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172857 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:35.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:35.375+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:36.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:36.603+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:37.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:37.911+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:39.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:39.191+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:40.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:40.439+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:41.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:41.735+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:43.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:42.999+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:44.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:44.239+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:45.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:45.471+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172903 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:46.691 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:46.683+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:47.918 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:47.911+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:49.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:49.163+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:50.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:50.407+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172928 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:51.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:51.854+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:53.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:53.110+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:54.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:54.390+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:55.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:55.666+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:56.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:56.882+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172955 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:58.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:58.178+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:00:59.419 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:00:59.414+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:00.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:00.626+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:01.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:01.898+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172975 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:03.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:03.138+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:04.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:04.422+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:05.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:05.662+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:06.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:06.974+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 172995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:08.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:08.250+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:09.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:09.506+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:10.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:10.734+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:11.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:11.950+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:13.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:13.162+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:14.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:14.386+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:15.651 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:15.646+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:16.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:16.882+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:18.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:18.122+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:19.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:19.362+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:20.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:20.610+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:21.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:21.810+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:23.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:23.014+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173061 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:24.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:24.278+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:25.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:25.470+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:26.697 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:26.694+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:27.970 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:27.966+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:29.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:29.194+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:30.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:30.406+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:31.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:31.606+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:32.863 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:32.858+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:34.149 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:34.141+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:35.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:35.341+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:36.545 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:36.537+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173117 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:37.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:37.793+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:38.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:38.355+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:01:38.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:38.355+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:01:38.362 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:38.355+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:01:39.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:39.001+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:40.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:40.229+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:41.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:41.521+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:42.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:42.741+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:43.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:43.969+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:45.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:45.229+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:46.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:46.485+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:47.480 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:47.475+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:01:47.481 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:47.475+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:01:47.481 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:47.475+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:01:47.481 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:47.475+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:01:47.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:47.777+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:49.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:49.073+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173165 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:50.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:50.277+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:51.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:51.553+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:52.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:52.793+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:54.099 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:54.093+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:55.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:55.341+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:56.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:56.593+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:57.552 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:01:57.550+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:01:57.814 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:57.809+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:01:59.030 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:01:59.025+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:00.222 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:00.217+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:01.447 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:01.445+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:02.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:02.657+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:03.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:03.885+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173225 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:05.227 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:05.221+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:06.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:06.441+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:07.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:07.773+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:09.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:09.021+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173245 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:10.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:10.249+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:11.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:11.497+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:12.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:12.777+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:14.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:14.077+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:15.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:15.265+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:16.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:16.456+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:17.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:17.712+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:18.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:18.924+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173285 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:20.241 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:20.236+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:21.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:21.464+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:22.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:22.692+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:23.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:23.920+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173305 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:25.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:25.236+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:26.484 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:26.476+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:27.724 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:27.720+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:28.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:28.980+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173325 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:30.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:30.240+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173330 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:31.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:31.572+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:32.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:32.848+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:34.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:34.204+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:35.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:35.516+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:36.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:36.816+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:38.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:38.104+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:39.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:39.412+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:40.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:40.760+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173370 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:42.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:42.112+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:43.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:43.404+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:44.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:44.688+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:45.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:45.988+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:47.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:47.340+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:48.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:48.648+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:49.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:49.924+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:51.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:51.260+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:52.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:52.592+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:53.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:53.872+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:55.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:55.528+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:57.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:57.020+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:58.273 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:58.268+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:02:59.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:02:59.623+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:01.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:01.003+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:02.397 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:02.387+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:03.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:03.847+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:05.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:05.447+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:06.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:06.899+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:08.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:08.155+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:09.555 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:09.547+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:10.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:10.819+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:12.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:12.167+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173704 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:13.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:13.495+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:14.823 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:14.815+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173766 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:16.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:16.147+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:17.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:17.487+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:18.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:18.923+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:19.321 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:03:19.320+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:03:19.322 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:03:19.320+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:03:20.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:20.663+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:21.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:21.959+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:23.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:23.303+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173964 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:24.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:24.611+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 173991 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:26.386 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:03:26.384+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:03:26.386 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:03:26.384+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:03:26.387 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:03:26.384+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:03:26.387 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:03:26.384+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:03:26.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:26.443+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174056 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:27.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:27.711+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:29.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:29.055+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:30.386 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:30.379+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:31.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:31.775+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:33.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:33.063+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:34.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:34.307+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:35.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:35.671+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:37.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:37.151+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:40.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:40.031+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:42.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:42.970+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:45.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:45.486+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:46.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:46.854+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:49.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:49.790+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:51.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:51.806+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:53.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:53.162+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:54.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:54.458+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:55.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:55.738+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:57.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:57.042+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:58.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:58.278+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:03:59.504 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:03:59.498+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:00.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:00.798+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174855 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:02.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:02.050+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:03.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:03.270+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174911 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:04.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:04.486+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174936 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:05.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:05.762+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174965 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:07.101 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:07.098+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 174995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:08.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:08.290+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:09.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:09.514+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:10.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:10.770+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:12.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:12.434+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:13.756 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:13.750+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:15.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:15.146+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:16.525 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:16.522+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:17.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:17.826+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:19.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:19.106+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:20.332 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:20.330+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:21.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:21.614+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:22.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:22.854+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:24.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:24.053+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:25.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:25.337+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:26.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:26.589+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:27.794 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:27.789+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:29.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:29.037+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:30.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:30.337+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:31.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:31.557+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:32.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:32.957+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:34.216 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:34.213+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:35.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:35.477+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:36.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:36.681+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:37.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:37.885+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:39.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:39.181+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:40.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:40.401+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:41.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:41.681+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:42.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:42.961+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175409 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:44.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:44.185+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:45.431 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:45.425+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:46.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:46.653+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:47.877 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:47.873+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175429 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:49.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:49.101+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:50.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:50.369+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:51.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:51.625+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:52.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:52.849+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:54.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:54.081+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:55.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:55.349+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:56.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:56.609+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:57.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:57.821+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:04:59.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:04:59.033+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:00.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:00.365+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:01.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:01.605+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:02.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:02.865+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:04.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:04.149+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:05.360 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:05.357+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:06.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:06.544+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:07.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:07.776+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:09.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:09.032+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:10.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:10.352+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:10.403 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:10.401+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:05:11.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:11.568+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:12.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:12.760+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:14.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:14.012+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:15.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:15.372+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:16.575 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:16.568+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:17.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:17.836+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175550 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:19.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:19.076+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:19.511 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:19.508+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:05:19.512 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:19.508+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:05:19.512 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:19.508+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:05:19.512 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:19.508+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:05:19.513 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:19.512+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:05:20.375 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:20.368+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:21.530 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:21.528+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:05:21.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:21.616+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:22.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:22.880+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:24.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:24.180+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:25.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:25.408+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:26.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:26.804+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:28.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:28.060+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:29.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:29.284+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:30.527 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:30.520+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175599 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:30.617 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:30.616+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:05:30.617 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:30.616+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:05:30.617 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:05:30.616+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:05:31.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:31.744+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:32.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:32.968+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175610 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:34.235 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:34.228+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:35.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:35.452+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:36.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:36.748+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:38.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:38.076+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:39.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:39.344+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:40.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:40.560+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:41.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:41.784+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:42.984 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:42.976+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:44.232 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:44.228+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:45.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:45.492+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:46.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:46.768+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:48.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:48.032+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:49.259 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:49.251+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:50.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:50.483+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:51.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:51.691+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:52.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:52.959+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:54.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:54.195+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:55.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:55.575+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:57.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:57.075+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:58.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:58.327+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175710 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:05:59.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:05:59.523+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:00.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:00.771+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:02.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:02.031+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:03.276 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:03.271+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175730 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:04.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:04.475+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:05.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:05.707+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:06.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:06.907+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:08.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:08.163+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:09.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:09.363+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:10.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:10.647+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:11.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:11.947+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175766 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:13.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:13.163+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:14.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:14.439+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:15.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:15.655+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:16.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:16.947+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:18.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:18.175+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:19.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:19.487+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:20.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:20.775+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:22.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:22.011+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:23.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:23.307+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:24.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:24.539+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:25.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:25.751+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:27.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:27.031+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:28.269 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:28.259+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:29.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:29.471+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:30.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:30.687+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:32.137 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:32.130+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:33.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:33.406+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:34.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:34.666+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:35.249 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:35.246+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:06:35.249 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:35.246+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:06:35.252 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:35.246+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:06:35.252 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:35.246+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:06:35.252 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:35.246+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:06:35.253 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:35.246+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:06:35.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:35.878+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:37.184 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:37.174+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:38.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:38.454+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:39.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:39.694+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175874 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:40.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:40.906+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:42.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:42.174+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:42.339 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:42.334+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:06:43.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:43.458+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:44.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:44.678+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:45.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:45.362+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:06:45.365 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:45.362+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:06:45.367 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:45.362+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:06:45.368 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:45.362+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:06:45.368 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:45.362+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:06:45.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:45.882+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:47.205 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:47.202+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:48.505 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:48.502+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:49.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:49.754+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:51.008 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:51.002+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175919 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:52.250 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:52.246+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:53.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:53.490+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:54.473 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:54.470+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:06:54.483 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:54.470+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:06:54.483 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:54.470+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:06:54.483 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:54.470+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:06:54.483 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:54.470+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:06:54.484 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:06:54.474+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:06:54.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:54.702+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:55.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:55.982+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:57.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:57.558+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:06:58.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:06:58.898+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175960 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:00.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:00.254+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:01.622 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:01.618+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175976 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:02.846 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:02.842+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175980 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:04.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:04.098+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:05.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:05.434+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:06.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:06.638+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 175996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:07.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:07.866+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:09.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:09.118+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176004 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:10.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:10.454+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:11.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:11.682+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:12.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:12.970+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176020 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:13.672 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:07:13.669+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:07:14.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:14.173+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176024 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:15.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:15.537+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176029 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:16.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:16.821+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176036 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:18.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:18.101+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:19.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:19.325+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176044 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:20.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:20.633+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:21.907 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:21.897+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176056 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:23.146 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:23.137+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:24.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:24.349+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176064 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:25.567 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:25.561+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:26.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:26.825+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:28.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:28.073+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176080 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:29.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:29.345+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:30.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:30.649+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:31.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:31.849+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:33.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:33.101+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176100 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:34.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:34.289+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:35.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:35.573+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:36.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:36.833+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176116 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:38.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:38.049+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:39.240 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:39.237+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:40.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:40.477+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:41.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:41.729+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176136 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:42.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:42.957+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:44.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:44.185+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:45.505 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:45.501+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176160 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:45.964 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:07:45.960+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:07:45.965 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:07:45.964+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:07:46.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:46.781+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:48.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:48.057+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:49.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:49.289+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:50.005 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:07:50.000+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:07:50.005 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:07:50.000+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:07:50.005 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:07:50.000+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:07:50.006 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:07:50.004+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:07:50.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:50.521+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176180 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:51.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:51.729+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:52.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:52.973+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:54.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:54.245+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:55.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:55.529+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176200 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:56.799 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:56.793+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:58.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:58.088+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:07:59.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:07:59.348+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:00.583 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:00.576+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:01.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:01.856+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:03.184 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:03.180+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:04.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:04.408+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:05.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:05.656+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:06.892 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:06.888+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:08.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:08.148+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:09.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:09.364+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:10.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:10.608+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:11.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:11.852+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:13.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:13.088+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:14.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:14.348+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:15.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:15.628+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:16.872 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:16.864+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:18.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:18.084+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:19.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:19.332+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:20.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:20.588+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:21.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:21.872+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:23.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:23.312+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:24.530 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:24.524+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:25.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:25.848+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:27.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:27.092+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:28.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:28.332+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:29.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:29.604+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:30.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:30.868+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:32.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:32.072+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:33.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:33.364+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:34.415 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:34.411+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:08:34.415 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:34.411+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:08:34.415 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:34.411+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:08:34.415 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:34.411+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:08:34.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:34.568+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:35.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:35.820+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:37.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:37.048+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:37.449 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:37.447+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:08:37.449 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:37.447+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:08:37.449 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:37.447+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:08:38.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:38.740+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:39.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:39.955+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:41.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:41.251+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:42.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:42.451+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:43.509 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:43.502+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:08:43.509 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:08:43.506+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:08:43.743 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:43.735+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:45.028 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:45.023+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:46.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:46.239+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:47.472 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:47.467+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:48.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:48.679+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:49.917 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:49.911+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:51.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:51.179+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:52.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:52.475+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:53.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:53.727+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:55.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:55.035+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:56.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:56.247+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:57.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:57.539+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:08:58.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:08:58.767+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:00.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:00.107+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:01.388 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:01.379+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:02.600 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:02.595+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:03.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:03.799+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:05.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:05.083+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:06.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:06.403+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:07.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:07.679+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:08.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:08.963+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:10.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:10.527+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:11.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:11.731+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:13.010 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:13.003+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:14.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:14.263+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:15.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:15.479+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:16.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:16.763+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:17.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:17.987+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176537 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:19.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:19.255+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:20.504 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:20.499+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:21.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:21.763+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:22.984 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:22.978+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:24.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:24.222+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:25.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:25.506+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:26.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:26.782+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176573 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:27.934 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:09:27.933+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:09:27.934 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:09:27.933+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:09:27.939 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:09:27.937+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:09:27.940 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:09:27.937+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:09:27.940 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:09:27.937+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:09:28.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:28.050+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:29.282 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:29.274+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176581 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:30.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:30.570+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:31.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:31.886+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:33.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:33.130+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176597 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:34.332 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:34.330+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176601 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:35.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:35.598+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:36.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:36.862+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:38.012 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:09:38.009+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:09:38.012 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:09:38.009+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:09:38.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:38.158+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:39.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:39.498+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176621 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:40.960 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:40.934+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:42.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:42.290+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:43.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:43.570+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:44.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:44.890+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:46.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:46.174+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:47.474 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:47.470+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176653 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:48.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:48.810+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:50.099 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:50.094+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176661 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:51.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:51.386+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:52.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:52.774+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:54.039 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:54.034+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:55.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:55.334+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:56.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:56.622+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:57.954 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:57.950+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:09:59.383 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:09:59.378+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:00.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:00.690+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:02.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:02.206+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:03.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:03.550+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:04.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:04.777+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:06.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:06.037+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:07.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:07.265+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:08.489 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:08.485+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:09.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:09.761+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176812 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:11.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:11.037+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:12.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:12.257+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:13.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:13.493+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:14.731 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:14.725+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 176988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:16.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:16.033+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:17.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:17.333+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177087 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:18.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:18.625+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177140 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:19.393 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:10:19.392+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:10:19.393 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:10:19.392+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:10:19.393 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:10:19.392+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:10:19.393 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:10:19.392+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:10:19.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:19.865+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:21.158 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:21.153+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:22.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:22.565+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:23.814 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:23.809+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177343 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:25.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:25.053+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:26.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:26.257+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:27.561 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:27.553+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177560 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:28.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:28.865+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:30.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:30.197+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177705 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:31.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:31.517+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:32.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:32.837+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:34.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:34.145+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:35.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:35.465+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:36.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:36.809+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177878 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:38.032 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:38.029+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:39.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:39.281+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:40.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:40.601+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177891 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:41.838 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:41.833+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:43.091 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:43.085+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:44.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:44.325+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:45.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:45.593+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177911 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:46.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:46.841+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:48.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:48.076+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:49.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:49.312+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:50.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:50.584+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:51.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:51.868+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:53.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:53.104+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:54.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:54.376+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:55.682 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:55.676+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:56.919 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:56.912+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177960 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:58.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:58.204+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177964 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:10:59.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:10:59.456+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:00.682 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:00.676+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:01.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:01.876+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177980 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:03.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:03.136+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:04.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:04.380+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:05.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:05.652+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 177993 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:06.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:06.932+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:08.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:08.148+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178004 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:09.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:09.444+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178008 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:10.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:10.708+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:10.868 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:10.862+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:11:10.868 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:10.862+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:11:10.868 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:10.862+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:11:10.868 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:10.862+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:11:10.868 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:10.862+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:11:11.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:11.992+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178020 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:13.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:13.232+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178024 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:14.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:14.520+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178028 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:15.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:15.788+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178033 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:16.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:16.992+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:17.934 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:17.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:11:17.934 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:17.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:11:17.935 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:17.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:11:17.935 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:17.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:11:17.935 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:17.930+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:11:17.936 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:17.934+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:11:18.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:18.256+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178044 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:19.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:19.512+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:20.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:20.784+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:22.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:22.020+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:23.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:23.308+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178064 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:24.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:24.532+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178068 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:25.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:25.768+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:27.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:27.024+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178080 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:28.042 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:28.038+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:11:28.044 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:28.038+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:11:28.044 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:28.038+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:11:28.044 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:28.038+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:11:28.044 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:28.038+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:11:28.045 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:28.038+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:11:28.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:28.512+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:29.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:29.760+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178088 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:31.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:31.015+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:32.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:32.267+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178100 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:33.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:33.527+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:34.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:34.815+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:36.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:36.047+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:37.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:37.303+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:38.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:38.539+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:39.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:39.803+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178128 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:41.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:41.115+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:42.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:42.343+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178140 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:43.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:43.567+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:44.848 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:44.843+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:45.192 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:45.185+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:11:45.192 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:45.185+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:11:45.192 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:45.185+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:11:45.192 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:45.185+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:11:45.194 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:45.189+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:11:45.194 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:11:45.189+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:11:46.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:46.123+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:47.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:47.383+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178160 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:48.652 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:48.647+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:49.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:49.939+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:51.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:51.163+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:52.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:52.399+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178180 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:53.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:53.699+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:55.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:54.999+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:56.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:56.291+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:57.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:57.555+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:11:58.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:11:58.875+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:00.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:00.211+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178216 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:01.441 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:01.435+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:02.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:02.687+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:03.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:03.887+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:05.183 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:05.175+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:06.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:06.463+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:07.696 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:07.687+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:08.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:08.971+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178253 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:10.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:10.283+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:11.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:11.603+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:12.461 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:12.456+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:12:12.461 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:12.456+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:12:12.461 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:12.456+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:12:12.461 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:12.456+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:12:12.462 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:12.456+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:12:12.894 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:12.886+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:14.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:14.158+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:15.522 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:15.514+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:16.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:16.858+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:18.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:18.138+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:19.418 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:19.410+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:20.708 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:20.702+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178302 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:21.970 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:21.966+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178309 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:23.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:23.186+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:24.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:24.822+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:26.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:26.038+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:27.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:27.286+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:28.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:28.542+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:29.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:29.814+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:31.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:31.018+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:32.250 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:32.234+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:33.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:33.446+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:34.739 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:34.734+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:36.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:35.998+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:37.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:37.262+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:38.538 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:38.534+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:39.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:39.766+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:41.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:41.050+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:42.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:42.258+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:43.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:43.510+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:44.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:44.746+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:46.031 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:46.026+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:47.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:47.270+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178409 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:48.540 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:48.538+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:49.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:49.774+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:51.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:51.050+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:52.318 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:52.314+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178429 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:53.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:53.526+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:53.857 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:53.855+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:12:53.857 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:53.855+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:12:53.861 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:53.859+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:12:53.861 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:53.859+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:12:53.861 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:53.859+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:12:53.862 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:53.859+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:12:54.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:54.810+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:54.888 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:54.883+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:12:54.888 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:54.883+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:12:54.888 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:12:54.883+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:12:56.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:56.053+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:57.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:57.329+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:58.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:58.581+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:12:59.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:12:59.797+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:01.099 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:01.093+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:02.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:02.385+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:02.960 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:02.955+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:13:02.960 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:02.955+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:13:02.962 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:02.955+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:13:02.962 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:02.955+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:13:02.962 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:02.955+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:13:02.962 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:02.955+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:13:02.963 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:02.955+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:13:03.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:03.601+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:04.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:04.889+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:06.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:06.169+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:07.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:07.469+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:08.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:08.689+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:09.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:09.893+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:11.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:11.149+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:12.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:12.405+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:13.051 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:13.047+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:13:13.053 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:13.047+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:13:13.055 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:13.051+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:13:13.055 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:13.051+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:13:13.056 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:13.055+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:13:13.056 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:13:13.055+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:13:13.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:13.701+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:14.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:14.909+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:16.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:16.149+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:17.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:17.365+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178529 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:18.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:18.577+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:19.788 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:19.785+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178537 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:21.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:21.049+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:22.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:22.301+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178549 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:23.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:23.577+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:24.828 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:24.825+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:26.051 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:26.045+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:27.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:27.325+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:28.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:28.565+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178583 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:29.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:29.801+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:31.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:31.037+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:32.303 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:32.297+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178599 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:33.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:33.581+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:35.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:35.501+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:36.793 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:36.789+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:38.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:38.037+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:39.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:39.308+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:40.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:40.584+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:41.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:41.936+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:43.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:43.136+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:45.478 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:45.472+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:46.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:46.776+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:48.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:48.076+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:49.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:49.424+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:50.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:50.704+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:51.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:51.928+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:53.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:53.200+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:54.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:54.472+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:55.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:55.792+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178692 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:57.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:57.072+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:58.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:58.272+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:13:59.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:13:59.484+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178707 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:00.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:00.780+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:01.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:01.972+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:03.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:03.176+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178723 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:04.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:04.444+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:05.569 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:05.561+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:14:05.569 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:05.561+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:14:05.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:05.776+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:06.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:06.988+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:08.285 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:08.280+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178743 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:09.583 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:09.576+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:10.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:10.792+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:12.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:12.044+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:13.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:13.260+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:14.492 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:14.488+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:15.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:15.792+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:16.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:16.980+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:18.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:18.248+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178783 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:18.697 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.693+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:14:18.699 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.697+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:14:18.699 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.697+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:14:18.701 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.701+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:14:18.703 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.701+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:14:18.703 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.701+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:14:18.703 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.701+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:14:18.704 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:18.701+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:14:19.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:19.460+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178787 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:20.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:20.803+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178792 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:22.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:22.043+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:23.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:23.307+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178803 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:25.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:25.711+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:26.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:26.967+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:28.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:28.271+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:29.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:29.651+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:30.950 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:30.943+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178832 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:32.227 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:32.219+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:32.831 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:32.828+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:14:32.831 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:32.828+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:14:32.834 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:32.832+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:14:32.835 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:32.832+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:14:32.836 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:32.832+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:14:32.836 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:32.832+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:14:33.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:33.495+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:35.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:35.179+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178847 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:36.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:36.447+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178852 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:37.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:37.687+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:38.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:38.923+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:40.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:40.207+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:41.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:41.491+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178872 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:42.734 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:42.727+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:44.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:44.011+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178883 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:45.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:45.259+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:46.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:46.563+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:47.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:47.903+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:49.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:49.191+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178903 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:50.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:50.515+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:50.853 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:50.852+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:14:50.854 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:50.852+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:14:50.854 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:50.852+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:14:50.854 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:14:50.852+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:14:51.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:51.883+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178916 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:53.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:53.123+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178923 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:54.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:54.431+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:55.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:55.811+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:57.099 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:57.091+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:58.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:58.403+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:14:59.625 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:14:59.619+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:00.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:00.843+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178952 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:02.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:02.087+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:03.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:03.323+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178963 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:04.538 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:04.530+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:05.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:05.834+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:07.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:07.114+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:08.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:08.386+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:09.671 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:09.662+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178987 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:10.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:10.942+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:11.205 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:11.199+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:15:11.205 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:11.199+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b2f81740 2019-12-17T01:15:11.205 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:11.199+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a080 2019-12-17T01:15:11.205 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:11.199+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424ae50 2019-12-17T01:15:11.206 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:11.203+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46a490 2019-12-17T01:15:11.206 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:11.203+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:15:12.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:12.242+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 178999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:13.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:13.510+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:14.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:14.726+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179007 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:15.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:15.922+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:17.135 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:17.130+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:18.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:18.366+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:19.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:19.646+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:20.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:20.870+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:22.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:22.078+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:23.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:23.354+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179043 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:24.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:24.638+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179047 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:25.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:25.886+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:27.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:27.166+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:28.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:28.410+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179067 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:29.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:29.714+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:30.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:30.926+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:32.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:32.134+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179083 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:33.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:33.350+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179087 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:34.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:34.590+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:35.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:35.878+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:37.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:37.114+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179103 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:38.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:38.326+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179107 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:39.531 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:39.526+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:40.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:40.854+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179116 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:42.110 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:42.106+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:43.397 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:43.394+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:44.583 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:44.578+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:45.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:45.870+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:47.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:47.105+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:48.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:48.365+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:49.884 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:49.881+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179152 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:51.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:51.149+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:52.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:52.385+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:52.623 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:52.618+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:15:52.626 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:52.622+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:15:52.626 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:52.622+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:15:52.626 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:52.622+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:15:52.626 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:52.622+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:15:52.626 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:52.622+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:15:53.635 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:53.630+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e1330 2019-12-17T01:15:53.636 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:53.630+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e15a0 2019-12-17T01:15:53.636 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:53.630+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4248b60 2019-12-17T01:15:53.636 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:53.630+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b4249c70 2019-12-17T01:15:53.636 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:53.630+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b424a7d0 2019-12-17T01:15:53.637 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:15:53.630+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46b0c0 2019-12-17T01:15:53.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:53.637+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:54.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:54.909+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179172 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:56.151 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:56.145+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:57.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:57.437+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:58.748 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:58.745+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179188 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:15:59.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:15:59.973+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:01.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:01.217+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:02.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:02.445+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179204 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:03.748 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:03.745+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:04.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:04.969+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179212 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:06.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:06.221+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:07.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:07.513+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:08.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:08.809+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179228 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:10.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:10.013+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:11.276 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:11.273+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:13.251 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:13.245+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179244 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:14.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:14.553+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:15.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:15.885+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:17.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:17.101+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:18.382 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:18.377+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:19.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:19.637+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:20.907 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:20.897+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:22.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:22.173+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:23.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:23.461+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179288 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:24.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:24.709+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179292 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:25.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:25.953+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:28.183 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:28.177+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:29.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:29.564+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:30.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:30.904+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:32.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:32.184+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179324 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:33.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:33.444+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:34.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:34.720+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:35.983 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:35.976+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:37.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:37.260+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179344 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:38.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:38.504+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:39.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:39.752+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179352 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:40.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:40.972+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:42.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:42.172+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179364 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:43.387 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:43.380+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179368 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:44.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:44.596+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:45.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:45.896+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:47.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:47.112+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179384 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:48.387 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:48.380+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:49.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:49.616+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179392 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:50.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:50.896+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:52.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:52.136+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179404 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:53.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:53.420+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:54.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:54.668+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179412 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:55.936 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:55.928+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:57.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:57.188+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:58.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:58.404+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:16:59.626 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:16:59.620+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:00.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:00.928+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:01.286 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:17:01.280+0000 7fe6e96cf700 -1 osd.1 pg_epoch: 110 pg[2.15( v 110'933 (0'0,110'933] local-lis/les=105/106 n=33 ec=13/13 lis/c=105/105 les/c/f=106/106/0 sis=105) [1,2] r=0 lpr=105 luod=110'932 crt=110'931 lcod 110'931 mlcod 110'931 active+clean] bad op order, already applied 43654432 > this 43654309 2019-12-17T01:17:01.287 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:17:01.284+0000 7fe6eb6d3700 -1 osd.1 pg_epoch: 110 pg[2.11( v 110'5924 (101'2900,110'5924] local-lis/les=107/108 n=33 ec=13/13 lis/c=107/107 les/c/f=108/108/0 sis=107) [1,2] r=0 lpr=107 luod=110'5922 crt=110'5921 lcod 110'5921 mlcod 110'5921 active+clean] bad op order, already applied 43654431 > this 43654307 2019-12-17T01:17:01.293 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:17:01.284+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3b19e14d0 2019-12-17T01:17:01.293 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:17:01.284+0000 7fe6f9acf700 -1 reset not still connected to 0x55c3bc46bcf0 2019-12-17T01:17:01.293 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fe6e96cf700 time 2019-12-17T01:17:01.284780+0000 2019-12-17T01:17:01.293 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T01:17:01.295 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fe6eb6d3700 time 2019-12-17T01:17:01.286247+0000 2019-12-17T01:17:01.295 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T01:17:01.298 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T01:17:01.298 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55c3a3189140] 2019-12-17T01:17:01.299 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c3a3365729] 2019-12-17T01:17:01.299 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c3a3369660] 2019-12-17T01:17:01.299 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c3a3374761] 2019-12-17T01:17:01.299 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c3a31fa67b] 2019-12-17T01:17:01.299 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c3a3454817] 2019-12-17T01:17:01.299 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c3a3216b0c] 2019-12-17T01:17:01.299 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c3a385647c] 2019-12-17T01:17:01.300 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c3a38596d0] 2019-12-17T01:17:01.300 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 10: (()+0x76db) [0x7fe70ae146db] 2019-12-17T01:17:01.300 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 11: (clone()+0x3f) [0x7fe709bb488f] 2019-12-17T01:17:01.300 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:2019-12-17T01:17:01.296+0000 7fe6e96cf700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fe6eb6d3700 time 2019-12-17T01:17:01.286247+0000 2019-12-17T01:17:01.300 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T01:17:01.300 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 2019-12-17T01:17:01.300 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T01:17:01.301 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55c3a3189140] 2019-12-17T01:17:01.301 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c3a3365729] 2019-12-17T01:17:01.301 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c3a3369660] 2019-12-17T01:17:01.301 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c3a3374761] 2019-12-17T01:17:01.301 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c3a31fa67b] 2019-12-17T01:17:01.301 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c3a3454817] 2019-12-17T01:17:01.301 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c3a3216b0c] 2019-12-17T01:17:01.302 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c3a385647c] 2019-12-17T01:17:01.302 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c3a38596d0] 2019-12-17T01:17:01.305 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 10: (()+0x76db) [0x7fe70ae146db] 2019-12-17T01:17:01.305 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 11: (clone()+0x3f) [0x7fe709bb488f] 2019-12-17T01:17:01.306 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 2019-12-17T01:17:01.306 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:*** Caught signal (Aborted) ** 2019-12-17T01:17:01.306 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: in thread 7fe6e96cf700 thread_name:tp_osd_tp 2019-12-17T01:17:01.306 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T01:17:01.306 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55c3a3189140] 2019-12-17T01:17:01.307 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c3a3365729] 2019-12-17T01:17:01.307 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c3a3369660] 2019-12-17T01:17:01.307 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c3a3374761] 2019-12-17T01:17:01.307 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c3a31fa67b] 2019-12-17T01:17:01.307 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c3a3454817] 2019-12-17T01:17:01.307 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c3a3216b0c] 2019-12-17T01:17:01.307 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c3a385647c] 2019-12-17T01:17:01.308 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c3a38596d0] 2019-12-17T01:17:01.308 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 10: (()+0x76db) [0x7fe70ae146db] 2019-12-17T01:17:01.308 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr: 11: (clone()+0x3f) [0x7fe709bb488f] 2019-12-17T01:17:02.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:02.308+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:03.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:03.568+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:04.037 INFO:tasks.ceph.cluster2.osd.1.smithi177.stderr:daemon-helper: command crashed with signal 6 2019-12-17T01:17:04.384 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.380+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:17:04.391 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:17:04.391 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:17:04.391 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:17:04.391 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:17:04.392 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:17:04.392 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1facb0 2019-12-17T01:17:04.393 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8f450 2019-12-17T01:17:04.394 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:17:04.394 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:17:04.394 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:17:04.395 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.388+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:17:04.395 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.392+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:17:04.395 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.392+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:17:04.395 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.392+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:17:04.407 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:17:04.404+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:17:04.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:04.796+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179452 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:06.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:06.012+0000 7f6702f62700 -1 osd.2 111 get_health_metrics reporting 179457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:07.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:07.556+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179464 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:09.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:09.088+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179468 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:10.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:10.308+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:11.530 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:11.523+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:12.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:12.751+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:14.036 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:14.031+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:15.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:15.303+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:16.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:16.563+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:17.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:17.831+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:19.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:19.079+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:20.327 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:20.319+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:21.528 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:21.523+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:22.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:22.899+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:24.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:24.123+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:25.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:25.447+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:26.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:26.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179691 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:27.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:27.975+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:29.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:29.283+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:30.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:30.587+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:31.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:31.955+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179711 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:33.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:33.203+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179722 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:34.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:34.527+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179722 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:35.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:35.947+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:37.235 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:37.227+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:38.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:38.563+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:39.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:39.959+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:41.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:41.283+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179751 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:42.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:42.675+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:44.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:44.071+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:45.447 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:45.443+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179766 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:46.795 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:46.791+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179771 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:48.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:48.119+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:49.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:49.527+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179782 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:50.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:50.875+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:52.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:52.287+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:53.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:53.647+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179802 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:55.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:55.062+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:56.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:56.390+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:58.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:58.122+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:17:59.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:17:59.518+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:00.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:00.818+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:01.944 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:01.938+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:18:01.945 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:01.938+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:18:01.945 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:01.938+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:18:01.949 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:01.946+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:18:01.949 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:01.946+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:18:01.949 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:01.946+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:18:01.950 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:01.946+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:18:02.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:02.314+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:03.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:03.658+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:04.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:04.990+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:06.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:06.402+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179851 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:07.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:07.858+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:09.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:09.290+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:10.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:10.718+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:12.040 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:12.034+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:18:12.041 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:12.034+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:18:12.041 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:12.038+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:18:12.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:12.122+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:13.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:13.542+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 179979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:15.161 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:15.158+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:16.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:16.966+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:18.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:18.306+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:19.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:19.794+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:21.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:21.046+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:22.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:22.490+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:23.145 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.138+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:18:23.145 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.138+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:18:23.145 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.138+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:18:23.145 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.138+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:18:23.146 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.142+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:18:23.146 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.142+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:18:23.147 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.142+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:18:23.147 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.142+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:18:23.147 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:18:23.142+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:18:23.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:23.834+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:25.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:25.402+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180239 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:26.739 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:26.734+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:28.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:28.102+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:29.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:29.578+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180331 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:31.118 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:31.114+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:33.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:33.702+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:36.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:36.178+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:37.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:37.661+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:38.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:38.937+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:40.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:40.205+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:41.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:41.413+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180597 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:42.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:42.645+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:43.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:43.857+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180649 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:45.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:45.169+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:46.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:46.421+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:47.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:47.625+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180731 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:48.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:48.909+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:50.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:50.145+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:51.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:51.405+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180816 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:52.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:52.657+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:53.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:53.937+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:55.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:55.165+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:56.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:56.381+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180924 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:57.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:57.629+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:18:59.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:18:59.161+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 180982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:00.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:00.461+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:01.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:01.785+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:03.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:03.109+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:04.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:04.445+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:05.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:05.753+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:07.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:07.053+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:08.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:08.365+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:09.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:09.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:11.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:11.057+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181443 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:12.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:12.361+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:13.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:13.629+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:14.964 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:14.957+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:16.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:16.177+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181463 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:17.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:17.401+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:18.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:18.700+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:19.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:19.896+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:21.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:21.092+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181483 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:22.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:22.324+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:23.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:23.552+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:24.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:24.852+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:26.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:26.144+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181503 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:27.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:27.416+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:28.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:28.692+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:29.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:29.892+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:31.151 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:31.144+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181523 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:32.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:32.372+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:33.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:33.604+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:34.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:34.876+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:36.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:36.076+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:37.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:37.328+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181550 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:38.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:38.544+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:39.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:39.784+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:40.844 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:40.840+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:19:40.845 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:40.840+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:19:40.845 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:40.840+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:19:40.846 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:40.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:19:40.846 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:40.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:19:40.846 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:40.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:19:41.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:41.072+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:42.324 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:42.316+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:43.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:43.604+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:44.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:44.804+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:46.051 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:46.044+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:47.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:47.324+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:48.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:48.580+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:48.929 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:48.923+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:19:48.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:48.923+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:19:48.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:48.923+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:19:48.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:48.927+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:19:48.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:19:48.927+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:19:50.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:50.448+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181602 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:51.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:51.636+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:52.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:52.924+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:54.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:54.316+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:55.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:55.588+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:56.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:56.828+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:58.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:58.184+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:19:59.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:19:59.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:00.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:00.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:02.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:02.091+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:03.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:03.371+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:04.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:04.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:06.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:06.083+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:07.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:07.347+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181675 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:08.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:08.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:09.966 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:09.959+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:11.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:11.231+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:12.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:12.519+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181695 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:13.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:13.759+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:15.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:15.051+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:16.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:16.243+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:17.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:17.455+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181715 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:18.696 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:18.691+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:19.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:19.979+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181723 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:21.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:21.187+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:22.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:22.491+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:23.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:23.707+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 181798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:24.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:24.927+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:26.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:26.203+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182067 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:27.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:27.507+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:28.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:28.767+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182078 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:30.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:30.075+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:31.335 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:31.327+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182087 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:32.626 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:32.619+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:33.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:33.835+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:35.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:35.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:36.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:36.471+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182107 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:37.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:37.727+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:39.029 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:39.023+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182118 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:40.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:40.299+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:41.553 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:41.547+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:42.419 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:42.410+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:20:42.419 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:42.410+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:20:42.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:42.774+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:44.026 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:44.018+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:45.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:45.278+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:46.573 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:46.562+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:47.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:47.794+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:49.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:49.070+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:50.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:50.282+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:51.553 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:51.550+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:52.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:52.850+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:54.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:54.074+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:55.350 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:55.346+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:56.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:56.598+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:58.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:58.454+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182194 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:20:59.604 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.597+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:20:59.614 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.601+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:20:59.614 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.601+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:20:59.615 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:20:59.615 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:20:59.615 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:20:59.615 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:20:59.616 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:20:59.616 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:20:59.616 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:20:59.624 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:20:59.605+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:20:59.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:20:59.782+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:01.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:01.118+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:02.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:02.354+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:03.655 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:03.650+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182218 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:04.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:04.922+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:06.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:06.206+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:07.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:07.630+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:08.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:08.886+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:10.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:10.150+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:11.385 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:11.382+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:12.668 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:12.666+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182254 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:13.746 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:21:13.746 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:21:13.747 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:21:13.747 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:21:13.747 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:21:13.747 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:21:13.748 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:21:13.748 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:13.745+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:21:13.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:13.874+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182258 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:15.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:15.130+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:16.343 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:16.338+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:17.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:17.646+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:18.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:18.918+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:20.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:20.186+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:20.809 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:20.805+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:21:20.809 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:20.805+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:21:20.809 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:20.805+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:21:20.810 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:20.805+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:21:20.810 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:20.805+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:21:21.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:21.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:22.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:22.698+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182294 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:24.001 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:23.997+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:25.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:25.221+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182302 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:26.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:26.497+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:27.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:27.761+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:29.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:29.013+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:30.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:30.257+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:30.888 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:21:30.884+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:21:31.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:31.497+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182327 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:32.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:32.777+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182334 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:34.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:34.029+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:35.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:35.305+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:36.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:36.565+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:37.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:37.821+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:39.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:39.025+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:40.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:40.241+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:41.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:41.529+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:42.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:42.809+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:44.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:44.069+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:45.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:45.361+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:46.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:46.625+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:47.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:47.849+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:49.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:49.161+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:50.485 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:50.481+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:51.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:51.793+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:53.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:53.397+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:54.739 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:54.729+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:56.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:56.113+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182427 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:57.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:57.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:58.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:58.645+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:21:59.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:21:59.865+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182452 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:01.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:01.177+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:02.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:02.473+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182464 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:03.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:03.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182468 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:05.001 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:04.997+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:06.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:06.208+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:07.220 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:07.215+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:22:07.221 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:07.219+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:22:07.223 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:07.219+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:22:07.223 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:07.219+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:22:07.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:07.436+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:08.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:08.748+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:09.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:09.956+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:11.254 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:11.248+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:12.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:12.564+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:13.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:13.904+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:15.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:15.140+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:16.434 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:16.428+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:17.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:17.696+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:18.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:18.940+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:20.174 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:20.168+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:21.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:21.444+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182537 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:22.729 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:22.720+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182544 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:24.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:24.052+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:25.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:25.356+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182552 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:25.395 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:22:25.396 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:22:25.396 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:22:25.396 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:22:25.396 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:22:25.396 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:22:25.396 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:22:25.397 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.391+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:22:25.399 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.395+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:22:25.399 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.395+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:22:25.399 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:25.395+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:22:26.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:26.548+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:27.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:27.784+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:29.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:29.000+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:30.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:30.592+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:31.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:31.924+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:33.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:33.160+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:34.424 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:34.420+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:35.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:35.728+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:36.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:36.968+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182597 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:38.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:38.252+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182604 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:39.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:39.800+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:41.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:41.176+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182617 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:42.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:42.396+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:43.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:43.628+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:44.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:44.884+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:46.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:46.208+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:47.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:47.444+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:48.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:48.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:48.832 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:48.826+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:22:48.833 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:22:48.826+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:22:49.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:49.859+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:51.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:51.127+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:52.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:52.371+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:53.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:53.667+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:54.903 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:54.895+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182682 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:56.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:56.199+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:57.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:57.471+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:58.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:58.695+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:22:59.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:22:59.891+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:01.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:01.227+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182707 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:02.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:02.527+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:03.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:03.735+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:04.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:04.939+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182722 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:06.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:06.227+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:07.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:07.435+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:08.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:08.683+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:09.968 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:09.963+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:10.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:10.802+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:23:10.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:10.806+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:23:10.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:10.806+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:23:10.819 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:10.806+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:23:11.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:11.235+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:12.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:12.503+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:13.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:13.727+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:13.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:13.814+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:23:13.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:13.814+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:23:15.027 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:15.019+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:16.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:16.243+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:17.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:17.459+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:18.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:18.695+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182782 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:20.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:20.299+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:21.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:21.599+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:22.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:22.879+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:22.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:22.917+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:23:22.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:22.917+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:23:22.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:22.917+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:23:22.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:22.917+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:23:22.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:22.917+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:23:22.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:22.921+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:23:24.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:24.195+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182802 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:25.500 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:25.491+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:26.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:26.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:27.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:27.979+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:29.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:29.511+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:30.838 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:30.830+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:32.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:32.146+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182831 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:33.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:33.446+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:34.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:34.766+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:36.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:36.038+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:37.423 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:37.414+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:38.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:38.698+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:39.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:39.942+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:41.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:41.226+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182871 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:42.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:42.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182878 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:43.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:43.710+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:44.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:44.942+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:46.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:46.266+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182891 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:46.327 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:46.325+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:23:46.327 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:23:46.325+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:23:47.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:47.494+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:48.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:48.806+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:50.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:50.078+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:51.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:51.362+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182911 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:52.608 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:52.602+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:53.884 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:53.878+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:55.143 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:55.138+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:56.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:56.414+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:57.682 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:57.678+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:23:58.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:23:58.886+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:00.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:00.138+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:01.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:01.346+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:02.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:02.582+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:04.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:04.086+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:05.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:05.390+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:06.630 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:06.622+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182971 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:07.322 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:07.320+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:24:07.942 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:07.938+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:09.184 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:09.178+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:10.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:10.450+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:11.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:11.733+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182991 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:12.970 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:12.965+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 182998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:14.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:14.185+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:15.459 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:15.453+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:16.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:16.705+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:17.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:17.989+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183018 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:19.278 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:19.273+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:20.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:20.517+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:21.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:21.737+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183031 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:23.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:23.029+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183038 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:24.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:24.237+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:25.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:25.477+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:26.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:26.697+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183051 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:27.981 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:27.969+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:29.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:29.177+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:30.464 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:30.461+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:31.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:31.721+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:33.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:33.001+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183078 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:34.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:34.285+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:35.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:35.577+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:36.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:36.881+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:38.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:38.097+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:39.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:39.325+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:40.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:40.561+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:41.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:41.833+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:43.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:43.121+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183118 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:44.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:44.333+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:45.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:45.589+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:46.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:46.801+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:48.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:48.125+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183138 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:49.385 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:49.381+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:50.635 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:50.629+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:51.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:51.731+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:24:51.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:51.731+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:24:51.738 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:51.731+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:24:51.738 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:51.731+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:24:51.738 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:51.735+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:24:51.738 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:51.735+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:24:51.738 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:51.735+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:24:51.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:51.853+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:53.074 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:53.069+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:54.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:54.332+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:54.774 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:54.771+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:24:54.776 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:24:54.771+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:24:55.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:55.624+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:56.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:56.856+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:58.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:58.188+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:24:59.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:24:59.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:00.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:00.756+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:02.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:02.040+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:03.325 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:03.320+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:04.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:04.548+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:05.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:05.904+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:07.241 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:07.236+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:08.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:08.792+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:09.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:09.984+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:11.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:11.296+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:12.543 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:12.536+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:13.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:13.800+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:15.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:15.048+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:16.081 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:25:16.081 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:25:16.081 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:25:16.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:25:16.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:25:16.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:25:16.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:25:16.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:25:16.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:25:16.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:16.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:25:16.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:16.300+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:17.586 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:17.580+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183258 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:18.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:18.832+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:20.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:20.124+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:21.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:21.356+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:22.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:22.568+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:23.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:23.784+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:25.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:25.028+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:26.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:26.352+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183291 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:27.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:27.624+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:28.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:28.872+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183302 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:30.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:30.172+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:31.382 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:31.376+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183311 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:32.683 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:32.672+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:34.264 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:34.260+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:35.518 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:35.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:36.723 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:36.715+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183331 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:37.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:37.991+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:40.092 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:40.083+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:41.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:41.371+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:42.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:42.675+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:43.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:43.975+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:45.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:45.223+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:46.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:46.431+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:47.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:47.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:48.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:48.891+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:50.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:50.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:51.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:51.415+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:52.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:52.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:53.966 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:53.955+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:55.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:55.179+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:56.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:56.427+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:57.369 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.369+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:25:57.369 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.369+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:25:57.369 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.369+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:25:57.371 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.369+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:25:57.372 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.369+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1facb0 2019-12-17T01:25:57.372 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.369+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8f450 2019-12-17T01:25:57.374 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.373+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:25:57.375 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.373+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be5dc0 2019-12-17T01:25:57.375 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.373+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:25:57.375 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.373+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:25:57.375 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.373+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:25:57.376 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.373+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:25:57.376 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:25:57.373+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:25:57.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:57.659+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183420 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:25:58.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:25:58.971+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:00.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:00.187+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:01.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:01.471+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:02.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:02.747+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183440 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:04.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:04.335+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183444 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:05.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:05.571+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:06.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:06.863+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:08.084 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:08.079+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183460 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:09.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:09.299+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183464 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:10.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:10.563+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183468 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:11.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:11.811+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:13.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:13.103+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183480 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:14.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:14.491+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:15.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:15.819+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:17.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:17.103+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:18.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:18.302+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:19.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:19.578+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:20.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:20.926+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:22.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:22.254+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:23.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:23.850+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183524 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:25.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:25.162+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:26.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:26.486+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:27.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:27.926+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:29.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:29.334+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183544 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:30.639 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:30.634+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:30.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:26:30.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:26:30.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:26:30.714 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:26:30.714 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:26:30.714 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:26:30.715 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:26:30.715 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:26:30.716 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:26:30.717 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.712+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:26:30.720 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.716+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:26:30.720 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.716+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:26:30.721 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.716+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:26:30.721 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.716+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:26:30.721 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.716+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:26:30.721 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.716+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:26:30.727 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.724+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:26:30.727 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.724+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:26:30.727 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.724+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:26:30.729 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.728+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:26:30.729 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:30.728+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:26:32.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:32.066+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:33.474 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:33.470+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183560 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:33.735 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.732+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:26:33.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.732+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:26:33.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.732+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:26:33.742 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.736+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:26:33.743 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.736+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:26:33.743 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.736+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:26:33.744 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.740+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:26:33.747 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:26:33.747 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:26:33.748 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:26:33.748 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:26:33.748 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:33.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:26:34.735 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:34.732+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:26:34.745 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:34.736+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:26:34.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:34.798+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:36.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:36.226+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183571 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:37.625 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:37.622+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:38.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:38.978+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183584 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:40.428 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:40.422+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:41.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:41.870+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183593 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:43.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:43.110+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183600 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:43.861 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:43.860+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:26:43.912 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:43.860+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:26:43.913 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:43.860+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:26:43.913 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:43.860+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:26:43.913 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:43.860+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:26:43.913 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:43.860+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:26:43.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:26:43.860+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:26:44.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:44.642+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183604 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:46.070 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:46.066+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:47.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:47.410+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:48.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:48.814+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:50.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:50.258+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:51.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:51.598+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:53.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:53.002+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183640 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:54.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:54.270+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:55.579 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:55.574+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 183996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:56.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:56.866+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:58.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:58.110+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:26:59.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:26:59.394+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:00.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:00.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:01.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:01.985+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184383 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:03.235 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:03.213+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:04.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:04.509+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:05.762 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:05.753+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:06.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:06.989+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:08.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:08.257+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 184911 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:09.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:09.565+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185060 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:10.059 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.055+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:27:10.060 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.055+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:27:10.062 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.059+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:27:10.062 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.059+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:27:10.062 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.059+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:27:10.062 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.059+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:27:10.066 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.063+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:27:10.068 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.063+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:27:10.072 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.067+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:27:10.072 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:10.067+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:27:10.780 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:10.777+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:12.038 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:12.033+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:13.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:13.325+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:14.109 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:14.103+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:27:14.110 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:14.107+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:27:14.111 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:14.107+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:27:14.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:14.549+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:15.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:15.937+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185564 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:17.361 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:17.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:18.674 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:18.669+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:20.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:20.305+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:21.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:21.513+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:22.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:22.765+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:24.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:23.997+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:24.209 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:27:24.209 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:27:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:27:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:27:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:27:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:27:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:27:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:27:24.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:24.203+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:27:25.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:25.293+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:26.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:26.493+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185975 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:27.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:27.757+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:29.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:29.013+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:31.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:31.597+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 185990 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:32.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:32.817+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:34.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:34.113+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:35.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:35.393+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:36.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:36.637+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186015 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:37.909 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:37.905+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:39.137 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:39.133+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:40.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:40.365+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:41.666 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:41.661+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186035 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:42.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:42.912+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:44.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:44.124+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:45.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:45.424+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:46.418 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:27:46.418 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:27:46.418 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:27:46.418 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:27:46.418 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:27:46.419 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:27:46.419 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:27:46.419 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:27:46.419 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:27:46.414+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:27:46.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:46.628+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:47.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:47.856+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:49.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:49.076+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:51.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:51.284+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:52.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:52.648+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:53.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:53.920+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:55.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:55.136+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:56.446 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:56.440+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:57.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:57.744+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:27:59.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:27:58.996+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:00.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:00.280+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:01.548 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:01.540+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:02.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:02.768+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:04.079 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:04.072+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:06.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:06.636+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186130 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:08.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:08.128+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:08.605 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:28:08.601+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:28:08.606 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:28:08.601+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:28:08.607 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:28:08.601+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:28:08.607 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:28:08.601+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:28:09.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:09.380+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:10.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:10.604+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:11.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:11.868+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:13.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:13.084+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:14.385 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:14.380+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186166 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:15.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:15.708+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:17.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:17.180+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:18.548 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:18.544+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:19.858 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:19.852+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:21.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:21.160+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:22.683 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:22.676+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:23.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:23.960+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:25.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:25.203+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:26.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:26.499+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:27.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:27.751+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:29.024 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:29.019+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:30.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:30.331+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:31.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:31.683+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:32.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:32.967+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186243 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:34.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:34.215+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:35.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:35.435+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:36.743 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:36.735+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:37.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:37.979+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186263 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:39.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:39.287+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:40.509 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:40.503+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:41.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:41.727+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:41.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:28:41.928+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:28:43.030 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:43.023+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186283 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:44.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:44.331+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:45.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:45.587+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:46.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:46.907+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:48.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:48.175+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:49.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:49.399+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186805 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:50.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:50.671+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:52.074 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:52.067+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 186993 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:53.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:53.363+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187047 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:54.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:54.603+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:56.147 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:56.139+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:57.484 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:57.479+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187064 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:28:58.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:28:58.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:00.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:00.099+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:01.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:01.339+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:02.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:02.683+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:04.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:03.999+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:05.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:05.255+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:06.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:06.526+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:07.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:07.774+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:09.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:08.998+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:10.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:10.230+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:11.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:11.502+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:12.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:12.790+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:13.421 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:13.415+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:29:13.424 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:13.419+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:29:13.424 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:13.419+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:29:13.425 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:13.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:29:13.425 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:13.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:29:13.425 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:13.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:29:14.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:14.006+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:15.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:15.314+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187139 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:16.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:16.239+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:29:16.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:16.239+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:29:16.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:16.239+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:29:16.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:16.239+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:29:16.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:16.239+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:29:16.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:29:16.239+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:29:17.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:17.430+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:18.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:18.742+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:20.081 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:20.078+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:21.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:21.538+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:22.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:22.910+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:24.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:24.246+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:25.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:25.522+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:27.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:27.014+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:28.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:28.430+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:29.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:29.782+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:31.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:31.214+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:32.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:32.638+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:34.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:34.010+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:35.335 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:35.330+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:36.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:36.866+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:38.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:38.222+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:39.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:39.930+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:41.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:41.318+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:42.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:42.822+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:44.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:44.114+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:45.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:45.626+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187259 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:47.026 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:47.022+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:48.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:48.402+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:49.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:49.745+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:51.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:51.197+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:52.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:52.529+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:53.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:53.885+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:55.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:55.313+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:57.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:57.165+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:29:59.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:29:59.261+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187609 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:00.579 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:00.573+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:01.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:01.893+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:03.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:03.281+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187751 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:04.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:04.737+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:06.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:06.049+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:08.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:08.029+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187883 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:12.438 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:12.433+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 187966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:13.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:13.833+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 188143 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:16.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:16.817+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 188192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:19.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:19.709+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 188307 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:21.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:21.145+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 188408 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:23.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:23.681+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 188459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:24.865 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:24.857+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:30:24.865 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:24.857+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:30:24.865 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:24.857+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:30:24.865 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:24.857+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:30:24.866 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:24.857+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:30:24.866 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:24.857+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:30:24.866 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:24.857+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:30:28.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:28.421+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 188563 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:34.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:34.420+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 188718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:38.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:38.152+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189098 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:39.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:39.892+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:40.015 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:40.013+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:30:40.015 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:40.013+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:30:40.016 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:40.013+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:30:40.016 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:40.013+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:30:42.050 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:42.049+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:30:42.050 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:42.049+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:30:42.050 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:42.049+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:30:42.050 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:42.049+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:30:42.051 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:42.049+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:30:42.051 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:42.049+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:30:42.051 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:42.049+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:30:44.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:44.336+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:47.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:47.336+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:50.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:50.800+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:54.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:54.396+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:30:57.212 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:57.209+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:30:57.213 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:57.213+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:30:57.213 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:57.213+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:30:57.215 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:57.213+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:30:57.215 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:30:57.213+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:30:57.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:30:57.564+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189828 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:00.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:00.720+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 189916 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:03.542 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:03.520+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190036 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:05.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:05.892+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:09.739 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:09.696+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:15.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:15.079+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:18.076 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:18.071+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190640 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:20.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:20.719+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:23.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:23.323+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:25.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:25.839+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:28.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:28.335+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:31.044 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:31.023+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 190958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:33.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:33.855+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:34.682 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:31:34.680+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:31:34.683 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:31:34.680+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:31:37.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:37.119+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191140 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:38.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:38.795+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:40.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:40.819+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191343 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:42.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:42.775+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:44.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:44.747+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:50.274 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:50.267+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:54.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:54.587+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191864 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:57.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:57.098+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 191968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:31:59.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:31:59.318+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:02.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:02.206+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192080 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:03.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:03.534+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:04.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:04.886+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:07.327 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:07.322+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:10.504 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:10.498+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192258 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:16.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:16.046+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192400 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:18.959 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:32:18.954+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:32:18.959 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:32:18.954+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:32:19.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:19.494+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:22.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:22.206+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192640 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:25.274 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:25.270+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192695 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:28.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:28.418+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:30.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:30.814+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:34.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:34.846+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192876 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:36.208 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:36.206+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 192984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:39.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:39.421+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:43.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:43.445+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:47.274 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:47.269+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:49.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:49.749+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:32:55.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:32:55.077+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:02.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:02.201+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:05.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:05.873+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:06.403 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:06.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:33:06.404 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:06.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:33:06.404 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:06.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:33:06.406 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:06.405+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:33:06.406 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:06.405+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:33:09.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:09.453+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:10.509 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:10.509+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:33:10.509 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:10.509+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:33:10.511 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:10.509+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:33:10.517 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:10.513+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:33:14.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:14.145+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:17.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:17.345+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:21.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:21.388+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:25.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:25.788+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 193966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:29.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:29.828+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:33.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:33.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194139 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:38.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:38.296+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:40.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:40.796+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194299 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:43.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:43.504+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:43.787 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:33:43.788 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:33:43.788 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:33:43.788 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:33:43.789 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:33:43.789 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:33:43.789 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:33:43.789 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:33:43.789 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:43.784+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:33:45.704 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:45.688+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:49.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:49.244+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:49.845 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:49.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:33:49.846 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:49.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:33:55.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:55.240+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:56.676 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:56.672+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:33:58.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:58.927+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:33:58.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:58.927+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:33:58.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:58.927+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:33:58.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:58.927+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:33:58.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:33:58.927+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:33:59.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:33:59.651+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:03.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:03.111+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:06.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:06.303+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:09.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:09.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194845 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:12.943 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:12.907+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 194937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:16.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:16.163+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:17.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:17.927+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:21.570 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:21.563+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:24.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:24.523+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:27.696 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:27.691+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:30.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:30.107+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:37.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:37.759+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:43.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:43.266+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:44.365 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:34:44.362+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:34:44.365 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:34:44.362+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:34:44.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:44.798+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:48.408 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:48.398+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:52.487 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:52.482+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:56.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:56.154+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 195931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:34:59.571 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:34:59.562+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196007 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:04.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:04.302+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:07.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:07.494+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196198 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:12.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:12.218+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:16.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:16.166+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:19.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:19.718+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196436 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:23.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:23.721+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:26.769 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:35:26.769+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:35:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:35:26.769+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:35:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:35:26.769+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:35:26.773 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:35:26.769+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:35:26.774 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:35:26.773+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:35:26.775 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:35:26.773+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:35:28.655 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:28.617+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:35.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:35.225+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:41.923 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:41.913+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196784 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:47.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:47.225+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:52.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:52.129+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 196998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:53.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:53.425+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:54.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:54.937+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:35:58.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:35:58.249+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197193 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:01.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:01.925+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:05.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:05.576+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:09.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:09.048+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197523 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:11.844 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:11.840+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:36:11.846 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:11.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:36:11.846 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:11.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:36:11.846 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:11.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:36:11.847 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:11.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:36:11.847 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:11.844+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:36:12.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:12.812+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:15.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:15.632+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197689 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:18.595 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:18.588+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:19.273 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:19.272+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:36:19.276 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:19.276+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:36:19.277 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:19.276+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:36:19.277 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:19.276+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:36:19.278 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:19.276+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:36:19.280 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:19.276+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:36:21.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:21.300+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197796 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:21.852 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:21.847+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:36:21.853 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:21.851+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:36:21.854 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:21.851+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:36:21.854 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:21.851+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:36:24.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:24.456+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:30.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:30.092+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:32.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:32.648+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 197999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:37.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:37.772+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:39.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:39.984+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:41.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:41.628+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:43.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:43.164+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:44.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:44.496+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:45.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:45.972+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:46.733 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.727+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:36:46.733 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.727+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:36:46.733 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.727+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:36:46.733 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.727+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:36:46.734 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.727+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:36:46.734 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.731+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:36:46.734 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.731+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:36:46.734 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:46.731+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:36:47.475 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:47.467+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198347 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:48.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:48.907+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:50.448 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:50.443+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:52.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:52.031+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198491 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:53.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:53.571+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:55.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:55.007+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:56.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:56.403+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:57.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:57.963+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:59.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:36:59.387+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198651 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:36:59.625 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:59.622+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:36:59.625 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:36:59.622+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:37:00.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:00.791+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198675 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:02.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:02.263+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:03.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:03.631+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198763 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:05.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:05.311+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198784 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:06.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:06.711+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:08.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:08.271+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 198899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:09.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:09.655+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:11.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:11.043+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:12.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:12.675+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:14.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:14.331+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:14.735 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.730+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:37:14.736 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.730+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:37:14.736 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.730+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:37:14.736 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.730+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:37:14.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.734+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:37:14.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.734+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:37:14.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.734+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:37:14.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.734+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:37:14.737 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:14.734+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:37:15.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:15.707+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:17.285 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:17.279+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:18.760 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:18.747+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:20.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:20.215+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:21.861 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:21.855+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:22.024 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:37:22.018+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:37:23.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:23.363+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:24.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:24.711+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:28.482 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:28.466+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199383 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:30.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:30.246+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199484 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:31.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:31.758+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:33.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:33.270+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199555 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:34.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:34.710+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:36.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:36.150+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:37.708 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:37.702+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:39.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:39.282+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:40.893 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:40.882+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:42.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:42.342+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199811 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:43.790 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:43.786+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199872 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:45.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:45.430+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:46.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:46.862+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:48.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:48.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 199983 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:49.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:49.778+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:51.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:51.286+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200040 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:52.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:52.774+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:54.205 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:54.202+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:55.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:55.802+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200143 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:57.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:57.282+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200158 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:37:58.921 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:37:58.914+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:00.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:00.590+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:02.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:02.082+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:03.739 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:03.734+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:05.746 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:05.742+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:07.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:07.202+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200354 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:08.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:08.986+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:10.834 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:10.829+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:12.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:12.613+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:14.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:14.289+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:16.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:16.489+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200540 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:19.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:19.069+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:20.332 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:20.328+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:38:20.335 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:20.332+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:38:20.336 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:20.332+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:38:20.336 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:20.332+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:38:20.336 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:20.332+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:38:20.336 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:20.332+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:38:21.037 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:21.033+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:24.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:24.057+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200756 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:27.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:27.401+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 200900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:28.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:28.705+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:30.327 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:30.321+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201064 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:31.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:31.905+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:33.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:33.385+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201415 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:34.479 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:34.476+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:38:34.479 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:38:34.476+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:38:34.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:34.793+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:36.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:36.165+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:37.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:37.597+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:38.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:38.941+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 201776 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:40.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:40.497+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 202012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:42.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:42.009+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 202246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:43.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:43.657+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 202397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:47.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:47.933+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 202485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:51.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:51.760+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 202658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:38:55.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:38:55.712+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 202888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:00.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:00.220+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:04.708 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:04.700+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203096 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:09.800 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:09.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:39:09.800 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:09.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:39:09.800 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:09.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:39:09.800 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:09.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:39:10.806 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:10.803+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:39:10.808 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:10.803+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:39:10.809 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:10.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:39:10.809 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:10.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:39:10.809 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:10.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:39:10.810 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:10.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:39:10.810 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:10.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:39:12.816 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:12.811+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:39:12.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:12.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:39:12.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:12.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:39:12.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:12.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:39:12.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:12.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:39:12.825 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:12.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:39:12.825 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:12.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:39:13.835 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:13.831+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:39:13.836 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:13.831+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:39:16.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:16.876+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203465 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:19.440 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:19.420+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:22.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:22.036+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203653 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:23.834 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:23.828+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:25.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:25.980+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:27.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:27.956+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:30.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:30.712+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 203946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:33.200 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:33.184+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:35.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:35.515+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:37.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:37.443+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:38.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:38.919+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:39.084 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.078+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:39:39.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:39:39.087 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:39:39.087 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:39:39.087 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:39:39.087 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:39:39.088 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:39:39.088 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:39:39.088 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:39:39.089 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:39.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:39:44.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:44.443+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204287 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:47.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:47.151+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:48.753 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:48.743+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:49.441 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:49.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:39:49.442 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:49.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:39:49.442 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:49.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:39:49.442 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:49.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:39:49.442 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:49.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:39:49.442 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:49.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:39:50.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:50.803+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:53.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:53.315+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:55.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:55.875+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:39:57.238 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:39:57.238 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:39:57.238 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:39:57.239 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:39:57.239 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:39:57.239 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:39:57.239 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:39:57.240 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:39:57.240 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:39:57.234+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:39:58.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:39:58.375+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:00.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:00.959+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204760 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:01.547 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:01.541+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:40:01.548 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:01.541+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:40:02.553 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:02.545+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:40:02.553 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:02.549+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:40:02.554 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:02.549+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:40:03.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:03.543+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 204871 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:05.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:05.383+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205091 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:07.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:07.903+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:10.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:10.159+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:12.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:12.703+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205416 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:14.430 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:14.423+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205432 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:14.644 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:14.641+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:40:14.646 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:14.645+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:40:14.648 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:14.645+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:40:14.648 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:14.645+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:40:14.649 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:14.649+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:40:17.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:17.142+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:18.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:18.766+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:21.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:21.014+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:23.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:23.506+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:25.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:25.074+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205635 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:27.378 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:27.374+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:29.431 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:29.418+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:32.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:32.314+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:34.312 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:34.310+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205791 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:36.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:36.454+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205824 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:37.912 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:37.908+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:40:37.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:37.912+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:40:40.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:40.078+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:42.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:42.466+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:42.693 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:42.688+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:40:42.695 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:42.692+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:40:42.696 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:42.692+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:40:43.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:43.950+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:45.313 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:45.310+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 205999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:45.997 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:45.996+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:40:45.998 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:45.996+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:40:45.999 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:45.996+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:40:45.999 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:45.996+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:40:46.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:46.774+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:47.734 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:40:47.732+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:40:48.332 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:48.330+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:50.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:50.230+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:51.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:51.670+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206107 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:53.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:53.162+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:54.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:54.430+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206180 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:55.722 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:55.718+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:57.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:57.197+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:58.567 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:58.561+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:40:59.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:40:59.885+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:00.878 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.876+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:41:00.878 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.876+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:41:00.878 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.876+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:41:00.878 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.876+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:41:00.879 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.876+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:41:00.879 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.876+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:41:00.881 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.880+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:41:00.881 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.880+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:41:00.882 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:00.880+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:41:01.349 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:01.345+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:02.837 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:02.833+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:04.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:04.101+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:05.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:05.417+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:06.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:06.877+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:08.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:08.257+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:09.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:09.665+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:11.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:11.089+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:12.368 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:12.365+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:13.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:13.649+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 206895 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:14.964 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:14.961+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:16.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:16.277+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:17.682 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:17.677+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:18.302 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:41:18.299+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:41:18.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:18.945+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:20.301 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:20.297+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:21.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:21.669+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207031 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:23.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:23.185+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207036 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:24.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:24.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207047 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:25.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:25.973+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207051 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:27.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:27.357+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207056 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:28.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:28.865+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:30.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:30.149+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207067 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:31.454 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:31.449+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:32.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:32.777+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:34.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:34.133+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207083 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:35.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:35.465+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207087 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:36.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:36.797+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:38.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:38.785+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207103 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:40.075 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:40.068+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207107 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:41.439 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:41.432+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207111 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:42.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:42.744+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207116 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:44.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:44.048+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:45.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:45.392+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:46.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:46.780+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:48.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:48.816+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207136 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:50.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:50.148+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:51.720 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:51.716+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:53.127 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:53.120+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:54.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:54.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:55.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:55.804+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:57.360 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:57.356+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207176 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:41:58.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:41:58.872+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207183 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:00.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:00.148+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207187 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:01.411 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:01.400+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:02.660 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:02.656+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:03.964 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:03.956+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207203 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:05.231 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:05.224+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:06.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:06.492+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:07.748 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:07.740+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207216 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:09.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:09.060+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:10.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:10.396+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207227 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:11.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:11.768+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:13.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:13.164+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:14.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:14.456+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207248 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:15.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:15.796+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:17.151 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:17.144+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:18.391 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:18.384+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:19.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:19.640+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207268 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:20.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:20.947+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207272 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:22.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:22.271+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:23.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:23.599+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:24.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:24.863+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:26.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:26.159+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:26.709 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:26.705+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:42:26.710 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:26.705+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:42:26.711 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:26.705+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:42:26.711 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:26.705+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:42:27.479 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:27.471+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:28.795 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:28.787+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:30.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:30.063+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:30.963 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:30.957+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:42:30.965 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:30.961+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:42:30.965 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:30.961+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:42:30.965 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:30.961+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:42:30.965 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:30.961+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:42:31.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:31.391+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:32.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:32.711+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:34.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:34.051+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:35.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:35.315+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:36.018 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:36.017+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:42:36.018 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:36.017+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:42:36.018 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:36.017+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:42:36.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:36.607+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:39.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:39.323+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:41.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:41.159+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:41.840 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:41.837+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:42:41.840 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:41.837+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:42:42.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:42.571+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:43.911 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:43.903+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:45.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:45.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:47.340 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:47.331+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:47.913 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:42:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:42:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:42:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:42:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:42:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:42:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:42:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:42:47.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:42:47.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:42:47.901+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:42:48.892 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:48.887+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:50.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:50.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:51.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:51.855+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:53.204 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:53.195+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:54.592 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:54.583+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:55.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:55.859+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:58.183 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:58.175+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:42:59.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:42:59.487+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:00.827 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:00.819+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:02.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:02.179+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:03.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:03.450+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:04.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:04.698+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207457 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:06.004 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:05.994+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:07.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:07.314+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:08.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:08.642+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:09.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:09.898+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207477 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:11.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:11.130+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:12.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:12.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:13.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:13.714+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:15.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:15.042+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207497 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:16.307 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:16.302+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:17.534 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:17.530+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:18.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:18.774+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207513 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:20.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:20.070+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:21.315 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:21.310+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:22.548 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:22.546+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:23.846 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:23.842+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:25.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:25.166+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207537 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:25.240 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:25.240+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:43:25.240 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:25.240+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:43:28.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:28.239+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:43:28.247 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:28.243+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:43:28.268 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:28.263+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:43:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:28.267+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:43:28.272 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:28.267+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:43:31.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:31.050+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:32.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:32.582+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:33.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:33.878+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:35.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:35.190+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:36.588 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:36.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:43:36.588 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:36.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:43:36.588 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:36.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:43:36.589 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:36.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:43:36.589 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:36.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:43:36.589 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:36.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:43:36.589 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:36.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:43:37.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:37.638+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:38.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:38.890+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:40.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:40.806+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:44.436 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.427+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:43:44.436 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.427+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:43:44.436 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.427+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:43:44.437 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.427+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:43:44.437 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.431+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:43:44.437 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.431+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:43:44.437 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.431+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:43:44.437 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.431+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:43:44.437 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:44.431+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:43:46.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:problem writing to /var/log/ceph/cluster1-osd.2.log: (28) No space left on device 2019-12-17T01:43:46.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:46.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:46.814 INFO:tasks.ceph.cluster2.mgr.x.smithi106.stderr:problem writing to /var/log/ceph/cluster2-mgr.x.log: (28) No space left on device 2019-12-17T01:43:47.034 INFO:tasks.ceph.cluster1.mon.a.smithi106.stderr:problem writing to /var/log/ceph/cluster1-mon.a.log: (28) No space left on device 2019-12-17T01:43:47.362 INFO:tasks.ceph.cluster1.mgr.x.smithi106.stderr:2019-12-17T00:34:24.943+0000 7f956dd17700 -1 mgr handle_mgr_map I was active but no longer amproblem writing to /var/log/ceph/cluster1-mgr.x.log: (28) No space left on device 2019-12-17T01:43:47.464 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:47.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:43:47.464 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:47.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:43:48.142 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:48.137+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:49.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:49.453+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:50.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:50.837+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:52.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:52.197+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:53.511 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:53.505+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:54.753 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:54.749+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:56.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:56.029+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:57.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:57.289+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:58.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:58.609+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:43:59.566 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.563+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:43:59.577 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.563+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:43:59.578 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.563+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:43:59.579 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.563+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:43:59.579 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.563+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:43:59.580 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.567+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:43:59.580 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.567+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:43:59.580 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.567+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:43:59.581 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:43:59.567+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:43:59.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:43:59.905+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:01.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:01.133+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:02.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:02.361+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:03.629 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:03.625+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:04.886 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:04.881+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:06.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:06.193+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:07.486 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:07.477+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:08.756 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:08.749+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:10.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:10.053+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:11.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:11.297+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207722 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:12.544 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:12.537+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:13.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:13.869+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:15.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:15.209+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:16.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:16.457+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:17.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:17.733+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207747 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:18.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:18.989+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:20.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:20.297+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207758 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:21.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:21.517+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:22.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:22.833+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207767 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:24.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:24.129+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:25.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:25.449+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:26.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:26.801+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207782 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:28.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:28.100+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207787 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:29.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:29.416+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:30.793 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:30.788+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:32.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:32.048+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207807 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:33.418 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:33.412+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:34.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:34.704+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:36.079 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:36.072+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:36.091 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:44:36.086+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:44:36.091 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:44:36.086+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:44:36.092 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:44:36.086+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:44:36.093 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:44:36.090+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:44:37.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:37.292+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207827 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:38.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:38.532+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:39.838 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:39.832+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:41.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:41.044+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:42.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:42.288+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207847 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:43.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:43.600+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:44.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:44.968+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:46.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:46.224+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:47.519 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:47.512+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:48.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:48.824+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207874 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:50.111 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:50.104+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207878 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:51.403 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:51.396+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:52.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:52.728+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207887 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:54.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:54.036+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:55.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:55.312+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:56.115 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:44:56.113+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:44:56.115 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:44:56.113+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:44:56.606 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:56.600+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:57.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:57.924+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207907 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:44:59.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:44:59.224+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:00.481 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:00.472+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207918 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:01.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:01.836+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:03.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:03.164+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207927 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:04.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:04.452+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:05.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:05.732+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207938 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:07.061 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:07.056+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:08.341 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:45:08.341+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:45:08.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:08.448+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:09.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:09.671+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207958 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:10.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:10.939+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:12.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:12.247+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:13.473 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:13.467+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:14.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:14.727+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:15.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:15.971+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207990 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:17.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:17.263+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 207995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:18.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:18.499+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:19.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:19.727+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:21.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:20.999+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:22.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:22.251+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208015 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:22.355 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:45:22.352+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:45:23.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:23.531+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:24.879 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:24.871+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:26.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:26.187+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:27.485 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:27.479+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208035 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:28.750 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:28.743+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:30.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:30.079+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:31.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:31.359+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:32.685 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:32.679+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208055 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:33.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:33.951+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:35.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:35.175+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:36.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:36.487+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208070 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:37.819 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:37.811+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:39.163 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:39.155+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:40.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:40.451+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:41.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:41.695+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:42.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:42.951+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:44.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:44.187+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:45.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:45.487+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:46.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:46.799+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:48.078 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:48.071+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:49.355 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:49.347+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208122 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:50.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:50.735+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:52.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:52.098+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:53.478 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:53.470+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:54.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:54.738+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:56.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:56.038+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208150 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:57.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:57.294+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:58.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:58.590+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208172 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:45:59.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:45:59.926+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208176 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:01.151 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:01.146+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:02.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:02.430+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:03.647 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:03.642+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:04.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:04.894+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208200 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:06.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:06.138+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208204 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:07.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:07.430+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:08.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:08.738+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208216 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:09.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:09.970+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:11.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:11.250+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:12.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:12.498+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:13.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:13.742+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:15.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:15.010+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:16.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:16.258+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208244 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:17.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:17.498+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:18.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:18.790+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208256 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:20.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:20.066+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208260 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:21.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:21.338+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:22.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:22.582+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208269 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:23.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:23.886+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208276 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:25.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:25.182+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:26.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:26.446+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:27.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:27.686+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:28.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:28.982+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:30.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:30.274+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:31.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:31.594+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:32.834 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:32.830+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208309 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:34.057 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:34.054+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:46:34.057 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:34.054+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:46:34.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:34.113+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208316 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:35.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:35.417+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208320 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:36.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:36.665+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208324 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:37.080 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:37.074+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:46:37.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:37.078+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:46:37.084 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:37.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:46:37.085 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:37.082+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:46:38.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:38.021+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:38.102 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:38.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:46:38.102 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:38.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:46:38.102 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:38.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:46:38.102 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:38.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:46:38.103 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:38.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:46:38.103 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:38.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:46:39.108 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:39.102+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:46:39.108 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:39.102+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:46:39.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:39.249+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:40.553 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:40.549+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208349 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:41.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:41.817+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:43.114 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:43.109+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:44.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:44.377+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208365 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:45.751 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:45.745+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:47.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:47.141+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:48.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:48.517+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208385 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:49.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:49.785+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:51.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:51.089+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:52.357 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:52.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:53.237 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.226+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:46:53.238 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.230+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:46:53.238 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.230+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:46:53.238 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.230+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:46:53.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:46:53.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:46:53.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:46:53.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:46:53.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:46:53.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:46:53.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1facb0 2019-12-17T01:46:53.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8f450 2019-12-17T01:46:53.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:46:53.244 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be5dc0 2019-12-17T01:46:53.244 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:46:53.244 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:46:53.244 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:46:53.244 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:46:53.244 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:46:53.245 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:46:53.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:46:53.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:53.577+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:54.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:54.833+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208409 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:56.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:56.045+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:57.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:57.349+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:58.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:58.641+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208425 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:46:59.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:46:59.893+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208429 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:01.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:01.137+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:02.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:02.441+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:03.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:03.729+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208445 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:04.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:04.993+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:06.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:06.221+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:07.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:07.457+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:08.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:08.761+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:10.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:10.057+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:10.401 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:10.397+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:47:10.406 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:10.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:47:10.407 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:10.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:47:10.407 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:10.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:47:11.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:11.285+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:12.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:12.589+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208479 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:13.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:13.841+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:15.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:15.133+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:16.386 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:16.380+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:17.457 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:17.457+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:47:17.458 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:17.457+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:47:17.723 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:17.716+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:19.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:19.012+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:20.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:20.284+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:21.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:21.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:22.819 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:22.812+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:24.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:24.048+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:25.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:25.288+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:26.539 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:26.532+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:27.773 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:27.768+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:29.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:29.044+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:30.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:30.364+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208550 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:31.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:31.596+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:32.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:32.856+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:34.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:34.184+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:35.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:35.472+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:36.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:36.776+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:38.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:38.012+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:39.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:39.388+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:40.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:40.740+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:42.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:42.040+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:43.389 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:43.384+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:44.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:44.700+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208610 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:45.711 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:45.708+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:47:45.712 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:45.708+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:47:45.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:45.708+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:47:45.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:45.708+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:47:45.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:45.708+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:47:45.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:45.708+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:47:45.713 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:47:45.708+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:47:46.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:46.152+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:47.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:47.492+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:48.834 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:48.828+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:50.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:50.232+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:51.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:51.596+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:53.175 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:53.168+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:54.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:54.696+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:56.305 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:56.300+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:57.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:57.575+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:47:58.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:47:58.923+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:00.323 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:00.311+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:01.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:01.655+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:03.167 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:03.159+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208679 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:04.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:04.627+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:06.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:06.063+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:07.522 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:07.515+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:09.172 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:09.163+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:10.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:10.803+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:10.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:48:10.911+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:48:12.390 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:12.383+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:13.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:13.711+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208816 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:15.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:15.139+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208848 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:16.533 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:16.527+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208879 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:18.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:18.303+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208920 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:19.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:19.691+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208951 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:21.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:21.319+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 208986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:22.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:22.759+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209016 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:24.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:24.235+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:25.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:25.631+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209076 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:27.113 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:48:27.111+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:48:27.114 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:48:27.111+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:48:27.114 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:48:27.111+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:48:27.115 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:48:27.111+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:48:27.139 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:27.131+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209112 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:28.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:28.623+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:30.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:29.999+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209172 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:32.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:32.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:33.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:33.463+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209247 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:34.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:34.887+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209280 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:36.307 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:36.299+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209309 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:37.625 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:37.619+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:39.170 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:39.163+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:40.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:40.634+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:42.113 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:42.106+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:43.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:43.502+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209469 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:45.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:45.198+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:46.540 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:46.534+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209533 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:47.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:47.902+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:49.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:49.334+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:50.805 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:50.802+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209623 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:52.540 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:52.538+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209665 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:54.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:54.014+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209692 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:55.372 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:55.370+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209718 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:56.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:56.718+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:58.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:58.062+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209775 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:59.401 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:48:59.394+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209801 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:48:59.443 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:48:59.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:48:59.443 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:48:59.438+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:49:00.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:00.850+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:02.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:02.262+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209863 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:03.615 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:03.606+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:05.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:05.290+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:06.496 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:06.490+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:49:06.508 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:06.498+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:49:06.508 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:06.498+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:49:06.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:06.706+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:08.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:08.174+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 209987 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:10.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:10.074+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:11.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:11.742+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:13.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:13.314+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:15.026 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:15.022+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210132 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:16.712 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:16.710+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:18.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:18.186+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:20.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:20.306+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210234 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:21.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:21.853+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:23.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:23.221+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:24.834 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:24.829+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:26.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:26.357+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210359 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:27.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:27.857+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:29.348 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:29.345+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:30.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:30.765+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:32.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:32.105+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:33.444 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:33.441+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:33.772 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:33.769+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:49:34.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:34.781+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:36.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:36.213+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:37.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:37.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210831 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:38.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:38.925+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:40.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:40.249+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 210984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:41.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:41.593+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:42.893 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:42.889+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211063 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:44.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:44.189+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:45.071 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:45.069+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8f450 2019-12-17T01:49:45.072 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:45.069+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:49:45.072 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:45.069+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:49:45.073 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:45.069+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:49:45.073 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:49:45.069+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:49:45.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:45.457+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:46.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:46.697+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:47.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:47.973+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:49.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:49.217+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211296 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:50.484 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:50.477+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:51.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:51.709+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:52.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:52.945+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211427 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:54.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:54.245+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:55.554 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:55.549+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:56.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:56.869+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211643 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:58.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:58.153+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:49:59.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:49:59.433+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211742 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:00.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:00.721+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:02.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:02.209+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:03.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:03.753+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211838 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:05.127 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:05.120+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:06.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:06.408+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:07.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:07.776+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:09.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:09.176+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211932 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:10.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:10.488+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211936 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:11.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:11.924+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:12.112 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:12.108+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:50:12.112 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:12.108+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:50:12.114 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:12.112+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:50:13.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:13.364+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:14.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:14.796+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211956 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:16.337 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:16.336+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:50:16.338 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:16.336+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:50:16.338 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:16.336+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:50:16.338 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:16.336+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:50:16.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:16.572+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211960 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:18.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:18.000+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211965 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:19.401 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:19.396+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:21.047 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:21.040+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211976 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:22.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:22.600+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:23.970 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:23.964+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:25.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:25.312+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 211996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:26.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:26.720+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:28.127 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:28.120+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:29.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:29.592+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:31.022 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:31.016+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:31.468 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:31.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:50:31.469 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:31.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:50:31.469 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:31.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:50:31.469 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:31.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:50:31.470 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:31.467+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:50:32.545 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:32.540+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:33.898 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:33.892+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:35.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:35.304+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:35.521 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:50:35.522 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:50:36.539 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:36.535+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:50:36.570 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:36.539+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:50:36.571 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:36.539+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:50:36.571 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:36.539+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:50:36.571 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:36.539+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:50:36.571 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:36.539+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:50:36.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:36.692+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212176 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:37.991 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:37.984+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212207 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:39.279 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:39.272+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212236 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:40.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:40.612+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:41.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:41.884+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212295 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:43.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:43.240+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212329 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:44.622 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:44.616+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:46.047 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:46.040+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:47.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:47.563+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:47.646 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:47.643+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:50:47.683 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:47.643+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:50:47.684 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:47.647+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:50:47.684 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:47.647+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:50:47.684 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:50:47.647+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:50:48.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:48.923+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:50.335 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:50.327+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212489 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:51.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:51.683+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212517 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:53.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:53.035+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:54.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:54.371+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:55.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:55.671+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212602 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:57.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:57.011+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212631 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:58.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:58.455+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:50:59.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:50:59.847+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212700 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:01.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:01.311+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:02.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:02.707+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:04.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:04.003+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:05.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:05.315+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212865 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:06.650 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:51:06.646+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:51:06.651 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:51:06.646+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:51:06.651 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:51:06.646+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:51:06.651 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:51:06.646+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:51:06.651 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:51:06.646+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:51:06.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:06.703+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212919 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:07.841 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:51:07.838+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:51:07.842 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:51:07.838+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:51:08.097 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:08.091+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 212976 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:09.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:09.435+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213035 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:10.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:10.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:12.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:12.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213132 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:13.548 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:13.543+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:14.857 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:14.851+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213224 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:16.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:16.287+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213254 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:17.681 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:17.675+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:19.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:19.043+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:20.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:20.379+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:21.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:21.711+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:23.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:23.059+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:24.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:24.375+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213440 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:26.102 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:26.095+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:27.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:27.447+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213509 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:28.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:28.858+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:30.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:30.374+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:31.703 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:31.694+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:33.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:33.122+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:34.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:34.530+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:35.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:35.986+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:37.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:37.450+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213736 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:38.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:38.934+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:40.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:40.326+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:41.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:41.666+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:43.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:43.002+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:44.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:44.394+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:45.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:45.710+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213916 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:47.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:47.114+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:48.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:48.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 213978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:49.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:49.954+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:51.502 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:51.498+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:52.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:52.982+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:54.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:54.438+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:55.955 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:55.950+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214267 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:57.288 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:57.286+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214323 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:51:59.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:51:59.102+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:00.338 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:52:00.337+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:52:00.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:00.618+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:02.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:02.006+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214605 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:03.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:03.574+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:05.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:05.130+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:06.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:06.594+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:08.352 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:08.350+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214740 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:09.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:09.822+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:11.309 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:11.289+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:12.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:12.821+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214836 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:14.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:14.201+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:15.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:15.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:17.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:17.085+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:18.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:18.425+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:19.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:19.857+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 214994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:21.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:21.149+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:22.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:22.545+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215075 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:23.927 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:23.921+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:25.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:25.365+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:26.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:26.829+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:28.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:28.205+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:29.619 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:29.613+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215339 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:31.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:31.077+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215388 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:32.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:32.389+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:33.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:33.977+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215496 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:35.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:35.565+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215555 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:36.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:36.849+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215610 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:38.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:38.197+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:39.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:39.521+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:40.812 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:40.805+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215820 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:42.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:42.221+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215898 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:43.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:43.697+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 215970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:45.052 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:45.049+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:46.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:46.521+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:47.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:47.849+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216178 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:49.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:49.149+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:50.555 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:50.549+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:51.948 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:51.945+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216258 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:53.524 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:53.516+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216284 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:54.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:54.968+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:56.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:56.700+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216345 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:58.066 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:58.060+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216372 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:52:59.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:52:59.440+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216399 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:00.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:00.760+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216424 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:02.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:02.112+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:03.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:03.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:04.722 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:04.716+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216496 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:06.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:06.180+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:07.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:07.540+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:08.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:08.940+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:10.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:10.288+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216597 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:11.683 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:11.676+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:13.063 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:13.056+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:14.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:14.432+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216674 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:15.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:15.768+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:17.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:17.244+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216724 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:18.800 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:18.792+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216755 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:20.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:20.304+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:21.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:21.760+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:23.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:23.264+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:24.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:24.700+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:26.276 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:26.268+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:27.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:27.740+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 216988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:28.132 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:53:28.126+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:53:28.133 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:53:28.130+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:53:29.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:29.188+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217020 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:30.670 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:30.664+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:32.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:32.160+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:33.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:33.760+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:35.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:35.291+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217156 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:36.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:36.731+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:38.292 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:38.283+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:39.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:39.915+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217254 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:41.447 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:53:41.442+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T01:53:41.447 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:53:41.442+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:53:41.448 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:53:41.442+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:53:41.448 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:53:41.442+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:53:41.482 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:41.475+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:42.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:42.923+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:44.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:44.387+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:46.087 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:46.083+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:47.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:47.583+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217436 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:48.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:48.947+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217485 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:50.496 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:50.487+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:52.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:52.007+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:53.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:53.579+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:55.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:55.083+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217702 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:56.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:56.631+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:53:58.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:53:58.727+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:00.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:00.283+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:02.027 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:02.019+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 217948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:02.263 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:02.257+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:54:02.264 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:02.257+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:54:02.264 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:02.257+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:54:02.264 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:02.257+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:54:04.035 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:04.027+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218020 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:06.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:06.691+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:08.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:08.155+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218229 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:09.821 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:09.815+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218312 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:11.332 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:11.325+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:54:11.360 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:11.351+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218396 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:12.853 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:12.847+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:14.412 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:14.407+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:16.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:16.123+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:17.769 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:17.762+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218675 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:19.194 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:19.186+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:20.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:20.762+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:22.276 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:22.266+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218756 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:24.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:24.170+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218789 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:25.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:25.602+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218835 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:27.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:27.150+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:28.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:28.674+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:30.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:30.282+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 218995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:31.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:31.698+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:33.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:33.118+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:34.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:34.910+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:36.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:36.510+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:38.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:38.258+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:39.745 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:39.742+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:41.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:41.174+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:42.842 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:42.838+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:44.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:44.474+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:46.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:46.010+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219525 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:47.604 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:47.598+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:49.239 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:49.234+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219635 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:50.775 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:50.770+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:51.294 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:51.288+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:54:51.294 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:51.288+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:54:51.294 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:51.292+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:54:51.294 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:51.292+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:54:51.295 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:51.292+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:54:51.295 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:54:51.292+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:54:52.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:52.366+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:54.002 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:53.998+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:55.937 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:55.934+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:57.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:57.670+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219915 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:54:59.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:54:59.494+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 219984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:00.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:00.885+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:02.396 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:02.389+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220084 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:03.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:03.809+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220147 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:05.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:05.169+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:06.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:06.653+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:07.851 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:07.848+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:55:07.853 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:07.852+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:55:07.854 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:07.852+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:55:07.854 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:07.852+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:55:08.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:08.153+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:09.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:09.705+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220427 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:10.892 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:10.888+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:55:10.892 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:10.888+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:55:10.893 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:10.892+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:55:10.893 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:10.892+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:55:10.894 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:10.892+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:55:11.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:11.241+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220505 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:12.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:12.665+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:14.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:14.129+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:15.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:15.537+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:17.257 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:17.253+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:18.695 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:18.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:20.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:20.325+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:21.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:21.877+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:23.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:23.429+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 220967 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:24.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:24.921+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221027 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:26.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:26.445+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:27.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:27.893+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:29.382 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:29.377+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:30.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:30.777+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:32.247 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:32.241+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221314 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:33.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:33.633+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:34.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:34.953+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221405 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:36.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:36.277+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221448 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:37.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:37.625+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:38.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:38.973+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221535 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:40.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:40.329+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:41.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:41.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:55:41.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:41.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:55:41.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:41.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:55:41.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:41.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T01:55:41.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:41.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:55:41.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:55:41.815+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:55:41.961 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:41.941+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:43.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:43.444+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221680 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:44.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:44.796+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:46.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:46.208+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:47.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:47.712+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221818 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:49.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:49.212+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:50.667 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:50.660+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221911 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:52.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:52.228+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 221962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:53.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:53.712+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:55.183 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:55.176+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:56.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:56.528+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:57.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:57.888+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:55:59.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:55:59.352+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:00.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:00.780+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:02.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:02.148+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222316 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:03.511 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:03.504+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222363 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:04.902 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:04.896+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:06.307 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:06.300+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222452 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:07.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:07.700+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:09.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:09.188+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:10.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:10.536+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222580 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:11.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:11.984+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:13.436 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:13.432+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:14.130 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:14.126+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T01:56:14.131 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:14.126+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:56:14.131 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:14.126+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:56:14.131 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:14.126+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:56:14.131 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:14.126+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:56:14.132 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:14.126+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:56:14.819 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:14.812+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222703 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:16.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:16.200+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:17.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:17.640+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:19.122 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:19.116+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:20.494 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:20.488+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:21.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:21.872+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 222995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:23.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:23.228+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:24.590 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:24.583+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223088 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:26.014 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:26.007+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:27.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:27.403+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:28.241 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:28.237+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T01:56:28.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:28.237+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T01:56:28.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:28.237+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T01:56:28.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:28.237+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T01:56:28.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:28.237+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T01:56:28.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:28.803+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223160 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:30.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:30.247+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:31.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:31.579+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:32.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:32.935+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:34.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:34.391+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223254 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:35.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:35.815+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223278 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:37.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:37.183+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223300 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:38.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:38.587+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223324 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:40.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:40.087+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:41.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:41.567+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:43.199 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:43.187+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:44.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:44.659+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223423 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:46.224 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:46.219+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:47.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:47.631+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:48.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:48.987+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223500 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:50.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:50.323+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:51.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:51.651+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223545 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:52.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:52.931+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223569 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:54.251 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:54.243+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223591 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:55.580 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:55.571+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:56.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:56.855+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:57.868 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:57.864+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:56:57.868 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:57.864+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:56:57.869 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:56:57.868+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:56:58.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:58.163+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:56:59.489 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:56:59.483+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:00.747 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:00.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:02.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:02.063+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223796 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:03.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:03.355+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223840 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:04.664 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:04.659+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:05.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:05.943+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223921 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:07.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:07.282+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 223959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:08.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:08.602+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:09.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:09.918+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224044 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:11.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:11.246+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224087 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:12.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:12.638+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224127 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:14.031 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:14.022+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224308 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:15.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:15.322+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224356 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:16.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:16.598+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:17.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:17.890+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224399 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:19.069 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.068+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:57:19.070 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.068+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:57:19.072 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.068+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:57:19.073 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.072+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:57:19.073 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.072+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:57:19.073 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.072+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:57:19.074 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.072+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:57:19.074 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:19.072+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:57:19.185 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:19.178+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:20.431 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:20.426+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:21.676 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:21.670+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:22.935 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:22.930+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224419 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:24.203 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:24.198+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:25.486 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:25.482+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:26.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:26.754+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:28.060 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:28.058+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:29.374 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:29.370+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:30.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:30.650+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:31.995 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:31.990+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:33.280 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:33.278+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224459 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:34.623 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:34.618+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:35.965 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:35.958+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:37.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:37.234+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:38.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:38.490+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224479 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:39.818 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:39.814+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:41.135 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:41.130+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:42.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:42.418+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:43.310 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:57:43.307+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:57:43.789 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:43.786+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:45.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:45.150+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:46.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:46.506+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:47.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:47.870+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224519 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:49.173 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:49.169+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:50.438 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:50.433+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:51.760 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:51.757+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:52.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:52.993+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224539 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:54.272 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:54.265+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:55.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:55.569+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224550 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:57.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:57.005+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:58.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:58.313+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224559 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:57:59.641 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:57:59.637+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:00.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:00.889+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:02.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:02.257+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:02.501 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:02.495+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:58:02.502 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:02.499+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:58:02.508 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:02.499+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:58:03.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:03.509+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:04.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:04.869+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:06.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:06.229+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:07.559 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:07.555+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:58:07.561 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:07.559+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:58:07.562 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:07.559+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:58:07.562 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:07.559+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:58:07.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:07.557+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:07.563 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:07.559+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:58:07.563 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:07.559+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:58:08.940 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:08.933+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224599 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:10.242 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:10.237+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224610 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:11.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:11.537+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:12.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:12.821+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224619 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:14.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:14.081+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:15.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:15.413+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:16.715 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:16.709+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224634 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:18.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:18.013+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:19.334 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:19.329+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:20.610 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:20.605+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:21.905 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:21.901+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:23.186 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:23.181+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:24.474 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:24.465+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:25.823 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:25.817+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:27.160 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:27.157+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224675 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:28.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:28.409+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:29.686 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:29.681+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:30.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:30.961+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:32.283 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:32.276+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224705 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:33.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:33.544+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224710 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:34.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:34.808+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:36.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:36.092+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:37.477 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:37.472+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:38.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:38.772+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224730 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:40.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:40.144+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224741 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:41.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:41.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224741 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:42.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:42.836+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:42.862 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:42.858+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:58:42.866 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:42.862+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:58:42.866 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:42.862+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:58:42.867 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:42.862+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:58:42.867 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:42.862+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:58:44.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:44.100+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224757 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:45.360 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:45.356+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:46.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:46.692+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224765 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:47.912 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:47.905+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:58:47.914 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:47.909+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:58:47.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:58:47.909+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:58:47.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:47.972+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:49.270 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:49.264+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:50.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:50.516+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224781 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:51.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:51.792+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:53.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:53.076+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:54.377 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:54.372+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:55.690 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:55.684+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224801 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:57.030 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:57.024+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224805 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:58.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:58.284+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:58:59.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:58:59.596+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224817 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:00.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:00.880+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224821 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:02.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:02.180+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:03.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:03.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:04.737 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:04.732+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224837 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:06.007 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:06.000+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224841 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:07.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:07.284+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224845 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:08.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:08.572+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:09.878 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:09.872+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224857 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:11.161 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:11.156+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:12.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:12.524+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224865 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:13.922 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:13.915+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:15.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:15.219+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224881 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:16.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:16.583+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224885 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:17.949 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:17.943+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:19.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:19.219+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:20.530 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:20.523+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:21.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:21.835+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224905 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:23.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:23.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:23.183 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.180+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T01:59:23.184 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.180+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T01:59:23.184 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T01:59:23.185 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T01:59:23.185 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T01:59:23.185 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T01:59:23.186 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T01:59:23.186 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T01:59:23.186 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T01:59:23.186 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T01:59:23.184+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T01:59:24.490 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:24.483+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:25.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:25.779+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224921 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:27.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:27.087+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224925 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:28.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:28.435+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:29.749 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:29.743+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:31.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:31.063+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:32.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:32.407+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:33.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:33.671+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:35.033 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:35.027+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:36.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:36.435+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224961 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:37.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:37.763+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224968 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:39.150 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:39.143+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224981 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:40.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:40.447+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:41.757 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:41.751+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:43.071 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:43.059+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 224994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:44.335 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:44.327+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:45.631 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:45.623+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:46.990 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:46.983+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:48.274 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:48.267+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:49.617 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:49.611+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:50.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:50.903+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:52.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:52.179+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225029 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:53.456 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:53.447+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:54.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:54.755+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:56.034 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:56.027+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:57.424 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:57.418+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T01:59:58.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T01:59:58.806+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:00.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:00.094+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225061 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:00.506 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:00.503+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:00:00.506 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:00.503+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:00:01.472 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:01.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:02.537 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1fa080 2019-12-17T02:00:02.537 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:00:02.538 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:00:02.538 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:00:02.538 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:00:02.538 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:00:02.538 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:00:02.539 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:00:02.539 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:00:02.539 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:00:02.539 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:02.531+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:00:02.767 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:02.754+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225072 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:04.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:04.186+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:05.496 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:05.494+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:05.570 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:05.567+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:00:05.574 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:05.571+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:00:05.574 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:05.571+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:00:05.574 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:05.571+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:00:05.575 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:05.571+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:00:05.575 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:05.571+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:00:05.575 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:05.571+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:00:06.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:06.774+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:08.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:08.042+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225094 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:09.330 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:09.326+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:10.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:10.658+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:11.636 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.631+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8f450 2019-12-17T02:00:11.637 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.635+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:00:11.638 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.635+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:00:11.638 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.635+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:00:11.638 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.635+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:00:11.638 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.635+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:00:11.639 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.635+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:00:11.644 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:11.635+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:00:11.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:11.942+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:13.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:13.262+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:14.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:14.494+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:15.814 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:15.810+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:17.145 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:17.142+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:18.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:18.386+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225142 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:19.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:19.646+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:20.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:20.990+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:22.239 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:22.234+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:23.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:23.506+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225162 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:24.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:24.810+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:26.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:26.102+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:27.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:27.442+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:28.811 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:28.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:00:28.813 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:28.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:00:28.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:28.811+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:00:28.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:28.811+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:00:28.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:28.811+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:00:28.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:28.811+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:00:28.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:28.826+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225182 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:30.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:30.190+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225189 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:31.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:31.578+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:32.832 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:32.826+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225202 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:34.192 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:34.186+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:35.531 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:35.526+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:36.837 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:36.826+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:38.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:38.090+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:38.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.898+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:00:38.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.898+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:00:38.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.898+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:00:38.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.898+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1facb0 2019-12-17T02:00:38.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.898+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8f450 2019-12-17T02:00:38.906 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.902+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:00:38.907 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.902+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be5dc0 2019-12-17T02:00:38.907 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.902+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:00:38.907 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:38.902+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:00:39.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:39.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225233 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:40.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:40.697+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:42.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:42.017+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:43.360 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:43.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:44.675 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:44.669+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225253 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:46.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:46.013+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:47.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:47.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225261 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:48.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:48.697+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:49.987 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:49.981+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:51.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:51.245+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:52.522 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:52.517+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:53.029 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:00:53.026+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:00:53.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:53.877+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:55.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:55.205+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:56.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:56.621+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:58.036 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:58.033+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:00:59.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:00:59.365+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:00.679 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:00.673+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:02.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:01.997+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:03.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:03.313+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225331 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:04.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:04.637+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225338 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:05.922 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:05.917+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:07.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:07.249+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:08.532 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:08.525+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:09.207 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:01:09.201+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:01:09.207 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:01:09.201+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:01:09.208 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:01:09.201+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:01:09.210 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:01:09.205+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:01:09.211 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:01:09.205+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:01:09.211 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:01:09.205+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:01:09.815 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:09.809+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:11.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:11.105+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:12.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:12.409+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:13.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:13.681+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:15.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:15.053+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:16.427 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:16.421+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:17.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:17.825+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225389 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:19.236 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:19.233+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:20.584 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:20.581+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:21.883 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:21.876+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:23.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:23.172+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225411 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:24.451 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:24.444+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:25.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:25.756+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:27.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:27.004+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:28.262 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:28.256+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:29.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:29.528+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:30.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:30.820+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:32.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:32.124+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:33.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:33.444+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225451 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:34.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:34.760+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:36.086 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:36.080+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:37.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:37.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:38.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:38.880+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:40.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:40.208+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:41.581 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:41.576+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:43.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:42.996+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225501 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:44.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:44.316+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:45.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:45.600+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:46.896 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:46.888+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:48.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:48.176+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:49.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:49.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:50.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:50.796+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:52.063 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:52.056+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:53.409 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:53.404+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:54.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:54.672+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:56.000 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:55.996+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225552 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:57.328 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:57.324+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225556 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:58.658 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:58.652+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:01:59.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:01:59.988+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225573 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:01.273 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:01.268+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225577 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:02.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:02.636+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225581 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:04.023 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:04.015+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:05.376 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:05.371+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:06.718 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:06.703+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225603 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:08.064 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:08.059+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:09.321 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:09.315+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225620 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:10.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:10.575+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225624 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:11.803 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:11.800+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:02:11.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:11.831+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:13.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:13.163+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225633 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:14.465 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:14.459+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225640 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:15.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:15.807+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225644 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:17.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:17.115+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:18.434 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:18.427+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225653 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:19.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:19.767+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225660 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:21.031 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:21.023+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225664 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:22.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:22.295+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:23.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:23.651+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:23.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:23.919+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:02:23.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:23.919+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:02:23.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:23.919+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:02:23.925 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:23.923+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:02:24.999 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:24.991+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225680 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:26.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:26.239+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:27.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:27.595+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:28.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:28.923+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:30.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:30.303+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225700 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:30.993 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:30.991+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:02:30.993 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:30.991+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:02:30.994 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:30.991+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:02:30.994 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:30.991+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:02:30.994 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:30.991+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:02:30.995 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:30.991+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:02:30.995 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:30.991+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:02:31.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:31.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225708 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:33.100 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:33.091+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:34.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:34.399+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225720 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:35.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:35.671+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225724 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:36.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:36.963+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:38.249 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:38.243+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:39.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:39.487+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225740 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:40.790 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:40.783+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225744 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:42.071 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:42.063+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:43.382 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:43.375+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:44.628 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:44.619+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225760 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:45.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:45.950+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225764 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:47.254 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:47.246+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:48.543 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:48.534+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:49.838 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:49.830+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225780 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:51.096 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:51.086+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225784 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:52.344 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:52.338+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225788 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:53.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:53.634+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:54.211 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:02:54.206+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:02:54.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:54.934+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225800 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:56.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:56.190+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:57.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:57.466+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225808 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:02:58.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:02:58.754+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:00.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:00.010+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225820 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:01.340 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:01.338+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225824 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:02.282 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:02.278+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:03:02.282 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:02.278+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:03:02.666 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:02.662+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225828 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:03.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:03.966+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:05.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:05.358+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225843 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:06.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:06.670+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:07.958 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:07.954+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:09.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:09.298+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:10.559 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:10.554+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225864 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:11.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:11.802+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225868 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:13.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:13.126+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:14.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:14.430+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225880 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:15.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:15.778+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225884 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:17.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:17.094+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:18.340 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:18.334+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:19.640 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:19.638+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:20.465 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:20.458+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:03:20.465 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:20.462+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:03:20.465 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:20.462+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:03:20.465 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:20.462+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:03:20.947 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:20.942+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225904 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:22.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:22.206+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225908 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:23.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:23.458+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:24.820 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:24.814+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225920 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:26.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:26.090+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225924 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:27.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:27.402+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225928 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:28.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:28.701+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:30.001 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:29.997+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:31.268 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:31.265+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:31.568 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:31.561+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:03:31.569 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:31.565+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:03:31.569 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:31.565+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:03:31.569 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:31.565+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:03:31.570 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:31.565+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:03:31.570 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:03:31.565+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:03:32.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:32.629+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:34.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:34.021+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:35.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:35.325+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225964 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:36.739 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:36.733+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225972 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:38.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:38.085+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:39.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:39.333+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225984 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:40.656 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:40.649+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:41.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:41.941+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:43.239 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:43.233+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 225997 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:44.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:44.509+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226004 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:45.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:45.849+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226008 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:47.190 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:47.185+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:48.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:48.429+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:49.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:49.733+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226024 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:51.025 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:51.021+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226028 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:52.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:52.329+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226032 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:53.618 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:53.613+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:54.939 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:54.933+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226044 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:56.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:56.177+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226048 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:57.461 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:57.457+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226052 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:03:58.721 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:03:58.717+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:00.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:00.101+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226064 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:01.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:01.449+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226068 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:02.759 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:02.753+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226072 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:04.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:04.105+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:05.488 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:05.485+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226088 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:06.825 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:06.821+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226092 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:07.916 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:07.912+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:04:08.177 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:08.169+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:09.496 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:09.489+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226104 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:10.807 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:10.800+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:12.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:12.100+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226112 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:13.430 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:13.424+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226117 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:14.735 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:14.728+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226124 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:16.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:16.036+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226128 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:17.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:17.288+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226132 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:18.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:18.628+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:19.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:19.904+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:21.246 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:21.240+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:22.589 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:22.584+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226152 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:23.946 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:23.940+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:25.303 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:25.296+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:26.671 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:26.664+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:27.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:27.980+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:29.393 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:29.388+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226218 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:30.680 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:30.676+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:31.960 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:31.952+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:33.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:33.236+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226351 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:34.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:34.604+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226358 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:35.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:35.904+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:37.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:37.228+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:38.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:38.488+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226371 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:39.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:39.784+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:41.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:41.120+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:42.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:42.372+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:43.355 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:43.351+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:04:43.356 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:43.351+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:04:43.356 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:43.351+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:04:43.360 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:43.355+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:04:43.361 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:43.355+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:04:43.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:43.680+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226391 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:44.979 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:44.972+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226398 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:46.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:46.260+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:47.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:47.560+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:48.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:48.824+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226411 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:50.124 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:50.116+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:51.426 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:51.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:04:51.426 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:51.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:04:51.429 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:51.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:04:51.429 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:51.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:04:51.472 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:51.464+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:52.816 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:52.808+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:54.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:54.191+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226431 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:55.464 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:55.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:04:55.466 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:55.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:04:55.469 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:55.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:04:55.469 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:55.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:04:55.469 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:04:55.463+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:04:55.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:55.491+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:56.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:56.867+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:58.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:58.207+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226451 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:04:59.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:04:59.455+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:00.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:00.727+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:02.128 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:02.119+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226467 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:03.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:03.359+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226472 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:04.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:04.647+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:05.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:05.971+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226637 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:07.306 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:07.299+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:08.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:08.551+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:09.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:09.899+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226653 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:11.191 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:11.179+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:12.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:12.487+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226661 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:12.625 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:12.622+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:05:12.626 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:12.622+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:05:12.627 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:12.622+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:05:12.627 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:12.622+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:05:12.627 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:12.622+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:05:12.629 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:12.626+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:05:12.629 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:12.626+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:05:13.797 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:13.791+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:15.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:15.067+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226673 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:15.661 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:15.658+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:05:15.664 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:15.658+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:05:15.664 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:15.658+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:05:15.665 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:15.662+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:05:15.665 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:15.662+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:05:15.665 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:15.662+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:05:16.341 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:16.335+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226677 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:17.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:17.623+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:18.910 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:18.903+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226686 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:20.271 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:20.263+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:21.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:21.635+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226697 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:23.049 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:23.043+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226704 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:24.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:24.399+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:25.665 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:25.659+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:26.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:26.919+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:28.227 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:28.219+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:29.514 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:29.507+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:29.641 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:29.638+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:05:29.641 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:29.638+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:05:29.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:29.638+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:05:29.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:29.638+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:05:29.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:29.638+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:05:29.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:29.638+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:05:29.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:05:29.638+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:05:30.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:30.823+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226737 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:32.131 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:32.123+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226741 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:33.452 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:33.447+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:34.706 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:34.699+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:36.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:36.070+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226757 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:37.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:37.394+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:38.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:38.654+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226766 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:39.942 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:39.934+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:41.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:41.234+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226777 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:42.505 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:42.498+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226781 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:43.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:43.754+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226786 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:45.077 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:45.074+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:46.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:46.414+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:47.764 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:47.758+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226801 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:49.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:49.074+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:50.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:50.410+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:51.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:51.778+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226817 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:53.080 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:53.078+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226825 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:54.418 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:54.414+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:55.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:55.658+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226837 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:56.953 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:56.950+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226841 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:58.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:58.294+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:05:59.547 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:05:59.542+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:00.868 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:00.862+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226857 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:02.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:02.202+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226861 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:03.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:03.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:04.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:04.738+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:06.015 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:06.010+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:07.354 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:07.350+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226881 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:08.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:08.674+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:10.028 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:10.022+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:11.341 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:11.338+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226897 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:12.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:12.646+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226901 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:13.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:13.926+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:15.283 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:15.278+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:16.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:16.638+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:18.076 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:18.073+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226924 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:19.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:19.449+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:20.740 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:20.733+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:21.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:21.989+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226941 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:23.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:23.313+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:24.567 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:24.561+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:25.854 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:25.849+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:27.107 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:27.101+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226961 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:28.394 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:28.389+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:29.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:29.665+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:30.945 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:30.937+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:32.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:32.233+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226981 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:33.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:33.557+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:34.844 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:34.841+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226993 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:36.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:36.157+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 226997 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:37.414 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:37.409+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:38.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:38.737+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:40.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:40.001+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:41.353 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:41.349+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:42.691 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:42.685+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:43.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:43.993+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:45.323 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:45.317+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227033 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:46.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:46.689+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:48.079 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:48.073+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227044 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:49.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:49.493+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:50.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:50.797+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:52.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:52.045+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227061 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:53.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:53.325+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:54.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:54.657+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:55.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:55.953+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:57.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:57.249+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:58.516 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:58.509+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:06:59.777 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:06:59.773+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:01.057 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:01.052+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:02.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:02.372+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:03.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:03.704+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227106 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:04.975 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:04.968+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:06.322 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:06.316+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227117 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:07.608 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:07.604+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:08.889 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:08.884+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:10.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:10.196+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:11.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:11.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:12.866 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:12.860+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:14.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:14.136+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:15.470 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:15.464+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:15.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:15.639+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:07:15.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:15.639+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:07:15.642 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:15.639+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:07:16.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:16.820+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:18.105 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:18.100+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:19.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:19.488+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:20.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:20.756+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:22.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:22.052+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:23.380 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:23.372+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:24.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:24.724+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227193 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:26.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:26.012+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:27.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:27.324+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:28.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:28.672+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:29.997 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:29.992+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227213 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:31.338 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:31.332+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227217 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:32.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:32.596+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227221 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:33.810 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:33.807+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:07:33.871 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:33.864+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:35.211 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:35.204+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227233 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:36.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:36.520+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227237 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:37.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:37.792+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227241 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:39.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:39.104+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:40.468 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:40.464+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227253 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:41.874 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:41.868+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227257 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:43.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:43.363+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:44.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:44.627+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227273 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:45.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:45.895+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:47.218 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:47.211+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:48.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:48.503+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:49.829 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:49.823+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:51.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:51.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:52.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:52.463+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:53.010 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:53.006+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:07:53.010 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:53.006+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be5dc0 2019-12-17T02:07:53.010 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:53.006+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:07:53.010 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:53.006+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:07:53.011 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:53.006+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:07:53.011 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:53.006+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:07:53.011 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:07:53.006+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:07:53.763 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:53.755+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:55.041 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:55.035+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:56.314 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:56.307+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:57.648 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:57.643+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:07:58.932 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:07:58.927+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:00.284 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:00.275+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:01.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:01.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:02.998 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:02.991+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:04.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:04.379+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:05.717 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:05.711+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:07.072 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:07.063+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:08.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:08.359+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:09.169 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:09.165+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:08:09.175 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:09.165+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:08:09.596 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:09.591+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:10.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:10.891+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:12.171 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:12.163+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:13.428 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:13.419+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:14.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:14.695+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227393 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:16.001 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:15.995+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227397 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:17.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:17.323+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227401 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:18.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:18.587+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:19.918 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:19.911+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227413 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:21.238 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:21.231+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227417 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:22.513 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:22.503+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:23.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:23.779+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:25.104 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:25.095+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227433 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:26.417 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:26.410+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227437 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:27.660 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:27.654+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227441 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:28.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:28.926+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:30.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:30.186+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:31.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:31.466+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227463 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:32.785 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:32.778+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227476 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:34.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:34.050+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227481 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:35.381 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:35.378+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227488 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:36.786 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:36.782+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227492 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:38.202 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:38.198+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:38.454 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:38.453+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:08:38.454 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:38.453+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:08:38.454 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:38.453+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:08:38.454 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:38.453+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:08:38.455 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:38.453+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:08:38.455 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:38.453+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:08:38.455 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:08:38.453+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:08:39.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:39.566+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227508 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:40.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:40.878+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227512 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:42.125 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:42.118+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:43.367 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:43.362+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227521 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:44.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:44.686+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227528 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:46.027 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:46.022+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227532 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:47.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:47.338+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227536 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:48.643 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:48.638+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227541 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:50.017 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:50.014+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227548 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:51.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:51.326+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227552 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:52.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:52.586+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227556 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:53.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:53.838+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227561 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:55.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:55.150+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227568 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:56.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:56.414+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:57.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:57.750+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227576 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:08:59.011 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:08:59.006+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227581 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:00.287 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:00.282+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227588 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:01.577 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:01.570+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227592 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:02.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:02.918+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227596 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:04.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:04.222+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227601 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:04.679 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:04.676+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:09:04.679 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:04.676+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:09:04.679 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:04.676+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:09:04.679 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:04.676+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:09:05.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:05.558+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227608 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:06.920 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:06.914+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227612 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:08.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:08.225+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227620 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:09.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:09.589+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227628 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:09.754 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:09:09.755 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:09:09.755 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:09:09.755 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:09:09.755 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:09:09.755 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:09:09.756 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:09:09.756 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:09:09.756 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:09.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:09:10.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:10.917+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227632 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:12.274 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:12.257+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227636 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:13.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:13.601+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:14.875 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:14.869+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227648 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:16.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:16.185+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227652 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:17.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:17.477+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227656 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:18.792 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:18.785+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227661 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:20.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:20.113+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227668 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:21.399 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:21.393+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227672 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:22.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:22.757+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227676 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:24.055 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:24.049+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227681 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:25.370 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:25.365+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227688 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:26.666 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:26.661+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227692 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:27.975 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:27.969+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227696 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:29.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:29.373+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227701 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:30.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:30.697+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227712 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:32.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:32.077+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227716 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:33.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:33.421+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227721 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:34.738 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:34.733+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:36.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:36.057+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227732 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:37.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:37.429+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227736 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:38.682 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:38.677+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227741 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:39.963 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:39.957+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227748 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:41.237 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:41.233+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227752 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:42.560 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:42.553+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227756 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:43.851 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:43.845+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:45.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:45.141+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227768 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:46.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:46.413+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227772 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:47.701 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:47.697+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227776 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:48.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:48.957+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227781 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:50.217 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:50.212+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227789 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:51.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:51.544+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:52.860 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:52.852+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227797 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:53.177 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:53.171+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:09:53.177 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:53.171+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:09:53.177 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:53.171+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:09:53.178 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:53.175+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:09:53.178 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:53.175+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:09:54.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:54.200+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227802 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:55.196 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.190+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:09:55.196 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.190+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:09:55.196 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.190+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:09:55.198 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.194+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:09:55.200 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.194+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:09:55.200 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.194+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:09:55.200 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.194+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:09:55.202 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:09:55.202 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:09:55.203 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:09:55.203 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:09:55.203 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:09:55.203 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:09:55.203 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:09:55.203 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:55.198+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:09:55.569 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:55.564+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227809 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:56.975 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:56.968+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227813 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:57.221 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.214+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:09:57.222 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.214+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:09:57.222 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.214+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:09:57.222 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.214+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:09:57.222 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.214+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:09:57.222 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.214+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:09:57.223 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.218+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:09:57.223 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.218+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:09:57.223 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.218+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:09:57.242 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:09:57.243 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:09:57.238+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:09:58.463 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:58.456+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:09:59.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:09:59.772+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227829 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:00.265 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:00.262+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:10:00.265 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:00.262+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:10:00.266 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:00.262+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:10:00.266 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:00.262+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:10:01.120 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:01.116+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227833 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:02.366 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:02.360+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227837 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:03.654 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:03.648+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:04.934 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:04.928+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227849 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:06.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:06.192+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227853 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:07.501 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:07.496+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227857 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:08.843 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:08.836+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227862 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:10.174 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:10.168+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227869 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:11.521 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:11.512+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:12.379 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:12.374+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:10:12.379 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:12.374+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:10:12.379 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:12.374+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:10:12.379 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:12.374+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:10:12.379 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:12.374+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:10:12.379 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:12.374+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:10:12.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:12.864+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:13.402 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:13.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:10:13.402 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:13.398+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:10:13.402 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:13.398+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:10:13.402 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:13.398+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:10:13.402 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:13.398+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:10:14.239 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:14.232+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227882 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:14.400 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:14.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:10:14.401 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:14.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:10:14.401 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:14.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:10:14.401 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:14.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:10:14.401 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:14.394+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:10:14.401 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:14.398+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:10:14.402 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:14.398+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:10:15.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:15.620+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227889 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:16.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:16.964+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227893 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:18.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:18.304+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227902 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:19.666 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:19.660+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:20.980 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:20.976+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227913 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:22.244 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:22.240+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227917 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:23.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:23.488+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227922 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:24.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:24.760+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227929 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:26.067 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:26.060+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:27.331 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:27.324+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:28.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:28.600+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:29.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:29.892+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227949 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:31.189 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:31.184+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227953 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:32.499 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:32.492+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227957 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:33.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:33.819+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227962 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:35.169 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:35.163+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227969 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:36.484 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:36.475+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:37.768 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:37.763+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227977 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:39.018 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:39.011+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227982 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:40.327 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:40.319+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:41.576 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:41.571+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227993 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:42.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:42.859+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 227997 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:44.152 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:44.143+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228002 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:45.407 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:45.399+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:46.710 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:46.703+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228013 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:48.008 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:48.003+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228017 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:49.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:49.403+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228022 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:50.754 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:50.747+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228033 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:52.131 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:52.123+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:53.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:53.475+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228042 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:54.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:54.795+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:56.136 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:56.127+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:57.464 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:57.459+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228057 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:58.804 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:10:58.799+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228062 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:10:58.843 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.841+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1facb0 2019-12-17T02:10:58.844 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.841+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:10:58.844 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.841+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:10:58.844 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.841+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:10:58.845 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.841+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:10:58.845 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.841+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:10:58.845 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.841+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:10:58.845 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:10:58.845+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:11:00.101 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:00.091+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:01.413 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:01.407+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:02.758 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:02.751+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:04.015 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:04.007+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:05.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:05.347+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:06.614 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:06.607+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:07.944 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:07.939+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:09.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:09.203+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:10.523 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:10.515+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:11.951 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:11.943+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:13.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:13.287+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:14.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:14.703+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228131 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:16.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:16.042+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:17.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:17.294+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228139 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:18.546 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:18.538+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228144 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:19.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:19.794+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228151 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:21.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:21.114+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228155 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:22.449 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:22.442+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:23.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:23.790+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228164 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:25.062 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:25.058+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228171 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:26.358 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:26.354+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:27.658 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:27.654+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:29.006 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:29.002+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228184 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:30.294 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:30.290+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228191 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:31.633 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:31.630+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:32.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:32.882+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:34.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:34.206+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228204 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:35.575 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:35.570+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228211 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:36.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:36.902+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:38.345 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:38.334+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:39.711 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:39.706+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228231 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:41.021 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:41.014+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:42.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:42.334+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228239 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:43.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:43.606+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228244 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:44.913 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:44.910+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228251 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:46.225 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:46.222+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:47.572 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:47.570+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228259 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:48.287 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:11:48.283+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:11:48.288 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:11:48.283+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:11:48.288 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:11:48.283+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:11:48.917 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:48.914+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228264 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:50.212 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:50.210+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228271 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:51.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:51.514+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228277 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:52.799 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:52.794+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228281 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:54.103 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:54.098+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:55.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:55.418+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228293 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:56.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:56.730+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228297 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:58.089 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:58.085+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228301 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:11:59.424 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:11:59.421+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:00.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:00.781+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228317 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:02.175 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:02.169+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228321 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:03.556 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:03.553+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:04.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:04.861+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228333 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:06.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:06.185+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228337 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:07.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:07.513+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228341 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:08.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:08.821+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:10.174 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:10.169+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228353 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:11.004 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:10.999+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:12:11.495 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:11.489+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228357 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:12.794 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:12.789+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228361 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:14.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:14.065+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228367 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:15.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:15.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228374 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:16.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:16.649+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228378 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:17.994 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:17.989+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:19.404 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:19.401+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228387 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:20.770 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:20.765+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228394 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:22.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:22.189+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:23.559 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:23.553+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228407 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:24.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:24.785+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228414 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:26.093 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:26.089+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228418 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:27.335 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:27.329+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:28.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:28.573+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228427 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:29.813 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:29.809+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228434 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:31.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:31.125+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228438 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:32.420 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:32.417+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:33.661 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:33.657+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228447 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:34.912 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:34.909+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228454 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:36.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:36.161+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228458 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:37.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:37.493+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:38.779 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:38.773+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228467 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:40.123 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:40.116+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:41.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:41.400+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228478 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:42.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:42.700+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:43.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:43.964+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228487 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:45.285 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:45.280+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:46.558 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:46.552+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:47.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:47.840+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:49.148 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:49.144+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228507 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:50.405 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:50.400+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228514 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:51.343 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:51.337+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:12:51.343 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:51.337+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:12:51.343 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:51.337+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:12:51.344 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:51.337+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:12:51.346 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:51.341+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:12:51.347 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:51.341+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:12:51.347 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:12:51.341+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:12:51.729 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:51.724+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228518 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:53.059 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:53.052+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:54.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:54.448+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:55.742 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:55.736+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228534 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:57.166 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:57.160+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:58.517 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:58.512+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228547 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:12:59.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:12:59.784+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228554 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:01.050 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:01.044+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:02.395 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:02.388+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:03.700 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:03.696+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:04.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:04.984+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228574 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:05.473 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:05.473+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:13:05.474 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:05.473+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:13:05.474 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:05.473+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:13:05.477 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:05.477+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:13:05.478 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:05.477+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:13:05.478 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:05.477+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:13:06.336 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:06.328+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228578 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:07.620 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:07.616+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:08.870 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:08.864+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228587 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:10.158 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:10.152+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228594 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:11.424 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:11.420+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:12.733 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:12.728+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228602 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:14.098 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:14.092+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228607 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:15.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:15.428+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:15.571 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:15.569+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:13:15.571 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:15.569+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:13:16.770 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:16.764+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228618 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:18.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:18.112+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228622 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:19.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:19.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228627 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:20.840 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:20.832+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228638 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:22.187 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:22.179+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:23.563 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:23.555+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228647 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:24.649 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:24.644+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:13:24.650 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:24.644+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:13:24.650 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:24.644+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:13:24.651 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:24.644+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:13:24.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:24.883+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228654 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:26.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:26.159+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228658 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:27.478 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:27.471+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228663 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:28.765 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:28.759+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228678 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:30.015 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:30.007+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228685 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:30.745 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:30.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:13:30.745 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:30.744+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:13:31.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:31.447+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228689 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:32.741 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:32.735+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228693 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:34.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:34.187+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:35.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:35.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228705 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:35.779 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.776+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:13:35.780 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.776+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:13:35.780 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.780+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:13:35.781 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.780+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:13:35.781 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.780+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:13:35.796 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.792+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:13:35.797 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.792+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:13:35.801 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.796+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:13:35.801 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:35.796+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:13:37.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:37.047+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:38.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:38.467+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228717 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:39.798 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:39.796+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:13:39.799 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:39.796+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:13:39.799 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:39.796+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:13:39.850 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:39.843+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228725 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:41.253 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:41.247+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228729 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:42.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:42.631+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228733 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:43.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:43.971+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228738 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:45.429 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:45.423+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228745 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:46.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:46.839+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228749 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:48.283 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:48.275+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228753 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:49.672 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:49.667+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228762 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:51.009 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:51.003+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228769 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:51.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:51.928+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:13:51.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:51.928+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:13:51.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:51.932+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:13:51.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:51.932+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:13:51.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:51.932+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:13:51.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:13:51.932+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:13:52.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:52.451+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228773 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:53.908 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:53.899+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:55.289 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:55.279+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228785 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:56.646 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:56.639+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228789 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:58.016 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:58.007+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228793 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:13:59.450 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:13:59.443+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228798 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:00.954 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:00.947+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:02.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:02.343+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:03.806 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:03.799+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:05.182 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:05.174+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228883 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:06.632 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:06.622+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:08.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:08.010+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228931 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:09.455 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:09.446+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228955 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:10.810 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:10.802+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 228978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:12.137 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:14:12.139 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:14:12.140 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:14:12.140 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:14:12.140 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:14:12.144 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:14:12.144 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:14:12.144 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:14:12.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:14:12.162 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:12.154+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229003 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:13.696 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:13.694+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:15.062 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:15.058+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229053 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:17.346 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:17.342+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229090 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:18.774 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:18.770+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229116 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:20.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:20.194+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:21.638 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:21.634+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229167 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:23.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:23.214+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:24.707 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:24.702+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:26.317 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:26.314+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229249 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:27.881 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:27.878+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229274 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:29.536 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:29.530+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229304 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:30.969 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:30.966+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229332 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:32.400 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:32.398+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229356 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:33.752 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:33.746+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229381 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:35.094 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:35.090+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229403 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:36.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:36.506+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:37.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:37.894+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229450 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:39.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:39.274+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229474 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:40.671 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:40.666+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229499 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:42.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:42.166+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:43.887 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:43.882+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229601 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:45.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:45.262+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:46.627 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:46.622+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:48.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:48.009+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:49.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:49.365+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229780 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:50.729 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:50.725+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229823 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:52.290 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:52.285+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229867 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:53.659 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:53.653+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229912 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:55.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:55.289+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 229966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:56.904 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:56.901+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230023 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:58.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:58.461+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230120 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:14:59.931 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:14:59.925+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230240 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:01.325 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:01.321+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230265 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:02.728 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:02.725+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:04.196 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:04.189+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230318 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:04.648 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:04.642+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:15:06.079 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:06.073+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230356 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:10.696 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:10.689+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:15:10.696 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:10.689+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:15:10.702 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:10.693+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:15:10.702 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:10.693+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:15:10.702 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:10.693+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:15:10.702 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:10.693+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:15:12.019 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:12.009+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230464 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:13.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:13.913+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230504 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:15.508 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:15.505+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230535 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:17.157 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:17.153+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230558 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:18.797 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:18.789+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:15:18.797 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:18.789+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:15:18.797 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:18.789+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:15:18.797 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:18.789+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:15:18.798 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:18.789+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:15:18.798 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:18.789+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:15:19.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:19.285+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230598 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:20.784 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:20.781+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:22.221 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:22.213+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:23.808 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:23.801+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230683 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:25.241 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:25.237+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230713 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:26.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:26.645+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230736 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:28.255 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:28.249+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230765 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:30.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:30.204+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230804 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:31.687 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:31.680+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230828 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:33.209 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:33.204+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:34.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:34.764+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230880 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:36.261 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:36.256+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 230921 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:37.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:37.720+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231004 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:39.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:39.208+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231011 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:40.974 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:40.968+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:42.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:42.592+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:44.040 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:44.036+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231061 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:45.432 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:45.424+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231087 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:46.839 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:46.832+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231110 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:48.362 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:48.356+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:49.822 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:49.816+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:52.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:52.208+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231206 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:53.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:53.812+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231238 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:55.355 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:55.348+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231340 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:56.830 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:56.824+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231439 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:58.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:58.396+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231494 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:15:59.171 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.168+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:15:59.172 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.168+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:15:59.172 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.168+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:15:59.172 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.168+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:15:59.173 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.168+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:15:59.173 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.168+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:15:59.173 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.172+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:15:59.173 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.172+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:15:59.173 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:15:59.172+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:15:59.978 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:15:59.972+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231572 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:01.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:01.492+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231639 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:03.054 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:03.048+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:04.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:04.640+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231776 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:06.047 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:06.036+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231842 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:07.564 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:07.556+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:08.264 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:08.260+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:16:08.957 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:08.952+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 231973 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:10.364 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:10.356+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232037 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:11.761 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:11.755+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232092 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:13.213 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:13.207+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232143 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:13.308 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.304+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:16:13.309 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.304+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be5dc0 2019-12-17T02:16:13.309 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.304+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:16:13.309 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.304+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:16:13.309 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.304+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:16:13.309 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.304+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:16:13.310 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.308+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:16:13.311 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.308+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:16:13.311 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.308+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:16:13.311 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.308+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:16:13.311 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.308+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:16:13.312 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.308+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:16:13.312 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.308+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:16:13.313 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.312+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:16:13.313 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.312+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:16:13.314 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.312+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:16:13.314 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.312+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:16:13.314 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:13.312+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:16:14.811 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:14.803+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232190 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:16.180 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:16.175+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:17.967 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:17.959+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:20.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:20.199+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232298 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:21.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:21.499+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232319 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:23.251 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:23.247+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232348 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:24.625 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:24.619+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232376 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:25.428 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:25.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:16:25.428 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:25.423+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:16:26.462 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:26.455+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232461 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:27.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:27.907+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:29.930 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:29.923+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232616 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:31.374 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:31.367+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232684 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:33.134 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:33.127+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232755 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:34.519 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:16:34.515+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:16:34.551 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:34.543+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232809 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:36.082 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:36.075+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232858 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:38.079 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:38.071+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232909 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:39.616 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:39.571+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:16:41.350 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:16:41.123+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 232966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:04.811 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.806+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:17:04.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:17:04.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:17:04.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:17:04.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:17:04.816 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:17:04.819 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.814+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:17:04.819 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:04.814+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:17:13.141 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:12.738+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 233820 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:18.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:18.926+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:17:18.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:18.926+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:17:18.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:18.926+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:17:18.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:18.930+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:17:18.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:18.930+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:17:18.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:18.930+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:17:45.900 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:45.841+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234935 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:47.247 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:47.245+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:17:47.248 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:47.245+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:17:47.248 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:17:47.245+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:17:47.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:47.245+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:48.634 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:48.629+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234940 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:49.992 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:49.985+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234942 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:51.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:51.257+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:52.579 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:52.577+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234943 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:53.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:53.909+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234944 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:55.193 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:55.189+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234945 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:56.460 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:56.453+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:57.783 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:57.777+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:17:59.132 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:17:59.129+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234947 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:00.483 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:00.477+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:01.791 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:01.785+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234979 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:03.108 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:03.105+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:04.392 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:04.389+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234988 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:05.698 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:05.693+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234989 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:06.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:06.949+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:08.269 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:08.265+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234992 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:09.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:09.597+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:10.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:10.933+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234995 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:12.320 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:12.317+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 234998 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:13.771 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:13.765+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235000 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:15.020 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:15.013+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:16.438 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:16.433+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235073 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:17.882 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:17.877+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235077 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:19.228 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:19.224+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235082 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:20.649 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:20.644+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235089 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:22.130 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:22.124+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235093 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:23.406 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:23.400+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235097 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:24.781 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:24.772+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235102 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:25.591 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:25.588+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:18:26.298 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:26.292+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235117 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:27.776 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:27.772+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:29.252 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:29.244+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235126 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:30.519 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:30.512+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235133 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:31.847 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:31.840+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235137 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:33.144 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:33.140+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:34.506 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:34.500+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235146 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:35.833 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:35.828+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235153 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:37.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:37.156+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235157 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:38.509 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:38.496+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:39.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:39.908+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235170 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:41.285 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:41.280+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235177 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:42.561 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:42.556+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:43.876 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:43.872+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235186 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:45.156 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:45.148+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235193 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:45.766 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:45.763+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:18:45.766 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:45.763+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:18:45.768 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:45.763+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:18:45.769 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:45.763+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:18:45.769 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:45.763+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:18:46.467 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:46.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235210 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:47.770 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:47.764+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:49.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:49.048+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:50.384 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:50.380+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235557 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:51.662 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:51.656+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235615 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:52.972 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:52.968+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235659 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:54.325 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:54.320+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235698 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:55.684 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:55.680+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:56.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:56.984+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235888 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:57.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:57.899+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:18:57.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:57.899+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:18:57.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:57.899+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:18:57.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:57.899+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:18:57.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:18:57.899+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:18:58.308 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:58.304+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235933 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:18:59.689 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:18:59.684+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235974 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:01.048 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:01.043+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235981 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:02.398 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:02.391+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235985 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:03.702 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:03.695+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 235994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:04.954 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:19:04.951+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:19:04.954 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:19:04.951+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:19:04.955 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:19:04.951+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:19:04.955 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:19:04.951+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:19:04.955 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:19:04.951+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:19:05.087 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:05.079+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236001 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:06.382 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:06.375+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236005 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:07.714 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:07.707+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236009 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:08.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:08.967+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:10.281 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:10.271+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236021 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:11.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:11.575+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236025 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:12.836 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:12.831+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236029 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:14.117 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:14.111+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:15.415 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:15.407+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236041 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:16.708 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:16.703+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236045 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:18.046 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:18.039+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236049 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:19.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:19.343+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:20.705 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:20.699+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236061 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:21.977 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:21.971+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236065 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:23.337 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:23.331+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236069 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:24.598 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:24.591+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236074 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:25.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:25.983+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236081 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:27.433 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:27.427+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:28.713 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:28.707+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236092 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:30.083 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:30.075+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236101 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:31.354 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:31.347+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:32.609 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:32.603+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236109 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:33.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:33.919+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236114 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:35.269 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:35.263+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236121 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:36.553 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:36.547+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236125 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:37.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:37.847+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:39.176 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:39.167+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236134 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:40.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:40.527+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236141 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:41.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:41.803+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236145 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:43.121 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:43.115+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:44.471 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:44.462+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236154 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:45.725 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:45.714+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236161 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:47.005 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:46.998+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236165 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:48.266 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:48.258+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236169 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:49.612 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:49.594+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236174 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:50.985 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:50.978+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236181 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:52.325 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:52.314+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236185 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:53.730 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:53.722+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236192 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:55.095 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:55.090+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236201 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:56.421 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:56.418+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236205 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:57.699 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:57.694+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236209 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:19:58.986 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:19:58.982+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236214 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:00.256 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:00.254+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236222 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:01.601 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:01.594+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236226 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:02.926 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:02.922+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236230 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:04.267 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:04.262+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236235 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:05.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:05.598+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236242 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:06.938 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:06.934+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236246 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:08.215 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:08.202+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236250 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:09.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:09.494+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236255 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:10.817 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:10.814+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236262 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:12.137 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:12.134+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236266 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:13.510 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:13.506+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236270 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:14.890 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:14.886+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236275 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:16.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:16.258+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236286 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:17.594 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:17.590+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236290 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:18.928 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:18.922+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236295 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:20.247 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:20.242+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236302 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:21.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:21.562+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236306 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:22.894 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:22.890+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236310 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:24.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:24.194+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236315 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:25.541 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:25.538+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236322 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:26.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:26.849+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236326 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:28.126 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:28.121+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236330 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:29.442 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:29.437+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236335 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:30.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:30.769+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236342 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:32.073 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:32.069+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236346 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:33.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:33.453+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236350 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:34.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:34.781+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236355 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:36.110 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:36.105+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236362 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:37.493 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:37.489+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236366 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:38.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:38.793+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236373 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:40.165 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:40.161+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236382 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:41.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:41.473+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236386 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:42.796 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:42.789+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236390 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:44.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:44.101+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236395 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:45.443 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:45.437+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:46.766 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:46.761+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236406 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:47.874 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:20:47.872+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:20:47.874 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:20:47.872+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:20:47.875 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:20:47.872+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:20:48.042 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:48.037+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236410 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:49.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:49.333+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236415 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:50.602 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:50.597+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236422 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:51.933 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:51.929+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236426 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:53.210 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:53.205+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236430 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:54.549 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:54.545+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236435 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:55.923 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:55.917+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236442 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:57.333 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:57.329+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236446 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:20:58.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:20:58.665+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236453 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:00.198 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:00.193+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236462 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:01.480 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:01.477+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236466 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:02.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:02.797+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236470 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:04.053 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:04.049+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236475 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:05.051 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:21:05.052 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:21:05.053 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:21:05.053 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:21:05.053 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:21:05.053 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:21:05.053 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:21:05.053 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:05.047+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:21:05.356 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:05.349+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236482 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:06.653 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:06.649+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236486 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:07.973 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:07.969+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236490 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:08.082 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.079+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:21:08.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1fa080 2019-12-17T02:21:08.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:21:08.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:21:08.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:21:08.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:21:08.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:21:08.087 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:21:08.087 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:21:08.088 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:21:08.088 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:08.083+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:21:09.234 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:09.228+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236495 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:10.538 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:10.532+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:11.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:11.804+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236506 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:13.106 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:13.100+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236510 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:14.371 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:14.364+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236515 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:15.732 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:15.728+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236522 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:17.030 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:17.024+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236526 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:18.347 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:18.340+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236530 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:19.657 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:19.652+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236535 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:21.056 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:21.052+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236542 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:22.426 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:22.420+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236546 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:23.824 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:23.800+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236553 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:25.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:25.176+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236562 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:26.535 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:26.528+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236566 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:27.846 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:27.840+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236570 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:29.133 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:29.128+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236575 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:30.515 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:30.508+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236582 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:31.809 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:31.800+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236586 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:33.158 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:33.152+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236590 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:34.469 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:34.464+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236595 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:35.831 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:35.824+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236602 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:37.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:37.148+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236606 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:38.552 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:38.548+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236610 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:38.610 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:38.606+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:21:38.612 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:38.606+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:21:38.612 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:38.606+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:21:38.612 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:38.606+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:21:38.612 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:38.606+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:21:38.613 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:38.606+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:21:38.613 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:21:38.606+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:21:39.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:39.892+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236615 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:41.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:41.288+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236626 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:42.642 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:42.636+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236630 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:44.012 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:44.008+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236635 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:45.329 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:45.324+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236642 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:46.673 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:46.668+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236646 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:47.988 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:47.984+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236650 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:49.265 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:49.260+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236655 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:50.553 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:50.548+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236662 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:51.867 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:51.859+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236666 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:53.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:53.131+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:54.476 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:54.471+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236675 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:55.778 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:55.771+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236682 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:57.164 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:57.159+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236690 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:58.529 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:58.523+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236694 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:21:59.852 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:21:59.847+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236699 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:01.245 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:01.239+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236706 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:02.663 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:02.655+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236714 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:04.036 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:04.031+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236719 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:05.363 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:05.355+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236726 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:06.669 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:06.663+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236730 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:07.924 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:07.919+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236734 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:09.229 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:09.223+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236739 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:10.561 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:10.555+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236746 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:11.723 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:11.717+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:22:11.726 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:11.721+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:22:11.727 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:11.721+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:22:11.727 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:11.721+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:22:11.727 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:11.721+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:22:11.728 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:11.721+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:22:11.728 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:11.721+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:22:11.899 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:11.891+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236750 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:13.232 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:13.227+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236754 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:14.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:14.555+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236759 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:15.916 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:15.907+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236766 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:17.219 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:17.211+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236770 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:18.593 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:18.587+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236774 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:19.941 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:19.935+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236779 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:21.339 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:21.331+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:21.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:21.817+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:22:21.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:21.817+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:22:21.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:21.817+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:22:21.825 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:21.817+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:22:21.826 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:21.821+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:22:22.696 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:22.691+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236794 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:24.043 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:24.035+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236799 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:24.853 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:24.849+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:22:24.854 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:24.849+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:22:24.855 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:24.849+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:22:24.855 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:22:24.849+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:22:25.342 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:25.335+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236806 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:26.637 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:26.631+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236810 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:27.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:27.951+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236814 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:29.248 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:29.243+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236819 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:30.537 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:30.531+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236826 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:31.880 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:31.875+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236830 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:33.195 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:33.186+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236834 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:34.507 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:34.498+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236839 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:35.798 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:35.790+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236846 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:37.119 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:37.110+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236850 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:38.435 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:38.426+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236854 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:39.760 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:39.754+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236859 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:41.090 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:41.082+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236866 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:42.505 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:42.502+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:43.862 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:43.858+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236877 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:45.243 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:45.238+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236886 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:46.607 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:46.594+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236890 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:47.901 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:47.898+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236894 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:49.159 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:49.154+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236899 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:50.412 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:50.410+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236906 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:51.709 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:51.706+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236910 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:52.962 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:52.958+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:54.311 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:54.306+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236919 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:55.645 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:55.642+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:56.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:56.910+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236930 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:58.226 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:58.222+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236934 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:22:59.512 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:22:59.510+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236939 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:00.856 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:00.854+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236946 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:02.155 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:02.150+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236950 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:03.526 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:03.514+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236954 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:04.826 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:04.822+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236959 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:06.207 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:06.202+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236966 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:07.562 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:07.558+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236970 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:08.915 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:08.910+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236978 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:09.272 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:09.268+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:23:09.275 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:09.272+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:23:09.275 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:09.272+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:23:09.276 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:09.272+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:23:10.263 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:10.258+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:11.591 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:11.586+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236990 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:12.845 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:12.838+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236994 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:14.109 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:14.106+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 236999 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:15.410 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:15.406+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237006 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:16.726 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:16.721+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237010 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:18.058 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:18.053+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237014 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:19.340 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:19.337+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237019 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:20.716 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:20.713+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237026 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:22.085 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:22.081+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:23.422 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:23.417+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237034 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:24.688 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:24.685+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237039 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:26.013 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:26.009+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237046 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:27.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:27.281+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237050 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:27.454 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:27.451+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:23:28.605 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:28.601+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237054 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:29.925 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:29.917+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237059 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:31.233 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:31.229+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237066 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:32.566 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:32.561+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237079 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:33.897 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:33.889+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237086 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:35.260 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:35.253+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237095 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:35.528 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.507+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:23:35.528 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.507+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:23:35.528 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.511+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:23:35.528 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.511+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:23:35.528 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:23:35.529 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:23:35.529 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:23:35.529 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:23:35.529 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:23:35.529 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:23:35.529 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:23:35.529 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:23:35.530 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:35.519+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:23:36.557 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:36.553+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237099 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:37.895 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:37.893+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237103 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:39.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:39.137+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237108 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:40.402 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:40.397+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237115 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:40.603 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:40.599+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:23:40.603 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:40.599+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:23:40.605 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:40.599+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:23:40.605 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:40.599+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:23:40.606 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:40.599+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:23:41.787 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:41.781+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237119 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:43.088 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:43.081+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237123 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:44.425 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:44.421+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237128 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:45.743 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:45.737+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237135 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:47.031 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:47.025+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237139 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:48.578 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:48.573+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237143 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:50.003 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:49.997+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237148 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:50.869 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:50.863+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:23:50.870 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:50.863+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:23:50.871 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:50.863+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:23:50.871 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:50.863+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:23:50.871 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:23:50.863+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:23:51.613 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:51.609+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237159 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:53.129 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:53.125+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237163 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:54.719 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:54.713+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237168 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:56.188 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:56.181+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237175 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:57.644 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:57.633+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237179 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:23:59.138 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:23:59.132+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237188 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:00.585 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:00.580+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237195 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:02.101 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:02.088+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237199 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:04.168 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:04.164+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237208 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:05.582 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:05.576+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237215 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:06.971 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:06.964+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237219 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:07.013 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:07.010+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:24:07.013 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:07.010+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:24:07.014 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:07.010+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:24:07.014 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:07.010+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:24:07.016 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:07.010+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:24:08.498 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:08.492+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237223 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:10.181 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:10.172+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237232 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:11.885 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:11.880+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237239 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:13.275 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:13.268+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237243 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:14.727 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:14.720+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237248 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:16.419 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:16.412+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237259 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:17.865 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:17.860+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237263 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:19.387 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:19.380+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237282 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:20.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:20.828+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237309 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:22.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:22.288+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237336 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:23.869 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:23.864+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237369 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:25.416 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:25.408+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237396 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:26.170 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:26.162+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:24:26.170 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:26.166+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:24:26.914 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:26.908+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237421 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:27.194 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:27.190+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:24:27.195 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:27.190+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:24:27.196 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:27.190+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:24:27.199 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:24:27.194+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:24:28.369 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:28.364+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237449 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:29.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:29.836+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:31.319 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:31.312+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237498 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:32.744 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:32.736+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237543 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:34.678 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:34.672+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237555 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:36.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:36.200+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237579 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:38.466 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:38.460+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237614 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:39.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:39.828+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237641 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:41.373 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:41.367+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237670 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:42.801 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:42.795+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:44.457 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:44.451+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237715 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:45.956 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:45.947+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237737 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:47.491 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:47.483+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:49.220 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:49.215+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237790 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:50.982 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:50.975+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237817 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:52.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:52.543+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237844 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:54.277 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:54.271+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237873 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:56.603 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:56.595+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237914 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:58.154 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:58.147+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237937 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:24:59.550 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:24:59.543+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237960 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:01.110 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:01.103+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 237986 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:02.621 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:02.615+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238012 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:04.112 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:04.107+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238036 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:05.497 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:05.491+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238058 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:06.976 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:06.967+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238085 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:08.379 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:08.371+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238105 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:09.835 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:09.827+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238129 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:11.179 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:11.171+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238149 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:12.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:12.631+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238173 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:14.076 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:14.071+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238196 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:15.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:15.583+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238220 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:17.503 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:17.495+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238252 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:18.502 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:25:18.500+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:25:18.504 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:25:18.500+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:25:18.505 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:25:18.500+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:25:19.310 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:19.303+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238279 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:20.772 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:20.763+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238303 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:22.178 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:22.171+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238328 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:23.650 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:23.642+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238352 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:25.206 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:25.198+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238377 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:26.692 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:26.682+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238402 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:28.153 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:28.146+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238427 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:29.527 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:29.518+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238447 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:30.929 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:30.922+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238473 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:32.323 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:32.318+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238493 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:33.841 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:33.834+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238516 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:35.302 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:35.298+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238538 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:36.975 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:36.970+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238567 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:38.445 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:38.442+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238589 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:39.943 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:39.934+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238613 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:41.748 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:41.742+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238657 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:43.201 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:43.198+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238667 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:44.458 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:44.450+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238687 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:45.782 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:45.778+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238709 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:47.295 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:47.290+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238735 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:48.864 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:48.858+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238761 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:50.230 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:50.226+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238778 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:51.555 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:51.550+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238802 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:52.891 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:52.886+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238822 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:54.300 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:54.298+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238841 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:55.693 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:55.690+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238860 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:57.075 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:57.070+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238900 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:25:58.574 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:25:58.570+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238926 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:00.045 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:00.034+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238948 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:01.520 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:01.514+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238975 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:02.952 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:02.946+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 238996 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:04.351 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:04.346+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239030 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:04.895 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:04.891+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:26:04.896 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:04.891+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:26:04.898 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:04.895+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:26:04.898 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:04.895+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:26:05.734 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:05.729+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239071 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:05.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:05.911+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:26:05.916 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:05.911+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:26:05.917 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:05.915+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:26:05.917 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:05.915+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:26:05.917 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:05.915+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:26:05.918 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:05.915+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:26:07.065 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:07.061+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239113 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:08.453 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:08.449+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239160 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:09.888 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:09.885+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239197 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:11.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:11.353+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239239 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:12.803 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:12.797+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239289 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:14.437 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:14.433+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239313 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:15.855 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:15.849+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239379 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:17.054 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:17.050+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:26:17.293 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:17.289+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239479 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:18.802 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:18.797+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239502 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:20.565 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:20.557+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239527 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:22.140 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:26:22.061+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 239551 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:26:26.095 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.090+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:26:26.097 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:26:26.097 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:26:26.097 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:26:26.097 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:26:26.098 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:26:26.098 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:26:26.098 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.094+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:26:26.103 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.098+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:26:26.103 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.098+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:26:26.103 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.098+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:26:26.103 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.098+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:26:26.103 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.098+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:26:26.104 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.098+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:26:26.104 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.098+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:26:26.118 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.114+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:26:26.119 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.114+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:26:26.121 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.114+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:26:26.121 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.114+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:26:26.121 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.114+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:26:26.121 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.114+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:26:26.122 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:26.114+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:26:28.118 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:28.110+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:26:58.388 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:58.381+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:26:58.389 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:58.385+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:26:58.389 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:26:58.385+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:27:01.407 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:01.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:27:01.407 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:01.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:27:01.407 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:01.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:27:01.407 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:01.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:27:01.408 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:01.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:27:01.408 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:01.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:27:01.408 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:01.401+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:27:14.541 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:14.541+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:27:14.542 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:14.541+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:27:27.699 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:27:27.699 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be5dc0 2019-12-17T02:27:27.699 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:27:27.699 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:27:27.700 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:27:27.701 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:27:27.701 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bcdd0 2019-12-17T02:27:27.701 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:27:27.701 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:27.696+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:27:54.938 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:54.936+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:27:54.938 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:54.936+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:27:54.939 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:54.936+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:27:57.988 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:57.984+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:27:57.988 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:57.984+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:27:57.988 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:57.984+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:27:57.988 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:57.984+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:27:57.989 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:57.988+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:27:57.989 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:27:57.988+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:28:12.120 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:12.115+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:28:12.120 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:12.115+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:28:12.121 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:12.119+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:28:12.121 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:12.119+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:28:12.122 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:12.119+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:28:12.122 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:12.119+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:28:12.122 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:12.119+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:28:13.120 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:13.115+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:28:13.122 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:13.119+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:28:14.138 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:28:14.138 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:28:14.139 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.135+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:28:14.141 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:28:14.141 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c39f1facb0 2019-12-17T02:28:14.142 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8f450 2019-12-17T02:28:14.142 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1b0e1a0 2019-12-17T02:28:14.142 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1be5dc0 2019-12-17T02:28:14.142 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:28:14.143 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:28:14.143 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:28:14.143 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.139+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:28:14.145 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.143+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:28:14.145 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:28:14.143+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:29:29.997 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:29.993+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28eea90 2019-12-17T02:29:29.997 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:29.993+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:29:29.997 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:29.993+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:29:29.997 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:29.993+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:29:29.998 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:29.993+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:29:29.998 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:29.997+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:29:58.435 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:58.432+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28efc70 2019-12-17T02:29:58.436 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:58.432+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a28f15a0 2019-12-17T02:29:58.436 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:58.432+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3ade080 2019-12-17T02:29:58.436 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:58.432+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:29:58.437 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:29:58.436+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:30:05.164 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:05.160+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:30:05.164 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:05.160+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:30:05.165 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:05.160+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:30:05.165 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:05.160+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:30:39.458 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:39.455+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:30:39.459 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:39.455+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:30:39.461 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:39.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:30:39.461 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:39.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:30:39.461 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:39.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:30:39.462 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:39.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:30:39.462 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:39.459+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:30:48.588 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:48.583+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:30:48.592 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:30:48.587+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:31:09.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:31:09.815 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:31:09.815 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:31:09.815 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:31:09.816 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.810+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:31:09.816 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.814+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:31:09.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.814+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:31:09.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:09.814+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:31:12.830 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:12.826+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:31:12.830 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:12.826+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:31:27.965 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:31:27.965 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:31:27.967 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:31:27.968 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:31:27.968 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:31:27.968 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:31:27.968 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:31:27.968 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.962+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:31:27.972 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.966+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a1a8ed00 2019-12-17T02:31:27.973 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:31:27.974 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2801330 2019-12-17T02:31:27.975 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:31:27.975 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:31:27.975 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:31:27.975 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:31:27.976 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:31:27.976 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:31:27.976 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:27.970+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:31:40.086 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:40.081+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:31:40.088 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:40.081+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:31:40.089 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:40.081+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:31:40.089 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:40.085+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:31:40.090 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:40.085+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:31:40.090 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:40.085+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:31:50.185 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:50.185+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:31:50.185 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:50.185+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:31:50.185 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:50.185+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:31:50.186 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:50.185+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:31:50.186 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:31:50.185+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:32:15.993 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:32:14.665+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 240870 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:32:15.993 INFO:tasks.ceph.cluster2.mgr.x.smithi106.stderr:2019-12-17T02:32:15.313+0000 7fd7cacf5700 -1 mgr handle_mgr_map I was active but no longer am 2019-12-17T02:32:18.900 INFO:tasks.ceph.cluster2.mgr.x.smithi106.stderr:problem writing to /var/log/ceph/cluster2-mgr.x.log: (28) No space left on device 2019-12-17T02:32:22.506 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:22.504+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:32:22.507 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:22.504+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:32:27.618 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:27.616+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bda00 2019-12-17T02:32:27.621 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:27.620+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bdba0 2019-12-17T02:32:34.603 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:34.600+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:32:56.799 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7aa996700 -1 osd.2 pg_epoch: 115 pg[2.20( v 115'6760 (112'3700,115'6760] local-lis/les=111/112 n=28 ec=13/13 lis/c=111/107 les/c/f=112/108/0 sis=111) [2] r=0 lpr=111 pi=[107,111)/1 crt=115'6758 lcod 115'6759 mlcod 115'6759 active+undersized+degraded mbc={}] bad op order, already applied 45504491 > this 45504394 2019-12-17T02:32:56.811 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:32:56.811 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:32:56.812 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:32:56.812 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:32:56.812 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:32:56.813 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:32:56.813 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:32:56.813 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:32:56.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fa7aa996700 time 2019-12-17T02:32:56.799504+0000 2019-12-17T02:32:56.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T02:32:56.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55c392dbe140] 2019-12-17T02:32:56.814 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.815 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.815 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.815 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.815 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.816 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.816 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.799+0000 7fa7aa996700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fa7aa996700 time 2019-12-17T02:32:56.799504+0000 2019-12-17T02:32:56.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T02:32:56.817 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55c392dbe140] 2019-12-17T02:32:56.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.818 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.821 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:*** Caught signal (Aborted) ** 2019-12-17T02:32:56.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: in thread 7fa7aa996700 thread_name:tp_osd_tp 2019-12-17T02:32:56.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (()+0x12890) [0x7fa7cd8e9890] 2019-12-17T02:32:56.822 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (gsignal()+0xc7) [0x7fa7cc59be97] 2019-12-17T02:32:56.823 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (abort()+0x141) [0x7fa7cc59d801] 2019-12-17T02:32:56.823 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x55c392dbe211] 2019-12-17T02:32:56.823 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.823 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.823 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.823 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.823 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 13: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.824 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 14: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.900 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:2019-12-17T02:32:56.895+0000 7fa7aa996700 -1 *** Caught signal (Aborted) ** 2019-12-17T02:32:56.900 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: in thread 7fa7aa996700 thread_name:tp_osd_tp 2019-12-17T02:32:56.900 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (()+0x12890) [0x7fa7cd8e9890] 2019-12-17T02:32:56.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (gsignal()+0xc7) [0x7fa7cc59be97] 2019-12-17T02:32:56.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (abort()+0x141) [0x7fa7cc59d801] 2019-12-17T02:32:56.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x55c392dbe211] 2019-12-17T02:32:56.901 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.902 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 13: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 14: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-17T02:32:56.903 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.911 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5763> 2019-12-17T02:32:56.795+0000 7fa7aa996700 -1 osd.2 pg_epoch: 115 pg[2.20( v 115'6760 (112'3700,115'6760] local-lis/les=111/112 n=28 ec=13/13 lis/c=111/107 les/c/f=112/108/0 sis=111) [2] r=0 lpr=111 pi=[107,111)/1 crt=115'6758 lcod 115'6759 mlcod 115'6759 active+undersized+degraded mbc={}] bad op order, already applied 45504491 > this 45504394 2019-12-17T02:32:56.912 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5278> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:32:56.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5275> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:32:56.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5274> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:32:56.915 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5272> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:32:56.916 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5271> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:32:56.917 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5269> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:32:56.917 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5268> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:32:56.917 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5267> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:32:56.918 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -4581> 2019-12-17T02:32:56.799+0000 7fa7aa996700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fa7aa996700 time 2019-12-17T02:32:56.799504+0000 2019-12-17T02:32:56.918 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T02:32:56.919 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.919 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.919 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55c392dbe140] 2019-12-17T02:32:56.919 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.919 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.919 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.919 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.920 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.921 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.921 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.921 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.921 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.922 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.922 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.922 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 0> 2019-12-17T02:32:56.895+0000 7fa7aa996700 -1 *** Caught signal (Aborted) ** 2019-12-17T02:32:56.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: in thread 7fa7aa996700 thread_name:tp_osd_tp 2019-12-17T02:32:56.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.923 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (()+0x12890) [0x7fa7cd8e9890] 2019-12-17T02:32:56.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (gsignal()+0xc7) [0x7fa7cc59be97] 2019-12-17T02:32:56.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (abort()+0x141) [0x7fa7cc59d801] 2019-12-17T02:32:56.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x55c392dbe211] 2019-12-17T02:32:56.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.924 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.925 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.925 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.925 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.926 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.926 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.926 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 13: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.926 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 14: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.926 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-17T02:32:56.926 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.927 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5763> 2019-12-17T02:32:56.795+0000 7fa7aa996700 -1 osd.2 pg_epoch: 115 pg[2.20( v 115'6760 (112'3700,115'6760] local-lis/les=111/112 n=28 ec=13/13 lis/c=111/107 les/c/f=112/108/0 sis=111) [2] r=0 lpr=111 pi=[107,111)/1 crt=115'6758 lcod 115'6759 mlcod 115'6759 active+undersized+degraded mbc={}] bad op order, already applied 45504491 > this 45504394 2019-12-17T02:32:56.927 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5278> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a22cd330 2019-12-17T02:32:56.927 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5275> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a2f67330 2019-12-17T02:32:56.927 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5274> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a3adc8f0 2019-12-17T02:32:56.928 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5272> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc1a0 2019-12-17T02:32:56.928 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5271> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bc270 2019-12-17T02:32:56.928 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5269> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65bd930 2019-12-17T02:32:56.928 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5268> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65be080 2019-12-17T02:32:56.928 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -5267> 2019-12-17T02:32:56.795+0000 7fa7bc599700 -1 reset not still connected to 0x55c3a65becb0 2019-12-17T02:32:56.928 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: -4581> 2019-12-17T02:32:56.799+0000 7fa7aa996700 -1 /build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: In function 'void PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)' thread 7fa7aa996700 time 2019-12-17T02:32:56.799504+0000 2019-12-17T02:32:56.929 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:/build/ceph-15.0.0-8533-g8a58d06/src/osd/PrimaryLogPG.cc: 3956: ceph_abort_msg("out of order op") 2019-12-17T02:32:56.929 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.929 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.929 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xdf) [0x55c392dbe140] 2019-12-17T02:32:56.929 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.930 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.931 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.932 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 0> 2019-12-17T02:32:56.895+0000 7fa7aa996700 -1 *** Caught signal (Aborted) ** 2019-12-17T02:32:56.932 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: in thread 7fa7aa996700 thread_name:tp_osd_tp 2019-12-17T02:32:56.932 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:56.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: ceph version 15.0.0-8533-g8a58d06 (8a58d0694cce968d9a21937d52c2e48cfe306455) octopus (dev) 2019-12-17T02:32:56.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 1: (()+0x12890) [0x7fa7cd8e9890] 2019-12-17T02:32:56.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2: (gsignal()+0xc7) [0x7fa7cc59be97] 2019-12-17T02:32:56.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 3: (abort()+0x141) [0x7fa7cc59d801] 2019-12-17T02:32:56.933 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b0) [0x55c392dbe211] 2019-12-17T02:32:56.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 5: (PrimaryLogPG::execute_ctx(PrimaryLogPG::OpContext*)+0x1a09) [0x55c392f9a729] 2019-12-17T02:32:56.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 6: (PrimaryLogPG::do_op(boost::intrusive_ptr&)+0x3e50) [0x55c392f9e660] 2019-12-17T02:32:56.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 7: (PrimaryLogPG::do_request(boost::intrusive_ptr&, ThreadPool::TPHandle&)+0xcf1) [0x55c392fa9761] 2019-12-17T02:32:56.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 8: (OSD::dequeue_op(boost::intrusive_ptr, boost::intrusive_ptr, ThreadPool::TPHandle&)+0x17b) [0x55c392e2f67b] 2019-12-17T02:32:56.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 9: (ceph::osd::scheduler::PGOpItem::run(OSD*, OSDShard*, boost::intrusive_ptr&, ThreadPool::TPHandle&)+0x67) [0x55c393089817] 2019-12-17T02:32:56.934 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 10: (OSD::ShardedOpWQ::_process(unsigned int, ceph::heartbeat_handle_d*)+0x90c) [0x55c392e4bb0c] 2019-12-17T02:32:56.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 11: (ShardedThreadPool::shardedthreadpool_worker(unsigned int)+0x4ac) [0x55c39348b47c] 2019-12-17T02:32:56.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 12: (ShardedThreadPool::WorkThreadSharded::entry()+0x10) [0x55c39348e6d0] 2019-12-17T02:32:56.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 13: (()+0x76db) [0x7fa7cd8de6db] 2019-12-17T02:32:56.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 14: (clone()+0x3f) [0x7fa7cc67e88f] 2019-12-17T02:32:56.935 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-17T02:32:56.936 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr: 2019-12-17T02:32:58.430 INFO:tasks.ceph.cluster2.osd.2.smithi177.stderr:daemon-helper: command crashed with signal 6 2019-12-17T02:33:47.894 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:33:47.855+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 241892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:33:49.694 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:33:49.687+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 241892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:33:51.359 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:33:51.351+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 241892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:33:53.068 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:33:53.058+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 241892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:33:54.597 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:33:54.590+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 241892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:33:56.296 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:33:56.286+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 241892 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:33:57.755 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:33:57.746+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 242428 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:34:39.069 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:34:38.041+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 242669 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:36:29.833 INFO:tasks.ceph.cluster2.mgr.x.smithi106.stderr:2019-12-17T02:36:17.527+0000 7efd44074700 -1 mgr handle_mgr_map I was active but no longer am 2019-12-17T02:36:31.416 INFO:tasks.ceph.cluster1.mon.a.smithi106.stderr:2019-12-17T02:36:31.299+0000 7f1f10280700 -1 mon.a@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is log(6 entries from seq 3395 at 2019-12-17T02:33:49.063753+0000) 2019-12-17T02:36:31.636 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:36:31.627+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 242727 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:36:31.936 INFO:tasks.ceph.cluster2.mgr.x.smithi106.stderr:problem writing to /var/log/ceph/cluster2-mgr.x.log: (28) No space left on device 2019-12-17T02:36:33.286 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:36:33.279+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 242728 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:36:34.748 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:36:34.739+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 242730 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:36:36.588 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:2019-12-17T02:36:36.579+0000 7f6702f62700 -1 osd.2 112 get_health_metrics reporting 242730 slow ops, oldest is osd_op(client.4332.0:312 2.a 2.7160720a (undecoded) ondisk+write+known_if_redirected e104) 2019-12-17T02:42:57.897 INFO:tasks.ceph.cluster1.mon.a.smithi106.stderr:problem writing to /var/log/ceph/cluster1-mon.a.log: (28) No space left on device 2019-12-17T02:42:59.031 INFO:tasks.ceph.cluster1.osd.2.smithi106.stderr:daemon-helper: command crashed with signal 9 2019-12-17T02:46:12.804 INFO:tasks.ceph.cluster2.mon.a.smithi177.stderr:2019-12-17T02:46:12.801+0000 7fd6d0d67700 -1 mon.a@0(leader).osd e117 no beacon from osd.2 since 2019-12-17T02:31:10.163829+0000, 902.639570 seconds ago. marking down 2019-12-17T02:48:49.569 INFO:tasks.ceph.cluster1.mon.a.smithi106.stderr:2019-12-17T02:48:49.565+0000 7f1f10280700 -1 mon.a@0(leader).osd e112 no beacon from osd.2 since 2019-12-17T02:33:47.725507+0000, 901.843052 seconds ago. marking down 2019-12-17T06:21:56.608 INFO:tasks.ceph.cluster1.mgr.x.smithi106.stderr:problem writing to /var/log/ceph/cluster1-mgr.x.log: (28) No space left on device 2019-12-17T06:21:56.948 INFO:tasks.ceph.cluster1.mon.a.smithi106.stderr:problem writing to /var/log/ceph/cluster1-mon.a.log: (28) No space left on device 2019-12-17T06:21:57.028 INFO:tasks.ceph.cluster2.mgr.x.smithi106.stderr:problem writing to /var/log/ceph/cluster2-mgr.x.log: (28) No space left on device 2019-12-17T10:32:09.030 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-17T10:32:09.044 DEBUG:teuthology.task.console_log:Killing console logger for smithi177 2019-12-17T10:32:09.045 DEBUG:teuthology.task.console_log:Killing console logger for smithi106 2019-12-17T10:32:09.046 DEBUG:teuthology.task.console_log:Killing console logger for smithi106 2019-12-17T10:32:09.046 DEBUG:teuthology.task.console_log:Killing console logger for smithi177 2019-12-17T10:32:09.046 DEBUG:teuthology.exit:Finished running handlers